Astral Codex Ten - Criticism Of Criticism Of Criticism
I. The voters clearly wanted Anti-Politics Machine to be a Book Review Contest Finalist this year, and I listened. But I wasn’t happy about it. I hate having to post criticism of EA. Not because EA is bad at taking criticism. The opposite: they like it too much. It almost feels like a sex thing. “Please, tell me again how naughty I’m being!” I went to an EA organization’s offices once - I think it was OpenPhil, but don’t quote me on that - and the whole place was strewn with the most critical books you can imagine - Robert Reich, Anand Giradharadas, that kind of thing. Can’t remember seeing Anti-Politics Machine but I’m sure it was there. Probably three copies per person. One for their office, one for their home library, and one for the spot under their mattress where other people would hide porn mags. (I’m deliberately not expanding the acronym “EA”. If you don’t know what it is, think of it as a variable, like “X”. In fact, do this even if you do know what it is.) Many of the highest-upvoted posts on the EA Forum are criticism. The more critical, the more upvotes. A typical careful well-thought out post by a community leader gets 25, maybe 50 upvotes. A case against RCT-driven development aid somewhat related to the one in Anti-Politics Machine got 389. It was the #6 most upvoted post of all time, and the only reason it wasn’t higher was because stronger criticisms of EA beat it out. There are 147 posts tagged criticism of EA, 59 tagged criticism of EA organizations, 35 tagged, criticism of the EA community, and 66 tagged criticism of EA culture - including 4 posts criticizing EA for being too unwilling to solicit and listen to criticism. In the most EA thing to ever happen, some people have launched a $100,000 prize for the best criticisms of EA (don’t bother writing in to criticize the contest, it’s already been done). I think it would be cheaper to just hire high-priced dominatrices. At this point, reading an article like this one, you already know what the next “narrative beat” has to be. Despite Their Superficial Openness To Criticism, People In EA Are Only Willing To Engage With A Narrow Selection Of Critiques That Flatter Their Preconceptions, While Truly Threatening Criticisms Are Excluded From The Window Of Acceptable Discourse. People Who Are Able To Speak The Language Of Power And Criticize EA Legibly In Its Own Terms Get Flattered And Rewarded With Trivial Changes, While People Who Genuinely Challenge The Establishment Are Dismissed As Beyond The Pale Of “Respectable” Criticism And Ignored Or Punished. (while I was editing this essay, someone wrote this inevitable thing, but I don’t think you should update too much on the details, any more than you would update on who in particular picked up a $20 bill on the ground, or what kind of bending motion they used) The fact that this has to be the next narrative beat in an article like this should raise red flags. Another way of phrasing “this has to be the next narrative beat” is that it’s something we would believe / want to believe / insert at this place in our discourse whether it was true or not. That means we need to be on extra special good epistemic behavior when we try to consider whether it’s true in this individual case, understanding that we’ll have a strong bias towards assuming “yes” that needs to be counteracted. Even more important, if the abstract egregore of EA has a humiliation fetish, that last paragraph - the one with “Despite Their Superficial Openness To Criticism, People In EA Are Only Willing To Engage With A Narrow Selection Of Critiques…” is at the exact center of the fetish. That’s the one porn video that they keep coming back to, the one where they hope nobody opens their computer and notices the “You viewed this 5,946,728 times” caption in their browser history. This makes me suspicious. II. Psychiatry has its own stock criticisms of itself. We rely too much on pills. We don’t get to know patients enough as individuals. We only treat the symptoms, not the real disease of [insert wild speculation]. We are probably systemically racist somehow, details to be filled in later. Something something Thomas Insel’s RDoC program. Non-psychiatrists in the popular media have stolen these criticisms and made them dumber, but we had them all first. In 2019 I reported on the American Psychiatric Association’s annual meeting. Here is a small fraction of the seminars on offer:
Disruption! Grabbing the third rail! Asking about what we’re overlooking! It seems that psychiatry, like EA, is really good at criticizing itself. Even better: these aren’t those soft within-the-system critiques everyone is worried about. These are hard challenges to the entire paradigm of capitalism or whatever. And it’s not just the APA as an institution. Go to any psychiatrist at the conference and criticize psychiatry in these terms - “Don’t you think our field is systemically racist and sexist and fails to understand that the true problem is Capitalism?” and they will enthusiastically agree and maybe even tell you stories about how their own experience proves that’s true and how they need to try to do better. Is there any criticism that can touch these people at all? Here’s my proposal: ask why they prescribe s-ketamine instead of racemic ketamine for treatment-resistant depression. If you say this, psychiatrists will push back. If you say it in a confrontational way - maybe you hint that they’ve outsourced their thought processes to a handful of regulators and pharmaceutical companies even when this severely disadvantages patients, because thinking for themselves is hard and scary - they’ll get offended. The world is full of psychiatrists who will confess to systemic racism with a smile on their face, then get all huffy when you ask them about esketamine. Here are other criticisms that I think can actually start fights: should tricyclics be higher on our treatment algorithm for depression than atypical antipsychotics? Should we use levothyronine more (or less) often? And my nominee for “highest likelihood of people actually coming to blows” would be asking if they’re sure it’s ethical to charge poor patients three-digit fees for no-shows. All of these are the opposite of the racism critique: they’re minor, finicky points entirely within the current paradigm that don’t challenge any foundational assumptions at all. But you can actually start fights if you bring them up, instead of getting people to nod along and smile vacuously. The racism critique doesn’t imply any specific person is doing any specific thing wrong. Certainly not you! It doesn’t demand any specific response except maybe more awareness, saying the right slogans, and maybe having some other person form a committee to make meaningless changes to some set of bylaws. But the esketamine critique actually demands that you in particular go out and learn about a different medication which is kind of scary and could you them in trouble if you use it wrong. It implies that you personally are failing patients, in a way that some other doctors aren’t failing patients. Maybe it means those other doctors are better than you! And so the knives come out. III. This is also how I think about EA criticism. I’m going to give an example of criticism I don’t like. I hate doing this, because all the criticism pieces are heartfelt and people worked hard on them. But I have to pick on someone in particular, so I’m going to pick on Some Blindspots In Rationality And Effective Altruism (disclaimer: I appreciate the work that went into this and like the people involved). It tries to get ahead of any “this isn’t paradigm-busting enough” by making extremely general and abstract points, like:
This is just a selection and I don’t claim I’m being fair or representative. I’m having trouble expressing why I feel so uneasy about this. Part of it is emotional: I feel less enlightened than preached at. Do we really not think of the interdependence between individuals? Does this really make us less effective in some way? Or is this just a sort of stock criticism with such a storied tradition that everyone has agreed to nod their head to it and agree to do better later? Are we sure that becoming less individualist would be a better use of our energy than becoming more individualist? How did we achieve that certainty? It sure seems like more individualist countries are richer and better places to live. And that within those countries, the most individualist regions and social networks are the richest and best. Aren’t more intelligent people generally more individualist when you do the psych tests and surveys? I don’t know, if I thought it was a good use of our resources to move some direction on the individualism spectrum, I would be kind of interested in trying to figure out how to move even more towards the individuals-are-independent side than we are now. But realistically I don’t think this is a good use of our resources because I personally am not sure how to do that, I personally am not interested in singlehandedly inventing the science of shifting position on the individualism spectrum, I don’t think trying to invent this science is a great use of anyone else’s time, and if someone did claim they invented this science, it would take a lot of evidence for me to believe them. (again, I think I’m being terribly unfair here to the author, who was genuinely worried about these blindspots, but I’m using this as an example of my reaction to different types of criticism) What’s the EA equivalent of the s-ketamine critique? A Critical Review Of Open Philanthropy’s Bet On Criminal Justice Reform argues that one of a major EA funder’s programs was substantially less effective than their other programs, that this had been easy to notice for a while, and that despite this they continued the program instead of changing it or cutting their losses. Everyone in EA is very nice, so all of the responses were phrased as “thank you for this constructive criticism, but having said that I wanted to raise…” But subtracting out the usual niceness level, I get the impression it actually hit a nerve. There was some pretty deep discussion about whether the criticism was fair, whether it was excessively hostile to identifiable individuals, and (of course) nitpicking all the math. Here are some differences I noticed between the experience of reading the more specific criminal justice criticism vs. the more paradigmatic structures-and-individualism criticism:
This isn’t to say that paradigmatic criticisms are always bad and useless, and specific criticism is always good. But the specific criticism at the end of Part I above - that the people in power prefer specific to paradigmatic criticism, because it’s less challenging - seems to me the exact opposite of the truth. IV. But we’ve got to change paradigms sometimes, right? How do we do that without soliciting paradigmatic criticism? I don’t know, man, I don’t know. Thomas Kuhn seemed to think of paradigm shifts as almost mystical processes. You don’t go in some specific direction carefully signposted “Next Paradigm”. Anomalous information comes in from the blue, someone happens to be in the right place to detect it, everyone agonizes over it for a while, the enigmas pile up higher and higher, and at some point the free energy becomes unbearable and everything does some multi-dimensional conformation shift and now you have a new paradigm. By the time ordinary outsiders hear about a paradigm shift, it’s already well into its lifecycle. Then it looks like a hidebound establishment refusing to go in the direction marked “Next Paradigm”. This is a fun situation, because on these rare occasions only you can be a bold pioneer who’s infinitely far ahead of the experts just by following signposts. It’s so fun that it can be hard to resist the temptation to believe you’re in it: just as economists have predicted ten of the last two recessions, so science journalists have predicted ten of the last two paradigm shifts. These are two different phases: waiting for anomalies and inspiration, vs. yelling at the hidebound establishment to accept the new order. And they require somewhat different virtues. The virtue of the first phase is looking for anomalies. These aren’t vague, sweeping, and ideological. The anomalies with Newtonian gravity weren’t things like “action at a distance doesn’t feel scientific enough” or “it doesn’t sufficiently glorify Jesus Christ” or even “it’s insufficiently elegant”. The one that ended up most important was “its estimate for the precession of the orbit of Mercury is off by forty arc-seconds per century”. I don’t know if it’s meaningful to talk about EA needing “another paradigm” - this whole discussion conflates scientific theories, ideologies, and methods for producing change. But if it does, it will come from complaints like the criminal justice criticism, which record boring ways that EA-as-it-exists-now made bad decisions on some specific point. If we had a hundred such complaints, maybe we could figure out some broader failure mode and how to deal with it. The virtue of the second phase is changing your mind and getting on board with the new program. But the new program has to exist first. If you can’t name a specific new program to get on board with, you’re still in the first phase, and you should be meticulously recording the orbit of Mercury instead of making sweeping statements including the word “hidebound”. What happens if you demand a new paradigm before enough anomalies have built up? If you incentivize people to preach at you, they’ll do that. But they can’t preach the tenets of the new paradigm, because they don’t know it yet. And they can’t preach the implementable tenets of the old paradigm, because you’ve already implemented them. So instead, they’ll preach things the old paradigm says are good, which haven’t been implemented because they’re vague or impossible or not worth the tradeoff against other considerations. Listen too hard, and you’ll go from a precise and efficient implementation of the old paradigm, to a fuzzier implementation that emphasizes trying to do vague, inefficient, or impossible things. This isn’t just a failure mode of EA or psychiatry, it’s a failure mode of whole societies. Sorry to everyone I had to implicitly attack in order to make this point. I felt like this of all essays needed to be specific and offend nameable people. You’re a free subscriber to Astral Codex Ten. For the full experience, become a paid subscriber. |
Older messages
Open Thread 233
Monday, July 18, 2022
...
Your Book Review: The Righteous Mind
Friday, July 15, 2022
Finalist #10 in the Book Review Contest
Impact Markets: The Annoying Details
Friday, July 15, 2022
...
Book Review: The Man From The Future
Wednesday, July 13, 2022
...
Mantic Monday 7/11/22
Tuesday, July 12, 2022
New star forecasting team -- Musk vs. Twitter -- Donald Trump wriggling his way out of things
You Might Also Like
How “Y.O.L.O. Joe” Can Beat The Lame Duck
Thursday, November 28, 2024
Here is what Democrats could actually achieve in the months before Trump takes office. Need a productive political topic to discuss at the Thanksgiving table? Want to impart key facts as you pass the
Trump Cabinet Bomb Threats, Ancient Sandwiches, and a Popsicle Caper
Thursday, November 28, 2024
Several of President-elect Donald Trump's Cabinet nominees and administration appointees faced bomb threats and "swatting" attacks on Tuesday and Wednesday. ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏
First-ever UEFI bootkit for Linux in the works, experts say [Thu Nov 28 2024]
Thursday, November 28, 2024
Hi The Register Subscriber | Log in The Register Daily Headlines 28 November 2024 KITTY LOOKS AT SCREEN AI GENERATED First-ever UEFI bootkit for Linux in the works, experts say Bootkitty doesn't
On My Mind: Fig Ornaments and Striped Bath Mats
Thursday, November 28, 2024
Plus: Eensy-weensy, teeny-tiny gifts. The Strategist Every product is independently selected by editors. If you buy something through our links, New York may earn an affiliate commission. November 27,
What It’s Like to Be on Trump’s Enemies List
Wednesday, November 27, 2024
Columns and commentary on news, politics, business, and technology from the Intelligencer team. Intelligencer power What It's Like to Be on Trump's Enemies List “Revenge does take time.” Photo-
GeekWire Mid-Week Update
Wednesday, November 27, 2024
Read the top tech stories so far this week from GeekWire Top stories so far this week Microsoft credited with spotting sophisticated Chinese hack that hit telecoms including T-Mobile US officials say a
Thursday Briefing: A fragile cease-fire in Lebanon
Wednesday, November 27, 2024
Plus, a post-election Thanksgiving. View in browser|nytimes.com Ad Morning Briefing: Asia Pacific Edition November 28, 2024 Author Headshot By Gaya Gupta Good morning. We're covering the first day
Turn your ideas into reality at AWS re:Invent 2024
Wednesday, November 27, 2024
Join in person or the free livestream and learn all things AWS and generative AI GeekWire is pleased to present this special sponsored message to our Pacific NW readers. Don't miss your chance to
SIROTA’S SIGNALS: A New MAGA Plot To Kill Anti-Corruption Laws
Wednesday, November 27, 2024
Plus, new data on Liz Cheney's election effect, the connection between real estate and your insurance premium, and a hidden city discovered under the ice. A New MAGA Plot To Kill Anti-Corruption
Erik Prince sued The Intercept
Wednesday, November 27, 2024
There is an increasingly common strategy by billionaires to weaponize libel law against journalism — and in the Donald Trump era, we can expect the legal attacks on the free press to rise. In 2020, The