Astral Codex Ten - Grading My 2018 Predictions For 2023
To celebrate the fifth anniversary of my old blog, in 2018, I made some predictions about what the next five years would be like. This was a different experience than my other predictions. Predicting five years out doesn't feel five times harder than predicting one year out. It feels fifty times harder. Not a lot of genuinely new trends can surface in one year; you're limited to a few basic questions on how the current plotlines will end. But five years feels like you're really predicting "the future". Things felt so fuzzy that I (partly) abandoned my usual clear-resolution probabilistic predictions for total guesses. Last week was the tenth anniversary of my old blog (I accept your congratulations), so it's time to look back on my terrible doomed 2018 predictions and see how I did at predicting the last half decade, starting with: Artificial Intelligence2018 was before the birth of GPT-2, the first decent language model, so even including this category was pretty bold. I wrote:
I think I nailed this. I don’t know how I even came up with “AI can generate images and even stories to a prompt” as a possibility! I didn’t even think it was on the radar back then! Two small quibbles: nobody is talking about technological unemployment, because unemployment rates are historically low. And AI safety concerns might occupy a very slightly larger percent of the public imagination. I grade 1, 5, and 6 as coming true; 2, 3, and 4 as not coming true, and 7 as “more”, all of which I got directionally correct. Overall grade: A World AffairsIn 2018, the UK was debating how to Brexit, Syria was winding down its civil war, and ISIS was still considered a threat. I wrote:
I think these were boring cowardly nothing-ever-happens predictions that mostly came true. Various feared EU crises did not materialize. There was no African migrant crisis, but I predicted that might come after 2023 anyway. Unsurprisingly I missed the biggest geopolitical story of this period, the Ukraine war. I grade 1, 3, 4, 5, and 7 as true, and 2 and 6 as false. I don’t think my country predictions were especially good or bad, except that Russia and the UK have indeed been having a hard time. The Middle East as a whole did not get worse. Lebanon did have an economic collapse but has stayed relatively politically stable; the Arabian Peninsula is doing pretty well with a cease-fire still hanging on in Yemen. Overall grade: B US Culture
I think all of this is basically true, though I’m probably judging this through the same biased idiosyncratic social lens that I used in 2018 to see these as rising trends, so I’m not too impressed with myself. I judge 1, 4, 5, and 6 as having happened, and 2 and 3 as not having happened, making me directionally correct on all predictions. You might think these were too easy, but I made them because in 2018 a lot of people were panicking about a (probably poorly handled) poll saying that support for gay rights was collapsing In The Age Of Trump, and I was pushing back against that. Time has proven me right. Overall grade: B+ US Politics2018 was the middle of the Trump administration. It was also the Socialist Moment when people thought something Bernie something something Chapo Trap House meant the far-left was on the rise. I wrote:
Basically none of this happened. The Republican Party hasn’t moved on from Trump in any direction. They have stayed exactly at Trump. Ron DeSantis seems personally successful and good at inciting culture war panics, but I don’t think there is a “DeSantis-ism” that offers a particular vision of 21st century conservatism. Ted Cruz remains irrelevant. The Democrats have not had a crisis. They went with Joe Biden, a likeable compromise candidate who I didn’t even mention as a possibility, and it worked. Kamala Harris didn’t even get close to becoming president, although Biden made the extremely predictable mistake of making her VP. The neoliberal/progressive split continues to exist, but I don’t think it’s tenser than in 2018, and might even be less tense now that socialists have stopped having their Moment. I count predictions 4, 6, and 10 as having happened, and 1, 2, 3, 5, 7, 8, 9, 11, 12, and 13 as not having happened. I’m resolving 14 as Democrat, 15 as the same. My biggest failure here was 10, where I gave Roe vs. Wade only a 1% chance (!) of being overturned! Looking back, in early 2018 the court was 5-4 Democrat, and one of the Republicans was John Roberts, who’s moderate and hates change. I was thinking the court would need two new Republicans, which was a lot to ask of a half-over presidential term, and which required Republicans to keep the Senate during the midterms. And even if the two new justices arrived, overturning Roe would be a startling and unusual break with precedent; even if the justices wanted to restrict abortion, I expected them to do something which kept a fig leaf of not having overturned Roe. And even if I was totally wrong, I expected it to take more than five years for all of this to happen. But in fact they got two more Republican justices, they were willing to break with precedent, and they did it fast. Looking back I probably had enough information that I should have put this at more like 90% or at most 95%. I’m not sure I had enough information to go lower than that, but it sure is embarrassing. Overall grade: F Economics
I don’t think the Officialness Divide or the Ability-To-Circumvent-Regulations Age arrived in any meaningful way. I think I was riding high of the age of Uber and Bitcoin, and expected people to continue to have that level of creative/entrepreneurial spirit, and instead, they didn’t. On the other hand, my crypto prediction seems . . . surprisingly spot-on? Commenters told me I was being silly, that either crypto would take over everything or collapse under the weight of its own uselessness. Instead it did just what I predicted. If I only I could be this prescient when actually investing. I judge 2, 3, 4, and 6 as having happened (though 2 is confounded by COVID). 1, 5, 7, and 8 didn’t happen. Overall grade for this section: B- Science/Technology
We definitely have the technology to do the polygenic score thing. I think impute.me might provide the service I predicted, but if so, it’s made exactly zero waves - not even at the same “somewhat known among tech-literate people” level as 23andMe. From a technical point of view this was a good prediction; from a social point of view I was completely off in thinking anyone would care. The polygenic embyro selection product exists and is available through LifeView. I can’t remember whether I knew about them in 2018 or whether this was a good prediction. As far as I can tell, none of the space tourism stuff worked out and the whole field is stuck in the same annoying limbo as for the past decade and a half. I count 6 and 7 as having happened (the supposedly-glutamatergic antidepressant is Auvelity, though I don't know if that's the real MOA), and 1, 2, 3, 4, 5, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19 as not having happened. This lopsided ratio doesn't necessarily mean I'm a bad predictor (I gave most of them low percent chances), but it does mean most of the exciting things that I hoped would happen didn't. Overall grade: C- X-Risks
People on the subreddit were impressed with this, since it mentioned mishandling infectious disease, heavy-handed government response, and resulting media censorship. But I don’t want to take too much credit here - I was thinking of something much more obviously artificial than COVID (even if it does end up to have been a lab leak), and heavy-handed government response in the sense of cracking down on bio research. That was almost the only area in which the government’s response wasn’t heavy-handed! Really all that this proves is that, like every rationalist, I’ve been in a constant state of mild panic about pandemic-related risks since forever. I don’t think I got any particular details of COVID right. I grade 3 and 4 as having happened, and 1 and 2 as not having done so. Overall grade: B Overall ThoughtsIt was hard to make specific predictions about things five years in advance. I made vague predictions, but it was hard to tell what to think of them. Some took the form of “things won’t change”, and that was true. Is this always a good bet? Is it picking up pennies in front of a steamroller? Sometimes I feel like I boldly said things wouldn’t change when everyone else thought they would go crazy; am I remembering right? How much credit do I get for this? The prediction I am most proud of is the (admittedly conditional, not strongly asserted) possibility that AIs would be able to generate stories and images to a prompt. The prediction I’m least proud of is that Roe v. Wade definitely wouldn’t be overturned. I can’t tell if I was better at predicting technical rather than social issues. If so, I’m not sure whether it was because that’s my strength, because that’s inherently easier, or because I said vague things about technical issues but foolishly said specific things about social issues. Overall these were neither particularly great nor particularly bad. I might have stronger opinions if more people tried this exercise and did better/worse than me. Predictions For 2028?There can’t possibly be a way this ends other than me getting things horrendously wrong and looking like an idiot, to be mocked by people who have never tried making formal predictions themselves. I’m going to get in so much trouble and it will be terrible. Still, for the sake of completeness, and of recording what I believed in 2023 down for all time, here are some vague thoughts, heuristics, and fields that I’m using to think about the next five years. All otherwise undated predictions are about 1/1/2028. AGE OF MIRACLES AND WONDERS: We seem to be in the beginning of a slow takeoff. We should expect things to get very strange for however many years we have left before the singularity. So far the takeoff really is glacially slow (everyone talking about the blindingly fast pace of AI advances is anchored to different alternatives than I am) which just means more time to gawk at stuff. It’s going to be wild. That having been said, I don’t expect a singularity before 2028. SOLOW'S LAW: "Computers are changing everything except the productivity statistics". Even though AIs will be dazzling and wild, they won’t immediately revolutionize the economy (cf. self-driving cars). This doesn't mean they can't become a $100 billion field (there are new $100 billion fields all the time!) or revolutionize a few industries, but I would be mildly surprised if they showed up as a visible break from trend on the big macroeconomic indicators (GDP, unemployment, productivity, etc). I think all of this will show up eventually, but not by 2028.
LIMITS OF SCALING: In theory, GPT-4 will bump up against some fundamental limits of scaling (eg it will use all text ever written as efficiently as possible in its training corpus). I've heard various claims about easy ways to get around this, which will probably work; I expect scaling to continue to produce gains, but this is less obvious than it's been the past five years. Training GPT-4 will cost $100M, which is a lot. Apple spends $20 billion per year on R&D, so it's not like tech companies can't spend more money if they want to, but after the next two OOMs it will start being bet-the-company money even for large actors. I still think it will probably happen, but all of these things might be hiccups that slow things down a little, maybe?
ACTION TRANSFORMERS: Maybe the next big thing. This is where you can give a language model an Internet connection, tell it something like "respond to all my emails" or "order some cheap Chinese food that looks good off UberEats, my credit card number is XXXXX", and it will do it. I think this technology will be ready in the next five years, although it might suffer from the self-driving car problem where you need more nines of reliability than it can provide. You want to be really sure it won't respond to an email from your boss by telling her to f@#k off, or buy a Chinese restaurant instead of food from a Chinese restaurant. I think it will start as an assistant that will run all of its decisions by you, then gradually expand out from there.
CONQUEST OF DIGITAL MEDIA: Can we make an AI that will create a full-length major motion picture to your specifications? IE you give it $2, say "make a Star Wars / Star Trek crossover movie, 120 minutes" and (aside from copyright concerns) it can do that? What about "code me a Assassins-Creed-quality first person shooter game, with muskets, set in the Revolutionary War?" I don’t think we’ll get quite that far in five years, but I think maybe "short cartoony YouTube clip" or "buggy app-style game" could be possible.
SCIENTIFIC RESEARCH: This would be the big one. I think AI will take a long time to conquer fields like biology which involve loops with the physical world (ie you have to put stuff in a test tube and see what happens); even if there are robot test-tube-fillers, anything that has to happen on a scale of seconds or minutes is fatal to AI training. But it wouldn't surprise me if there are subfields of scientific research that tool AIs can do at superhuman levels; some aspects of drug discovery are already in this category. It's just a matter of finding the exact right field and product. I think of AI research this way too; it won't be trivial to make AIs design other AIs, because they still have to train them (a step that takes longer than a few seconds) and see how they work. But maybe some aspects of the process can be sped up.
SOCIAL IMPLICATIONS: Everyone who hasn't been looking at Bing screenshots the past week is light-years behind on thinking about this. AIs are really convincing! And likeable! Lots of people who didn't have "get tricked into having emotions about AIs" on their list of possible outcomes are going to get tricked into having emotions about AIs. I don't know if this will actually have any implications. Some people who want friends or romantic partners will get AI versions of these things, but even the usual type of online friend / long-distance relationship isn't as good as IRL friends / short-distance relationships for most people, and AIs will be a step below even that. I think it will change society some but not overwhelmingly. I'm worried that smug self-righteous gatekeeper types will get even louder and more zealous in their underestimation of AI intelligence ("it's just autocomplete!") to feel superior to the people who say their AI girlfriend is definitely sentient. These people usually get what they want and this might have negative effects on society's ability to think about these issues.
POLITICAL IMPLICATIONS: I think there will be more of a movement to ban or restrict AI. I think people worried about x-risks (like myself) will have to make weird decisions about how and whether to ally with communists and other people I would usually dislike (assuming they would even let us into the coalition, which seems questionable). I think there will be some pointless bills that say they're regulating AI which actually do nothing.
AGI: This is a meaningless term. Some AIs may or may not satisfy some people's criteria for AGI by 2028; if so, it will get an article in some tech publication but otherwise pass unnoticed. This doesn’t mean AGI won’t be a big deal, just that there won’t be a single moment when we obviously have it and everything changes. ALIGNMENT: I don't think AI safety has fully absorbed the lesson from Simulators: the first powerful AIs might be simulators with goal functions very different from the typical Bostromian agent. They might act in humanlike ways. They might do alignment research for us, if we ask nicely. I don't know what alignment research aimed at these AIs would look like and people are going to have to invent a whole new paradigm for it. But also, these AIs will have human-like failure modes. If you give them access to a gun, they will shoot people, not as part of a 20-dimensional chess strategy that inevitably ends in world conquest, but because they're buggy, or even angry. I think we will get plenty of fire alarms, unless simulators turn out to be a flash in the pan and easily become something else (either because humans have developed a more effective capabilities paradigm, or because some simulator AI autogenerates an agent by accident). I think this is probably our best hope right now, although I usually say that about whatever I haven't yet heard Eliezer specifically explain why it will never work. POLITICS/CULTURE: I think 2020 will have been a low point; things won't get that bad and violent again in the next five years. Wokeness has peaked - but Mt. Everest has peaked, and that doesn't mean it's weak or irrelevant or going anywhere. Fewer people will get cancelled, but only because everyone has settled into an equilibrium where they know what the cancellable opinions are and don't say them (or because everyone with a cancellable opinion has already been removed, or was never hired in the first place). These kinds of legacy social movements that have lost the mandate of heaven do decay and decline eventually, but it could take decades. BIOLOGY: My model is something like: start with 1% risk of artificial pandemic catastrophe per decade in 1985, double every ten years. We're up to about 8 - 16% per decade for the 2020s, so about halve that for the 2023 - 2028 period. By "catastrophe" I mean "worse than COVID". I've been overall disappointed with advances in genetics and I don't expect anything more interesting than one or two last-ditch treatments for rare diseases, if that. IVG probably advances but not enough to make front-page news.
INTERNATIONAL: IDK, I don't expect a Taiwan invasion. Generally bearish on China for the usual reasons: I just think they've built up too much debt (literal and metaphorical), have a demographic time bomb, it's always hard to come down from the high of fast growth, and even though their mixed centralized-ish model worked well before, I think Xi is a significant change towards traditional dictatorship which doesn't work as well. I don't expect this to produce any obvious explosion or disaster for them before 2028 though. I expect Ukraine and Russia to figure out some unsatisfying stalemate before 2028, followed by massive growth in Ukraine (usually happens post-war, they'll probably get favorable terms from lots of other countries including an EU admission deal, they're overdue for a Poland-style post-communist boom).
ECONOMICS: IDK, stocks went down a lot because of inflation, inflation seems solveable, it'll get solved, interest rates will go down, stocks will go up again? In terms of crypto, I'll repeat what I said on my last crypto post: people have found some good applications for stablecoins, especially in foreign countries and for niche transfers by large actors. I expect that to continue, maybe expand, and in that sense I'm bullish, but all of this will get regulated to the point of total boringness. Ethereum will do fine because stablecoins are built on its chain, Bitcoin will do find because Bitcoin maximalists are like cockroaches and even a nuclear war couldn't kill them, altcoins will mostly not do fine. There will still be some exciting applications for solving coordination problems and protecting privacy, but they will be limited to the same niche groups of cypherpunks who cared about these things before cryptocurrency, and mostly not change the world. An exceptionally good result within this window would look like the same kind of niche that Signal has for communication. GENERAL: I think my decision to devote more space to AI than to all non-AI-related things combined will look prescient, even if my explicit predictions are wrong. You're currently a free subscriber to Astral Codex Ten. For the full experience, upgrade your subscription. |
Older messages
Open Thread 264
Monday, February 20, 2023
...
Trying Again On Fideism
Friday, February 17, 2023
...
Declining Sperm Count: Much More Than You Wanted To Know
Friday, February 17, 2023
...
Contra Kavanaugh On Fideism
Tuesday, February 14, 2023
...
Ro-mantic Monday 2/13/23
Tuesday, February 14, 2023
...
You Might Also Like
China has utterly pwned 'thousands and thousands' of devices at US telcos [Tue Nov 26 2024]
Tuesday, November 26, 2024
Hi The Register Subscriber | Log in The Register Daily Headlines 26 November 2024 US China tech trade war China has utterly pwned 'thousands and thousands' of devices at US telcos Senate
What A Day: Hindsight is 2024
Tuesday, November 26, 2024
The Harris campaign leadership speaks out for the first time on what went wrong. ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏
What the Tweens Actually Want
Tuesday, November 26, 2024
Plus: What Neko Case can't live without. The Strategist Every product is independently selected by editors. If you buy something through our links, New York may earn an affiliate commission.
Dr. Oz Shilled for an Alternative to Medicare
Monday, November 25, 2024
Columns and commentary on news, politics, business, and technology from the Intelligencer team. Intelligencer politics Dr. Oz Shilled for an Alternative to Medicare Trump's pick to oversee the
7 button-ups we love
Monday, November 25, 2024
Plus: A deal on a very giftable robe View in browser Ad The Recommendation Ad Our favorite button-ups A view of the torsos of two people wearing button-up shirts with their hands in the pockets of
Tuesday Briefing: Trump’s criminal cases likely to be dismissed
Monday, November 25, 2024
Plus, a possible cease-fire deal in Lebanon. View in browser|nytimes.com Ad Morning Briefing: Asia Pacific Edition November 26, 2024 Author Headshot By Justin Porter Good morning. We're covering a
Organ Grinder
Monday, November 25, 2024
Your Aging Parts, Robots Advance ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏
Ready For Master Plan Season Two?
Monday, November 25, 2024
We are ready to start Master Plan season two, which will be just as powerful as season
Five new startups to watch
Monday, November 25, 2024
Former Amazon Care leader's startup provides virtual support for caregivers | SparkToro co-founder launches game studio ADVERTISEMENT GeekWire SPONSOR MESSAGE: Get your ticket for AWS re:Invent,
☕ Rage against the returns
Monday, November 25, 2024
Retailers take steps to curb returns. November 25, 2024 Retail Brew Presented By Bloomreach It's the last Monday before Black Friday, and Chili's just released a line of bedding products that