Astral Codex Ten - Lives Of The Rationalist Saints
St. Felix declared publicly that he believed with 79% probability that COVID had a natural origin. He was brought before the Emperor, who threatened him with execution unless he updated to 100%. When St. Felix refused, the Emperor was impressed with his integrity, and said he would release him if he merely updated to 90%. St. Felix refused again, and the Emperor, fearing revolt, promised to release him if he merely rounded up one percentage point to 80%. St. Felix cited Tetlock’s research showing that the last digit contained useful information, refused a third time, and was crucified. St. Clare was so upset about believing false things during her dreams that she took modafinil every night rather than sleep. She completed several impressive programming projects before passing away of sleep deprivation after three weeks; she was declared a martyr by Pope Raymond II. St. John of Daly City left his hometown at age sixteen to join the Centrist Order, who tried to free themselves of political bias by meditating on moderate positions. Unsatisfied with their limited piety, he and several other members of the order split to found the Ultra-Both-Sidesists, known for extreme pronouncements like “If you favor either of Democrats or Republicans over the other by even one percent, you are no better than a mindkilled MAGA/woke fanatic.” He (or according to some scholars, one of his disciples) invented a new Implicit Association Test that could be used to ferret out even tiny amounts of political favoritism, then took it every day, scourging himself when he deviated from perfect neutrality by even a single question. When he died, nobody in his order could form an opinion on who should replace him; finally, the whole sect was dissolved by Pope Anna III and its assets donated to shrimp welfare. St. Promentius shut himself in an eremite’s cell and vowed not to leave until he had figured out the secrets of AI corrigibility. He stayed in the cell for nine years, speaking to nobody except an intern who came once a week to bring him whiteboards, markers, and bottles of Huel. At the end of nine years, the intern told him that the city planned to build an apartment tower over his cell. St. Promentius refused to break his vow and leave the cell. But he also refused his intern’s offer to inform the city of his presence, saying that “he who delays a building for any reason shall be judged with the NIMBYs”. His cell was demolished during the construction and it is assumed that he died, although others say that he only sleeps within the masonry, and will return during Crunch Time. St. Madeline Medianus had many interesting opinions on AI safety, but nobody listened because she was ugly, shy, and a bad speaker. She prayed for help, and one night Gwern appeared to her in a dream and told her a personalized supplement stack that would make her beautiful and charismatic. She took the supplements, got invited to all the cool parties, and her theories became the talk of the town. But she realized that her beauty and charisma were making people take her too seriously compared to others, so she lowered the dose until she was exactly average-looking and people would update on her opinions exactly the right amount. St. Alyssa wrote the decisive refutation of the Deutschist heresy. Then she thought about it harder, changed her mind, and wrote a new treatise about why maybe Deutschism actually made some good points. Although she died a heretic, Pope Oliver V canonized her anyway, because he didn’t want fear of negative reputational consequences to dissuade people from changing their minds on important questions. St. Philip of Lighthaven was captured by the Petersonites, who demanded that he profess that, although God might not exist, we should believe in Him anyway for pragmatic reasons. Philip retorted that he had a 16% probability in God's existence, and a 75% chance that believing in God would make the average person better off, but that credence in the latter belief should not affect credence in the former. While the Petersonites were busy trying to figure out whether he even disagreed with them or not, he snuck outside, opened the gates to their fortress, and sent a signal to the Rationalist army, who fell upon them and destroyed them. St. Joanne of ARC had a resume so beautiful that Sam Altman, Demis Hassabis, and Elon Musk all sought her hand as employee. They became increasingly insistent that she choose one of them, and refused to take ‘no’ as an answer. She asked Paul Christiano what to do, and on his advice she called the three men together and said “I will make my decision once my simple twenty-line program finishes running”. After they agreed, she revealed that her program was calculating BusyBeaver(100), and they all admitted they were unworthy of her. She cut her hair, gave her jewelry to the poor, and joined the Alignment Research Center, where she discovered many important theorems. Some say Jane Street is named after her, although others attribute it to a St. Jane of Manhattan who is otherwise unrecorded. St. Elizabeth of MIT was disowned by her father, an important founder, when he found her in the brothel consorting with prostitutes. Elizabeth was too humble to speak out in her own defense, and said nothing. But she had only befriended the prostitutes so he could learn their advanced surveying methodology and obtain their datasets, which she used to found a highly-effective org surveying expert opinion on important topics. When her father found out, he fell at Elizabeth’s feet and begged her forgiveness, then donated his fortune to his daughter’s work. St. Michael Beisotsukai was sent by Pope Eliezer LXXVII to evangelize to the postrationalists. When he arrived at TPOT, they fell upon him, taunting “If you are so rational, then predict the way we are going to kill you”, for however he predicted, they planned to kill him through some other method. But St. Michael gave a probability distribution across all common methods of execution that also left substantial probability mass on unknown unknowns, and followed it up with an eloquent lecture on out-of-model error. The postrationalists were so impressed that they converted on the spot and didn’t kill him at all - but this was fine, because St. Michael’s distribution had included a 10% chance that this would happen, and later evidence from other missionaries demonstrated this to be well-calibrated. St. Avi the Greater fasted in the desert for thirty days, where he was tempted by Moloch. “Found a new AI lab,” said Moloch, “and I will make you powerful among men.” But Avi refused, saying “What use is power, if it only accelerates race dynamics?” Then Moloch continued: “Found a new AI lab, and I will make you a billionaire.” But Avi refused, saying “What use is money, when Open Philanthropy already has $20 billion and can’t find enough high-impact charities with room for more funding?” Then Moloch continued: “Found a new a AI lab, and I will give you all the kingdoms of the world.” But Avi refused, saying “I don’t even like the term ‘AI lab’ - that paints a picture of disinterested basic research that they don’t live up to. You can just say ‘AI company’.” Then Moloch howled, defeated, and Avi went on to found many highly-effective orgs. You're currently a free subscriber to Astral Codex Ten. For the full experience, upgrade your subscription. |
Older messages
Highlights From The Comments On Tegmark's Mathematical Universe
Thursday, February 27, 2025
... ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏
Open Thread 370
Thursday, February 27, 2025
... ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏
Why I Am Not A Conflict Theorist
Thursday, February 27, 2025
... ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏
Ask Me Anything (2/2025)
Friday, February 14, 2025
... ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏
Deliberative Alignment, And The Spec
Friday, February 14, 2025
... ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏
You Might Also Like
DOGE Said It Cut $232 Million From Social Security Budget. It Was Only About Half a Million.
Thursday, February 27, 2025
The cut, an anti-trans attack, was the latest example of confusion sown by bold claims that wither under scrutiny. Most Read DOGE Said It Cut $232 Million From Social Security Budget. It Was Only About
Mushroom Font
Thursday, February 27, 2025
Is God A Mushroom? // The Hardest Working Font In Manhattan Mushroom Font By Caroline Crampton • 27 Feb 2025 View in browser View in browser Is God A Mushroom? John Last | Long Now | 26th February 2025
⚔️ ‘Witcher 4’ Devs Reveal New Details
Thursday, February 27, 2025
Plus: James Gunn just pointed out Marvel's biggest problem — again. Inverse Daily A new behind-the-scenes video on The Witcher 4's reveal trailer gives us a few hints at what the development
Is the EU drifting right and being cut adrift?
Thursday, February 27, 2025
+ Gene Hackman, an actor's actor
Cambodia 1:0 malaria
Thursday, February 27, 2025
They're actually almost done with it. what happened last week in Asia, Africa and the Americas Hey, this is Sham Jaff, a freelance journalist focused on Asia, Africa and the Americas and your very
Critical PostgreSQL bug tied to zero-day attack on US Treasury [Mon Feb 17 2025]
Thursday, February 27, 2025
Hi The Register Subscriber | Log in The Register Daily Headlines 17 February 2025 treasury Critical PostgreSQL bug tied to zero-day attack on US Treasury High-complexity bug unearthed by infoseccers,
☕ Setting a president
Thursday, February 27, 2025
The US wants a mineral rights deal with Ukraine... February 17, 2025 View Online | Sign Up | Shop Morning Brew Sponsored by Apple Card Good morning. Did you know that Presidents Day (today) doesn't
🚂 Get on the right track
Thursday, February 27, 2025
Fun stuff for you to click on curated with joy by CreativeMornings HQ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏
Ukraine Talks in Saudi Arabia, Three-Peat Slam Dunk, and Cake-Eating Opossum
Thursday, February 27, 2025
High-level diplomatic efforts to end the war in Ukraine are accelerating, with US and Russian officials set to begin talks in Saudi Arabia this week, though European allies have not been invited. ͏ ͏
In botched DEI purge, OSHA trashes workplace safety guidelines
Thursday, February 27, 2025
The Occupational Safety and Health Administration (OSHA) has ordered the digital and physical destruction of 18 publications on workplace safety practices, according to an internal February 7 email