Astral Codex Ten - More Thoughts On Critical Windows
On the fetish post, I discussed people who had some early sexual experience - like seeing a sexy cartoon character - and reacted in some profound way, like becoming a furry. Sometimes people have described this as a “critical window” for sexuality (similar to the “critical period” in language learning?) where young children “imprint” on sexual experiences - and then can’t un-imprint on them later, even when they see many examples of sex that don’t involve cartoon animals. One of my distant cousins won't eat tomatoes. His parents say when he was very young, he bit into a cherry tomato and it exploded into goo in his mouth, and he was so upset he wouldn't eat tomatoes from then on. Now he’s in his 30s and still hates them. Is this fairly described as a “critical window” for food preferences? Both of these sound like trapped priors: a very strong early event coloring experience so hard that it becomes impossible to update away from it. This can happen whenever: trauma is an age-neutral example. So why are there so many examples in childhood? In a typical AI training run, the AI starts at a very high learning rate (also called “temperature”) and gradually “cools” down over time. Think of this as a solution to a hill-climbing algorithm: in the early part of the run, you’re trying to explore the surface of the earth and find where the high mountains are; in the middle part, you’re trying to explore the Himalayas to find Everest; near the end, you’re trying to see if going a few feet east or west on Everest will bring you closer to the summit. So at the beginning, you might start in a random place and want to see if 500 miles away is more mountainous. But once your hard work has brought you 1000 feet from Everest’s summit, you don’t want to take a 500 mile jump and end up in New Delhi and have to start all over again. Plausibly, early childhood plasticity exists for the same reason; children should have higher learning rates; each update should be larger. So maybe incidents like the tomato explosion are more likely to have long-term consequences because children’s very large updates are more likely to land them in trapped priors. Not only is an adult’s ability to update away from the tomatoes-are-bad attractor limited by the prior affecting their future judgments, they can’t make updates of that size anymore. Many critical periods are more specific and better-defined than these: animals that can’t see out of one eye for the first few months of life permanently lose the ability to process that eye. So learning rate decay is probably better seen as a general principle which is implemented differently (and at different timescales, and with different levels of severity) in different systems. This still doesn’t explain the unpredictable nature of preference-changing events. My cousin had a bad experience with a tomato in childhood, but was that really his worst childhood experience? I had a really scary time at a beach once during childhood, where I thought I would be swept away and drowned - but I got over it and now I like beaches just as much as everyone else. Was my cousin’s experience with the tomato worse (along some axis) than my experience with almost drowning? What about all of us who see cartoon animals but heroically resist becoming furries? I think it’s helpful to notice these kinds of events seem more common in childhood - but even with a theory to explain them, they’re still pretty mysterious. You're currently a free subscriber to Astral Codex Ten. For the full experience, upgrade your subscription. |
Older messages
Critical Periods For Language: Much More Than You Wanted To Know
Wednesday, August 23, 2023
...
What Can Fetish Research Tell Us About AI?
Monday, August 21, 2023
Epistemic status: Ha ha, only serious
Open Thread 290
Monday, August 21, 2023
...
Your Book Review: The Mind Of A Bee
Friday, August 18, 2023
Finalist #14 In The Book Review Contest (cw: insect pics)
Bride Of Bay Area House Party
Thursday, August 17, 2023
...
You Might Also Like
'The most serious telecom hack in our history'
Saturday, November 23, 2024
Elon Musk's problem with Microsoft | Can you lie to an AI chatbot? ADVERTISEMENT GeekWire SPONSOR MESSAGE: Get your ticket for AWS re:Invent, happening Dec. 2–6 in Las Vegas: Register now for AWS
Bitcoin Nears $100,000 | Ledger’s Big Break
Saturday, November 23, 2024
A historic rally fueled by Trump's crypto agenda pushes bitcoin to new heights. Forbes START INVESTING • Newsletters • MyForbes Nina Bambysheva Staff Writer, Forbes Money & Markets Follow me on
The New MASTER PLAN
Saturday, November 23, 2024
Our second season will expose another hidden plot that has brought our world to the brink of collapse.
Guest Newsletter: Five Books
Saturday, November 23, 2024
Five Books features in-depth author interviews recommending five books on a theme Guest Newsletter: Five Books By Sylvia Bishop • 23 Nov 2024 View in browser View in browser Five Books features in-
Weekend Briefing No. 563
Saturday, November 23, 2024
Beyond the Bots -- The Lonely Technology Trap -- Africa's Healthcare Paradox ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏
Gladiators, vanity and self-restraint
Saturday, November 23, 2024
+ what's causing West Coast's drenching weather
Isabelle Huppert’s Uniqlo Socks and Paige DeSorbo’s White T-shirt
Saturday, November 23, 2024
Plus: Inside New York department stores of yore. The Strategist Every product is independently selected by editors. If you buy something through our links, New York may earn an affiliate commission.
The best carry-on backpacks
Saturday, November 23, 2024
A few of our favorites are on sale View in browser Ad The Recommendation Ad Consider a carry-on travel backpack Three carry-on backpacks pictured together. Connie Park/NYT Wirecutter Opening a good
☕ Ragebait
Saturday, November 23, 2024
Bluesky might be having its Justin Bieber moment... November 23, 2024 View Online | Sign Up | Shop Morning Brew Presented By The Points Guy Good morning. Christkindlmarket season is upon us. Here's
The Russian Missile, America's Deadliest Animals, and a Math Emergency
Saturday, November 23, 2024
NATO and Ukrainian officials will hold emergency talks Tuesday after Russia escalated hostilities with a hypersonic missile strike on a military facility in Dnipro last Thursday. ͏ ͏ ͏ ͏ ͏ ͏