Astral Codex Ten - More Thoughts On Critical Windows
On the fetish post, I discussed people who had some early sexual experience - like seeing a sexy cartoon character - and reacted in some profound way, like becoming a furry. Sometimes people have described this as a “critical window” for sexuality (similar to the “critical period” in language learning?) where young children “imprint” on sexual experiences - and then can’t un-imprint on them later, even when they see many examples of sex that don’t involve cartoon animals. One of my distant cousins won't eat tomatoes. His parents say when he was very young, he bit into a cherry tomato and it exploded into goo in his mouth, and he was so upset he wouldn't eat tomatoes from then on. Now he’s in his 30s and still hates them. Is this fairly described as a “critical window” for food preferences? Both of these sound like trapped priors: a very strong early event coloring experience so hard that it becomes impossible to update away from it. This can happen whenever: trauma is an age-neutral example. So why are there so many examples in childhood? In a typical AI training run, the AI starts at a very high learning rate (also called “temperature”) and gradually “cools” down over time. Think of this as a solution to a hill-climbing algorithm: in the early part of the run, you’re trying to explore the surface of the earth and find where the high mountains are; in the middle part, you’re trying to explore the Himalayas to find Everest; near the end, you’re trying to see if going a few feet east or west on Everest will bring you closer to the summit. So at the beginning, you might start in a random place and want to see if 500 miles away is more mountainous. But once your hard work has brought you 1000 feet from Everest’s summit, you don’t want to take a 500 mile jump and end up in New Delhi and have to start all over again. Plausibly, early childhood plasticity exists for the same reason; children should have higher learning rates; each update should be larger. So maybe incidents like the tomato explosion are more likely to have long-term consequences because children’s very large updates are more likely to land them in trapped priors. Not only is an adult’s ability to update away from the tomatoes-are-bad attractor limited by the prior affecting their future judgments, they can’t make updates of that size anymore. Many critical periods are more specific and better-defined than these: animals that can’t see out of one eye for the first few months of life permanently lose the ability to process that eye. So learning rate decay is probably better seen as a general principle which is implemented differently (and at different timescales, and with different levels of severity) in different systems. This still doesn’t explain the unpredictable nature of preference-changing events. My cousin had a bad experience with a tomato in childhood, but was that really his worst childhood experience? I had a really scary time at a beach once during childhood, where I thought I would be swept away and drowned - but I got over it and now I like beaches just as much as everyone else. Was my cousin’s experience with the tomato worse (along some axis) than my experience with almost drowning? What about all of us who see cartoon animals but heroically resist becoming furries? I think it’s helpful to notice these kinds of events seem more common in childhood - but even with a theory to explain them, they’re still pretty mysterious. You're currently a free subscriber to Astral Codex Ten. For the full experience, upgrade your subscription. |
Older messages
Critical Periods For Language: Much More Than You Wanted To Know
Wednesday, August 23, 2023
...
What Can Fetish Research Tell Us About AI?
Monday, August 21, 2023
Epistemic status: Ha ha, only serious
Open Thread 290
Monday, August 21, 2023
...
Your Book Review: The Mind Of A Bee
Friday, August 18, 2023
Finalist #14 In The Book Review Contest (cw: insect pics)
Bride Of Bay Area House Party
Thursday, August 17, 2023
...
You Might Also Like
Your new crossword for Saturday Jan 11 ✏️
Saturday, January 11, 2025
View this email in your browser Take a mental break with this week's crosswords: We have six new puzzles teed up for you this week. Play the latest Vox crossword right here, and find all of our new
Firefighters Make Progress, Water Rankings, and Ohio St. Wins
Saturday, January 11, 2025
Multiple wildfires continued to burn in Southern California yesterday, with officials reporting at least 10 deaths. Over 10000 homes across 27000 acres have burned, and 20 suspected looters have been
☕ So many jobs
Saturday, January 11, 2025
So why did stocks fall? January 11, 2025 View Online | Sign Up | Shop Morning Brew Presented By Indacloud Good morning. It's National Milk Day, the one day of the year you're allowed to skim
What A Day: It ain't easy being Greenland
Friday, January 10, 2025
A Greenlandic politician reacts to Trump's threats: “The most crazy thing.” ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏
Heavily funded Pandion delivery startup closes abruptly in latest logistics industry fallout
Friday, January 10, 2025
Breaking News from GeekWire GeekWire.com | View in browser Pandion, a Bellevue-based delivery startup launched by a former Amazon Air leader during the pandemic-fueled e-commerce boom, informed
The end of the live streamer mega deals
Friday, January 10, 2025
PLUS: Podcasts are still undervalued ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏
TikTok’s Messiest Future Might Be Its Most Likely
Friday, January 10, 2025
January 10, 2025 SCREEN TIME TikTok's Messiest Future Might Be Its Most Likely It's looking like the ban is going to happen, and probably right before Donald Trump once again takes office. By
Friday Sales: Chunky Asics and Winter Skin-Care
Friday, January 10, 2025
And plenty of discounted jeans, too. The Strategist Every product is independently selected by editors. If you buy something through our links, New York may earn an affiliate commission. January 10,
LEVER TIME: The L.A. Fires And The Uninsurable Earth (Part 1)
Friday, January 10, 2025
The urban inferno is a warning about America's future — if we do not combat the climate crisis and adapt to its threats. The Los Angeles fires pose huge questions about the future of life in
Bummed Out Bobcats, 1 Million Pushups, and a Zoo’s Festive Feast
Friday, January 10, 2025
Two Kansas linemen braved subzero wind chills to rescue a mother bobcat and her kitten that were frozen to a power pole during Sunday's severe winter storm. ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏