Astral Codex Ten - Moderation Is Different From Censorship
This is a point I keep seeing people miss in the debate about social media. Moderation is the normal business activity of ensuring that your customers like using your product. If a customer doesn’t want to receive harassing messages, or to be exposed to disinformation, a business can provide them the service of a harassment-and-disinformation-free platform. Censorship is the abnormal activity of ensuring that people in power approve of all the information on your platform. If the sender wants to send a message, and the receiver wants to receive it, but some third party bans the exchange of information, that’s censorship. The racket works by pretending these are the same imperative. “Well, some people would be triggered if they saw offensive content, so in order to keep the platform safe for those people, we’ve got to remove it for everybody.” This is not true at all. A minimum viable product for moderation without censorship is for a platform to do exactly the same thing they’re doing now - remove all the same posts, ban all the same accounts - but have an opt-in setting, “see banned posts”. If you personally choose to see harassing and offensive content, you can toggle that setting, and everything bad will reappear. To “ban” an account would mean to prevent the half (or 75%, or 99%) of people who haven’t toggled that setting from seeing it. The people who elected to see banned posts could see them the same as always. Two “banned” accounts could still talk to each other, retweet each other, etc - as could accounts that hadn’t been banned, but had opted into the “see banned posts” setting. Does this difference seem kind of pointless and trivial? Then imagine applying it to China. If the Chinese government couldn’t censor - only moderate - the world would look completely different. Any Chinese person could get accurate information on Xinjiang, Tiananmen Square, the Shanghai lockdowns, or the top fifty criticisms of Xi Jinping - just by clicking a button on their Weibo profile. Given how much trouble ordinary Chinese people go through to get around censors, probably many of them would click the button, and then they’d have a free information environment. This switch might seem trivial in a well-functioning information ecology, but it prevents the worst abuses, and places a floor on how bad things can get. And this is just the minimum viable product, the case I’m focusing on to forestall objections of “this would be too hard to implement” or “this would be too complicated for ordinary people to understand”. If you wanted to get fancy, you could have a bunch of filters - harassing content, sexually explicit content, conspiracy theories - and let people toggle which ones they wanted to see vs. avoid. You could let people set them to different levels. Set your anti-Semitism filter to the weakest setting and it will only block literal Nazis with swastikas in their profile pic; set it to Ludicrous, and it will block anyone who isn’t an ordained Orthodox rabbi. You could let users choose which fact-checking organization they trusted to flag content as “disinformation”. The current level of moderation is a compromise. It makes no one happy. Allowing more personalized settings would make the free speech side happier (since they could speak freely to one another and anyone else interested in hearing what they had to say). And it would make the avoid-harassment side happier, since they could set their filters to stronger than the default setting, and see even less harassment than they do now. This doesn’t solve all our problems. There are some genuine arguments for true censorship: that is, for blocking speech that both sides want to hear. For example:
I’m less sympathetic to these arguments than most people are, but I can’t deny they sometimes have value. They ought to be debated. Understanding the difference between moderation and censorship won’t end that debate. But my point is: nobody is debating these arguments now, because they don’t have to. Proponents of censorship have decided it’s easier to conflate censorship and moderation, and then argue for moderation. The solution is to de-conflate these two things - preferably by offering moderation too cheap to meter. Then censorship proponents can argue for why we still need censorship even above and beyond this, and everyone can listen to the arguments and decide whether or not they’re worth it. You’re a free subscriber to Astral Codex Ten. For the full experience, become a paid subscriber. |
Older messages
Open Thread 248.5
Wednesday, November 2, 2022
...
Highlights From The Comments On Jhanas
Monday, October 31, 2022
"I think it's the first time half the commenters accused the other half of lying"
Open Thread 248
Sunday, October 30, 2022
...
Book Review: Malleus Maleficarum
Friday, October 28, 2022
Witches get stitches
Nick Cammarata On Jhana
Thursday, October 27, 2022
...
You Might Also Like
10 Things That Delighted Us Last Week: From Seafoam-Green Tights to June Squibb’s Laundry Basket
Sunday, March 9, 2025
Plus: Half off CosRx's Snail Mucin Essence (today only!) The Strategist Logo Every product is independently selected by editors. If you buy something through our links, New York may earn an
🥣 Cereal Of The Damned 😈
Sunday, March 9, 2025
Wall Street corrupts an affordable housing program, hopeful parents lose embryos, dangers lurk in your pantry, and more from The Lever this week. 🥣 Cereal Of The Damned 😈 By The Lever • 9 Mar 2025 View
The Sunday — March 9
Sunday, March 9, 2025
This is the Tangle Sunday Edition, a brief roundup of our independent politics coverage plus some extra features for your Sunday morning reading. What the right is doodling. Steve Kelley | Creators
☕ Chance of clouds
Sunday, March 9, 2025
What is the future of weather forecasting? March 09, 2025 View Online | Sign Up | Shop Morning Brew Presented By Fatty15 Takashi Aoyama/Getty Images BROWSING Classifieds banner image The wackiest
Federal Leakers, Egg Investigations, and the Toughest Tongue Twister
Sunday, March 9, 2025
Homeland Security Secretary Kristi Noem said Friday that DHS has identified two “criminal leakers” within its ranks and will refer them to the Department of Justice for felony prosecutions. ͏ ͏ ͏
Strategic Bitcoin Reserve And Digital Asset Stockpile | White House Crypto Summit
Saturday, March 8, 2025
Trump's new executive order mandates a comprehensive accounting of federal digital asset holdings. Forbes START INVESTING • Newsletters • MyForbes Presented by Nina Bambysheva Staff Writer, Forbes
Researchers rally for science in Seattle | Rad Power Bikes CEO departs
Saturday, March 8, 2025
What Alexa+ means for Amazon and its users ADVERTISEMENT GeekWire SPONSOR MESSAGE: Revisit defining moments, explore new challenges, and get a glimpse into what lies ahead for one of the world's
Survived Current
Saturday, March 8, 2025
Today, enjoy our audio and video picks Survived Current By Caroline Crampton • 8 Mar 2025 View in browser View in browser The full Browser recommends five articles, a video and a podcast. Today, enjoy
Daylight saving time can undermine your health and productivity
Saturday, March 8, 2025
+ aftermath of 19th-century pardons for insurrectionists
I Designed the Levi’s Ribcage Jeans
Saturday, March 8, 2025
Plus: What June Squibb can't live without. The Strategist Every product is independently selected by editors. If you buy something through our links, New York may earn an affiliate commission.