Before Uvalde, a platform fails to answer kids' alarms
Open in browser Here’s your 22nd free edition of Platformer for the year: a look at how platforms build tools to let kids report threats online, but too often ignore them. The Uvalde shooting is only the latest example of young people attempting to report bad behavior only to see those reports go nowhere. If you value real-time reporting on how platforms are reshaping the world around us, I hope you’ll consider becoming a member today and helping to fund my work. Join now and you can come hang out with us in our chatty Discord server, where today we talked about the Supreme Court’s ruling in the Texas social media case. 👉 Before Uvalde, a platform fails to answer kids' alarmsTech companies keep building systems to detect violent threats. Why didn't Yubo's work?A week ago today, an 18-year-old man walked into an elementary school in Uvalde, Texas, and committed the latest in our nation’s never-ending series of senseless murders. And in the aftermath of that horror — 19 children dead, two teachers dead, 18 more injured — attention once again turned to what role platforms might have played in enabling the violence. This question can feel both urgently necessary and also somehow beside the point. Necessary because people (often teenagers) are constantly being arrested after making threats on social media, and the Uvalde case shows once again why those threats must be taken more seriously. And yet it’s also clear that American’s gun violence problem will not be solved at the level of platform policy or enforcement. It can be solved only by making it harder for people to acquire and use guns, particularly the assault weapons that figure in every single story like this one. But around here we focus on platforms. And with that in mind, let’s take a look at what we’ve learned about the shooter’s online behavior in the week since the shooting. It speaks to issues around child safety and platforms that I’ve reported on here before — and points to some clear steps that platforms (and, if necessary, regulators) should take next. Aside from a handful of private messages, the Uvalde shooter appears not to have much used Facebook. That and Instagram were once the default platforms for making threats like these, but new platforms are growing in popularity with young people. The Uvalde shooter liked one called Yubo, created by a French company called Twelve App. It’s a “live chilling” app similar to Houseparty, the app that Meerkat became after helping to launch the live-streaming craze in the United States in 2015. It’s also apparently quite popular, with more than 18 million downloads in the United States alone, according to the market research firm Sensor Tower. Like Houseparty, Yubo lets users broadcast themselves live to a small group of friends. The twist is that Yubo focuses on making new friends — finding people with similar interests and letting them chat. Particularly young people. “Yubo is a social live-streaming platform that celebrates the true essence of being young,” the company says. (Perhaps for that reason, its seems to have attracted more than its share of older men and their unwanted sexual advances.) In the days after the massacre, reporters discovered that Yubo appears to have been the shooter’s primary social app. He used it, among other things, to threaten rape — and school shootings. Here are Daniel A. Medina, Isabelle Chapman, Jeff Winter and Casey Tolan at CNN:
At the Washington Post, Silvia Foster-Frau, Cat Zakrzewski, Naomi Nix and Drew Harwell found a similar pattern of behavior:
Yubo told the network that it is cooperating with the investigation, but declined to offer any details on why the shooter was able to remain on the platform despite having been reported for making threats over and over again. It can seem shocking that a person who repeatedly makes violent threats, and is reported for doing so to the platform, fails to see any consequences. And yet for years now, children have been telling us that this is regular occurrence for them. In May of last year, I wrote about a report based on a survey of minors by Thorn, a nonprofit organization that builds technology to defend children from sexual abuse. Here are two findings from that survey that are relevant to the Uvalde case, from my column about it:
In short: most kids use platform reporting tools instead of telling parents or other caregivers about threats online, but in most cases those reporting tools aren’t effective. In our interview last year, Julie Cordua, Thorn’s CEO, likened platform reporting tools to fire alarms that have had their wires cut. In the Uvalde case, we see what happens when those alarms aren’t connected to effective enforcement mechanisms. If there’s any room for optimism here, it’s in the fact that criminals really do seem to be moving away from better-defended platforms to ones that are less established — and, in some cases, have fewer policy and enforcement tools. Surely part of that is simply evidence of changing tastes — Discord and Twitch are much more popular with the average teenager today than Facebook or perhaps even Instagram is. But part of it is also that Meta, YouTube, and Twitter in particular have invested heavily in content moderation, making it harder for bad actors to make threats with impunity and evade bans. That speaks to the value of content moderation, to both companies and the world at large. Peruse Yubo’s website and history and you will see a company that appears to be committed to good stewardship. The app has clearly posted community guidelines, albeit ones that have not been updated since 2020. It has a policy on ban evasion. And it uses facial-recognition technology in an effort to prevent users younger than 13 from signing up. The company also says that it uses machine-learning to scan live streams in an effort to find bad behavior, and scans text messages to look for private information that users might be about to share unwittingly, such as phone numbers. These are good, useful, and expensive tools that many other platforms do not offer. At the same time, these are voluntary measures in a world where regulators still have not established minimum standards for content policy, moderation, enforcement, or reporting what they find — aka “transparency.” We know that Yubo had a policy against basically everything the Uvalde shooter did. We know that kids saw what he was doing online, grew concerned, and used the app’s reporting tools to try to prevent it from happening in the future. And, as is usually the case in these situations, we know nothing about what happened next. Were the reports reviewed? By humans or machines? What did they find? Platforms that allow users to create accounts should be required to let people report those accounts for bad behavior. (Did you know you still can’t report an account on iMessage, one of the world’s biggest communications services?) Platforms should also be required to let us know what they do with those reports, both individually (to the person who reported it) and in the aggregate (so we can understand bad behavior on platforms overall). Doing so will sadly do nothing to stop the epidemic of gun violence in this country. But it will make good on the promise that apps like Yubo are making to their users when they let them report bad behavior — that they will take action when they receive them, and work to prevent further harm. Nobody forced Yubo build the systems that Thorn’s Cordua rightly called “fire alarms.” But it did. The least that Yubo and other platforms can do now is offer us some evidence that those alarms are actually plugged in. Elsewhere in bad vibes: How the right-wing misinformation machine is exploiting the shooting to promote false conspiracy theories. And here’s some dead silence from the firm hired by the Uvalde school district to monitor students for making threats on social media. Governing⭐ In a chillingly close 5-4 decision, the Supreme Court voted to stay the Texas social media law that would force platforms to carry hate speech and other harms. “Justice Alito said he was skeptical of the argument that the social media companies have editorial discretion protected by the First Amendment like that enjoyed by newspapers and other traditional publishers.” Fun! (Adam Liptak / New York Times)
Industry
Those good tweetsKid at the park just told me it's her birthday today. I asked her how old she is and she said five and a half. Story absolutely crumbling I asked my mom how her first date went with a guy she met on eharmony and she said “let’s just say we were physically compatible” and I said “let’s just say fine next time” Talk to meSend me tips, comments, questions, and Yubo reports: casey@platformer.news. By design, the vast majority of Platformer readers never pay anything for the journalism it provides. But you made it all the way to the end of this week’s edition — maybe not for the first time. Want to support more journalism like what you read today? If so, click here: |
Older messages
Welcome to Platformer
Saturday, May 28, 2022
Hey, thanks for subscribing to Platformer! Free subscribers receive one full edition each week. Paid subscribers receive four, arriving Monday through Thursday. All updates will arrive straight to your
How Facebook undercut the Oversight Board
Saturday, May 28, 2022
What really happened between the company and the board over Russia and Ukraine
Twitter's meltdown May
Saturday, May 28, 2022
Elon Musk's deal is looking wobbly, and the CEO just fired his top two lieutenants
Elon goes wobbly
Saturday, May 28, 2022
The Twitter deal is on hold. Is he renegotiating — or backing out?
Facebook admits its mistakes
Saturday, May 28, 2022
What the company's latest enforcement report tells us about the free-speech debate
You Might Also Like
My 2024 year in review
Saturday, January 11, 2025
Howdy! Happy New Year! Today, I'm finally sending you my annual review. (A little later than I'd hoped!) For over a decade now (eleven years!), I've been writing these annual reviews.
🗞 What's New: Here's why you should be watching startup movies
Saturday, January 11, 2025
Also: A false YouTube strike and a PR nightmare ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏
🚀 Relativity Valuation Plummets
Saturday, January 11, 2025
Plus Ligado Networks bankruptcy, United Airlines accelerated Starlink timeline, Q1 earnings, and more! The latest space investing news and updates. View this email in your browser The Space Scoop Week
⏰ 48 hours left - the #1 reason an ecommerce venture fails
Friday, January 10, 2025
Don't risk your time and money—learn how to find and test winning products. Hi Friend , Less than 48 hours left—so please pay attention. Here's a hard truth: 90% of ecommerce stores fail. Not
Meta just killed its diversity, equity and inclusion program
Friday, January 10, 2025
What employees are saying about the company's embrace of MAGA ideology —and what Meta is telling them not to say Platformer Platformer Meta just killed its diversity, equity and inclusion program
quitters day
Friday, January 10, 2025
Read time: 51 sec. You gave up already, didn't you? I'm not trying to be ad*ck 😆 It's just a fact: today is National Quitter's Day. The day 80% of people give up on their New Year's
🌟 Social Media Trends, AI Tools, and Expert Marketing Tutorials!🚀
Friday, January 10, 2025
Discover the latest on social media trends for 2025, Google's evolving ad campaigns, and YouTube's 3-minute Shorts. Plus, explore AI-driven tools like TopView 2.0 and Fenado AI, alongside must-
We found the best time to post on Instagram
Friday, January 10, 2025
Plus, Creator Camp is back! ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏
10words: Top picks from this week
Friday, January 10, 2025
Today's projects: CareerCode.it • Lesson Bud • NorthPoll • Webtwizz • FineVoice • Converti • Seller Terminal • HabitStack • Ariglad • OutSkill • edesy.in • Grow My Small Business AI 10words
Issue #134: Building $1K-$10K MRR Micro SaaS Products: RAG-as-a-Service, AI Voice Agent for Appointments, Employee…
Friday, January 10, 2025
Build Profitable SaaS products!! ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏