Morning Brew - ☕ Look at it this way

Stanford research on measuring AI bias.
Advertisement

It’s Wednesday. Nuance is sometimes a tough thing for living, breathing humans to grok, and it turns out it’s a problem for AI models, too. Tech Brew’s Patrick Kulp talked to researchers from Stanford about a new benchmark test that looks at “difference awareness.”

In today’s edition:

Patrick Kulp, Annie Saunders

AI

Lady Justice statue with binary code in background

Pitiphothivichit/Getty Images

Google’s Gemini model made headlines last year when it produced pictures of racially diverse people in Nazi uniforms, among other historically incoherent imagery.

While the episode fueled culture wars around “wokeness” online, Stanford University researcher Angelina Wang and her team saw it as an example of a bigger problem with how generative AI researchers treat algorithmic bias. Many of the metrics developers use to make models more fair strive for racial colorblindness or other identical treatment, which can sometimes ignore contexts where group differences do matter.

That’s why Wang and her co-authors at Stanford’s Institute for Human-Centered AI (HAI) have developed a new benchmark suite aimed to test difference awareness in AI models, consisting of eight scenarios and 16,000 multiple choice questions.

“One-size-fits-all definitions of fairness don’t work very well—we really have to have a more contextualized understanding,” Wang told Tech Brew. “The predominant way of going about making these AI systems more fair can sometimes be misguided and lead to wrong answers.”

Keep reading here.—PK

PRESENTED BY Vistaprint

AI

Tech Brew Q&A series featuring Mark Surman.

Mark Surman

The Mozilla Foundation might be best known as the org behind Firefox, but these days, it’s recasting the same stance it brought to the Browser Wars for a new generation-defining technology.

The nonprofit is currently shifting its strategy and rebranding to put AI front and center as it pushes for more open-source ideals in the technology—and helps define what that even means, invests in startups that align with that goal, and builds its own AI tools.

The shakeup comes as open-source AI is having a moment. Upstart Chinese lab DeepSeek shocked Silicon Valley with its purportedly ultra-efficient models released under an open-source license, prompting reconsideration of a debate that’s been brewing over the topic for years.

The Mozilla Foundation laid off around 30% of its staff last year in a restructuring of its operations, but Mozilla President Mark Surman said the org’s advocacy goals haven’t changed. “The short answer is that this restructuring hasn’t affected Mozilla’s mission at all. Our mission remains the same: pushing for a positive and transparent future that puts people first,” Surman said in an email.

We talked with Surman about how Mozilla is changing, whether advocacy efforts might look different under a new administration, and what DeepSeek means for open-source.

Keep reading here.—PK

AI

Google logo on office building

Natallia Pershaj/Getty Images

Between the rise of AI-powered competitors and a landmark antitrust ruling, Google has faced unprecedented threats to its search dominance in recent months. And yet people are still googling, for now—the tech giant remains the No. 1 player in the search space.

As the courts are set to decide on how to break Google’s search stranglehold, a new study from the National Bureau of Economic Research takes a look at some of the factors that have sustained Google’s market power for the past couple decades.

The researchers recruited more than 2,000 people and studied their search habits for a period of two weeks, offering certain segments cash rewards to switch to Microsoft Bing or asking others to make an active choice rather than sticking with a default engine.

The authors found that users who were paid to switch to Bing had a more positive opinion of its quality after the two weeks were up, and a third even chose to continue using it. Removing Google as a default option and forcing users to choose only increased Bing’s share by 1.1%, however.

When Bing was made the default search option for a certain segment of the group, many didn’t bother to switch to Google, suggesting that a certain portion of search market share is driven by consumers not paying much attention to which search engine they use, the authors wrote.

Overall, the researchers concluded that if people had a fully accurate view of each search engine’s quality and if the inconvenience of switching between them were removed, Bing would have a 15% larger market share than it does now.

Keep reading here.—PK

Together With PayPal

BITS AND BYTES

Stat: 37.9%. That’s how much Tesla sales fell in Norway in January, Wired reported. (At the same time, Tesla sales tumbled 63.4% in France and over 75% in Spain.)

Quote: “I’m very optimistic about using AI as sort of a dumb assistant, in that I don’t want it to make decisions for me…I don’t trust it to do things better than me.”—Aditi Raghunathan, a Carnegie Mellon University assistant professor of computer science, to Vox about AI agents

Read: Lawyers caught citing AI-hallucinated cases call it a ‘cautionary tale’ (404 Media)

Next gen: 5G is the backbone of retail—and your biz. From seamless connections to one-click purchases, see how 5G will continue to shape the retail landscape in our latest article.*

*A message from our sponsor.

Google Gemini logo.

Google

Google’s new AI Gems promise personalized assistants for any task, but are they actually worth it? We put them to the test.

Check it out

JOBS

Elevate your job search beyond the traditional channels. CollabWORK is where employers seek qualified candidates through trusted, community-based referrals. Let the power of community work for you, and click here to browse jobs curated especially for Tech Brew readers.

SHARE THE BREW

Share Tech Brew with your coworkers, acquire free Brew swag, and then make new friends as a result of your fresh Brew swag.

We’re saying we’ll give you free stuff and more friends if you share a link. One link.

Your referral count: 3

Click to Share

Or copy & paste your referral link to others:
emergingtechbrew.com/r/?kid=303a04a9

         
ADVERTISE // CAREERS // SHOP // FAQ

Update your email preferences or unsubscribe here.
View our privacy policy here.

Copyright © 2025 Morning Brew Inc. All rights reserved.
22 W 19th St, 4th Floor, New York, NY 10011

Older messages

✨ From Frustrating to Fun: E-Commerce Done Right

Thursday, February 27, 2025

Join us on March 5th. Making the Online Shopping Experience Fun Again Register now March 5th, 2024 12:00 - 12:40 pm ET Hi there, Optimizing the online shopping experience isn't easy. From mobile-

☕ Fight for your right to Party City

Thursday, February 27, 2025

Party City locations sell like hot cakes at auction. February 19, 2025 View Online | Sign Up Retail Brew Presented By Twilio Hello, hello. Legislators in California have introduced a bill that would

☕ Love language

Thursday, February 27, 2025

Why brands are playing matchmaker. February 19, 2025 View Online | Sign Up Marketing Brew Presented By Kinsta It's Wednesday. If you're posting on subreddits like r/numismatics, start saving

☕ Not so electric

Thursday, February 27, 2025

Once hot EV-maker Nikola is bankrupt... February 20, 2025 View Online | Sign Up | Shop Morning Brew Presented By Pacaso Good morning. The most highly anticipated hockey game in years is taking place

☕ Tariff-ic ideas

Thursday, February 27, 2025

The impact of tariffs on e-commerce. February 20, 2025 View Online | Sign Up Retail Brew presented by Walmart Marketplace Hey there, we have some news for both Birkenstock haters and fervent fans. A

You Might Also Like

In botched DEI purge, OSHA trashes workplace safety guidelines

Thursday, February 27, 2025

The Occupational Safety and Health Administration (OSHA) has ordered the digital and physical destruction of 18 publications on workplace safety practices, according to an internal February 7 email

☕ Model behavior

Thursday, February 27, 2025

Allen Institute says its model tops DeepSeek. February 17, 2025 View Online | Sign Up Tech Brew presented by StartEngine It's Monday. China's DeepSeek made a big splash, but something similar

The Best Presidents’ Day Sales, According to Our Deals Editor

Thursday, February 27, 2025

Stuff from Article, J.Crew, Madewell, and more. The Strategist Every product is independently selected by editors. If you buy something through our links, New York may earn an affiliate commission.

SPECIAL EDITION: Biden and Trump show us the promise and peril of presidential clemency.

Thursday, February 27, 2025

A guest essay from Reason's Jacob Sullum SPECIAL EDITION: Biden and Trump show us the promise and peril of presidential clemency. A guest essay from Reason's Jacob Sullum By Tangle Staff • 17

🍿 The Story Behind TV’s Best Opening Credits

Thursday, February 27, 2025

Plus: 'Severance' might have just confirmed a tantalizing fan theory. Inverse Daily The minds behind 'Yellowjackets' grungy analog opening titles explain how it's made, how it's

Scientists worry about their funding's future

Thursday, February 27, 2025

+ Kennedy Center takeover ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌

Sofa Travel

Thursday, February 27, 2025

Largest Sofa You Can Move Around A Corner // 50 Years Of Travel Tips Sofa Travel By Caroline Crampton • 17 Feb 2025 View in browser View in browser Largest Sofa You Can Move Around A Corner Richard

Worse than Watergate?

Thursday, February 27, 2025

A key Watergate whistleblower told The Lever that what we're seeing now is much worse than Watergate. ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌ ‌

☕ Moving Target

Thursday, February 27, 2025

Target and diversity terms. February 17, 2025 View Online | Sign Up Retail Brew Presented By Hightouch It's Monday, and we bring you news that Mike Tyson's brand, Tyson 2.0, which started as a

One far-right trend that skipped the US

Thursday, February 27, 2025

Plus: Mexican guns, sleep, and Christianity's comeback. View this email in your browser February 27, 2025 A woman and man in red hats reading ''Joe and the Hoe got to go'' hold a