Morning Brew - ☕ Impeding progress

Have top AI models hit a wall?
December 02, 2024

Tech Brew

IBM

It’s Monday. Based on our inboxes, you can’t shake a stick without whacking an announcement touting a new advancement in AI tech. But a handful of new reports indicated that those emails could soon be fewer and farther between. Tech Brew’s Patrick Kulp explores what could happen when top AI models hit a roadblock.

In today’s edition:

Patrick Kulp, Jordyn Grzelewski, Annie Saunders

AI

Take it to the limit

Gif of a robot hand trying to push through a brick wall. Illustration: Anna Kim, Photo: Adobe Stock

In the two years since ChatGPT thrust large language models (LLMs) into the mainstream, generative AI has seen a flurry of advances—take it from a publication that’s tried to keep up with them all.

But some of that progress may be slowing in coming months, according to recent reports that have prompted much discussion in the AI world over the last couple weeks. At least three of the top AI companies—OpenAI, Google, and Anthropic—may be hitting a wall of diminishing returns as they try to scale up the next iterations of flagship models, according to reports in The Information, Bloomberg, and Reuters.

For years, LLM development has hinged on the idea that the more data and computing power is shoveled into training AI systems, the smarter these models will be. But tech companies are now reportedly hitting roadblocks—they’ve nearly run out of human-authored training data, accelerating costs are yielding disappointing results, and energy crunches have set back training, according to Reuters.

All of that could have big consequences for the future of AI development, as companies may decide to home in on more specialized tasks or pursue different kinds of gains, experts told Tech Brew. Tech stocks that have soared on AI promises may adjust accordingly.

But for businesses that are still trying to harness generative AI for everyday tasks, the news doesn’t necessarily mean much, these experts said. Many companies are already finding that the massive models on the market are often bigger than they need for their purposes, according to Arun Chandrasekaran, a distinguished VP analyst with Gartner.

“I haven’t spoken to a single CIO who’s told me, ‘I want a 10 trillion parameter model rather than an 8 trillion parameter model,’” Chandrasekaran said.

Keep reading here.—PK

   

a message from IBM

AI learner leader

IBM

FUTURE OF TRAVEL

Emissions expectations

An EV charger next to the Republican elephant Amelia Kinsinger

For a preview of how President-elect Trump will regulate the auto industry, look to his first administration, which weakened standards that require automakers to reduce vehicle tailpipe emissions.

Under President Biden, the Environmental Protection Agency unveiled what were touted as the strongest-ever standards. Now, Trump is preparing to make good on his campaign promise to “end the EV mandate,” or roll back policies aimed at decarbonizing the transportation sector, which accounts for nearly one-third of US greenhouse gas emissions.

Auto execs and their compliance teams have surely been preparing for such a scenario. But they’ll be watching closely in the coming months to see how, exactly, the Trump administration will alter key regulations like emissions standards.

“There’s a lot of war room meetings going on right now,” S&P Global Mobility analyst Michael Robinet told us. “We are still a long-range, high-capital industry; bets we make in 2022 start paying off in 2025, 2026, 2027.”

Industry leaders are used to navigating an ever-shifting regulatory landscape. But such changes would come at a time when automakers have already bet big on electrification, pouring billions of dollars into EV and battery development and production.

“The industry is not as flexible as legislators think we are,” Robinet added. “It’s a long-lead industry and you have to plan for as many outcomes as possible, within a boundary of trying to continue to make money.”

Keep reading here.—JG

   

FUTURE OF TRAVEL

Regulate me

Front seat of a self-driving car as viewed from the backseat. Metamorworks/Getty Images

It’s not often that you see industries asking to be regulated, but the prospect of a federal regulatory framework for autonomous vehicles may be welcome news to the AV sector.

The incoming Trump administration is laying the groundwork to implement federal regulations for AVs, Bloomberg recently reported. The details are still taking shape, but the Department of Transportation would reportedly lead the process. The move would likely speed the deployment of driverless vehicles on US roadways––and benefit Tesla, whose CEO, Elon Musk, has been playing an influential role in Trump’s transition back to the White House.

Win for Tesla: “This would be a huge step forward in easing US rules for self-driving cars and be a significant tailwind for Tesla’s autonomous and AI vision heading into 2025,” Wedbush Securities analysts wrote in a note. They said they expect the Trump White House to help accelerate Tesla’s AI and AV plans, thanks to Musk’s “big bet” on Trump: “Tesla and Musk are set to reap the benefits from a new friendlier regulatory era in the Beltway ahead.”

Musk has expressed opposition to the current state-by-state regulatory process for AVs in the US. “There should be a federal approval process for autonomous vehicles,” Musk said during Tesla’s Q3 earnings call.

Keep reading here.—JG

   

Together With DataRobot

DataRobot

BITS AND BYTES

Stat: 1 million. That’s how many new users Bluesky has added per day since Election Day, the Washington Post reported in a story about the upstart social media platform’s surge in users.

Quote: “We are in the business of deterrence…And if we do not once in a while use our most powerful tools, there’s no deterrence.”—Margrethe Vestager, the EU’s antitrust regulator, to the New York Times in an interview prior to her departure from the role last month

Read: I have some notes on Sam Altman’s note-taking advice (The Verge)

Tech transformers: AI can help you transform your company—if you know how to use it. IBM and The Harris Poll teamed up to learn how AI leaders harness the power of new tech. Read on.*

*A message from our sponsor.

SHARE THE BREW

Share Tech Brew with your coworkers, acquire free Brew swag, and then make new friends as a result of your fresh Brew swag.

We’re saying we’ll give you free stuff and more friends if you share a link. One link.

Your referral count: 2

Click to Share

Or copy & paste your referral link to others:
emergingtechbrew.com/r/?kid=303a04a9

         
ADVERTISE // CAREERS // SHOP // FAQ

Update your email preferences or unsubscribe here.
View our privacy policy here.

Copyright © 2024 Morning Brew. All rights reserved.
22 W 19th St, 4th Floor, New York, NY 10011

Older messages

☕ 2 years of ChatGPT

Sunday, December 1, 2024

What's new and weird in the AI world... Presented By Timeline December 01, 2024 | View Online | Sign Up | Shop Hannah Minn NOTE FROM THE WRITERS Good morning. Today is the kind of day the “Sunday

☕ Polar Brew

Saturday, November 30, 2024

Business is booming in the Arctic and Antarctica... November 30, 2024 View Online | Sign Up | Shop Morning Brew Presented By Pacaso Till Lukat Good morning. Today, we give you a special edition that is

☕ The new retail

Friday, November 29, 2024

The shopping experience has transformed... November 29, 2024 View Online | Sign Up | Shop Morning Brew Presented By Bose Anna Kim Good morning. We hope you had a better Thanksgiving than Chandler did

☕ Call me, beep me

Wednesday, November 27, 2024

How brands can make the most of their BFCM and holiday texts. November 27, 2024 Marketing Brew Presented By Frontify It's Wednesday. Walmart is rolling back investments in some DE&I programs,

☕ Best of retail media

Wednesday, November 27, 2024

Some of our favorite retail media reads this year. November 27, 2024 Retail Brew Presented By Passport It's Wednesday, and it's almost time to put the turkey in. If you have any questions, don

You Might Also Like

Vaguely Orthopedic Shoes in the News

Tuesday, January 7, 2025

Plus: What girl in red can't live without. The Strategist Every product is independently selected by editors. If you buy something through our links, New York may earn an affiliate commission.

What A Day: Fools trolled

Monday, January 6, 2025

Republicans are already fighting over Donald Trump's "big, beautiful bill." Shocker! ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏

Chapped lips? A humidifier can help.

Monday, January 6, 2025

Plus: 7 winter boots we love View in browser Ad The Recommendation January 6, 2025 Ad A low-maintenance humidifier we love Our top pick for the best humidifier, the Levoit LV600S Smart Hybrid

Why Trump’s Mass-Deportation Plans Depend on Mexico

Monday, January 6, 2025

January 6, 2025 JUST ASKING QUESTIONS Why Trump's Mass-Deportation Plans Depend on Mexico He can't turn incendiary rhetoric into action without help from other countries, policy expert Dara

LEVER TIME: MAGA’s Civil War Over Immigration

Monday, January 6, 2025

A spat between tech bros and Trump's base illuminates the growing cracks in the Right's anti-immigrant coalition. Over the holidays, when President-elect Donald Trump said he would appoint an

Tuesday Briefing: Canada’s prime minister is stepping down

Monday, January 6, 2025

Plus, a recap of the Golden Globes. View in browser|nytimes.com Ad Morning Briefing: Asia Pacific Edition January 7, 2025 Emmett Lindner headshot Justin Porter headshot By Emmett Lindner and Justin

America is Certifiable

Monday, January 6, 2025

Watch Your Six, Pselebrating Psyllium ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏

[Money Update] The Calm Before The Storm

Monday, January 6, 2025

I hope your 2025 is off to a great start. I'm grateful to count you among The Flyover's dedicated readers. ͏ ‌ ͏ ‌ ͏ ‌ ͏ ‌ ͏ ‌ ͏ ‌ ͏ ‌ ͏ ‌ ͏ ‌ ͏ ‌ ͏ ‌ ͏ ‌ ͏ ‌ ͏ ‌ ͏ ‌ ͏ ‌ ͏ ‌ ͏ ‌ ͏ ‌ ͏ ‌ ͏ ‌ ͏

Amazon parents frustrated by loss of remote work flexibility

Monday, January 6, 2025

Microsoft starts push for Windows 11 upgrades | Amazon's Ring expands into smoke detectors ADVERTISEMENT GeekWire SPONSOR MESSAGE: GeekWire's special series marks Microsoft's 50th

☕ Get a move on

Monday, January 6, 2025

Expect M&A movement in the new year, experts say. January 06, 2025 View Online | Sign Up Marketing Brew Presented By Wistia It's Monday. Plenty of marketers are touching down in Vegas today