Morning Brew - ☕ Impeding progress

Have top AI models hit a wall?
December 02, 2024

Tech Brew

IBM

It’s Monday. Based on our inboxes, you can’t shake a stick without whacking an announcement touting a new advancement in AI tech. But a handful of new reports indicated that those emails could soon be fewer and farther between. Tech Brew’s Patrick Kulp explores what could happen when top AI models hit a roadblock.

In today’s edition:

Patrick Kulp, Jordyn Grzelewski, Annie Saunders

AI

Take it to the limit

Gif of a robot hand trying to push through a brick wall. Illustration: Anna Kim, Photo: Adobe Stock

In the two years since ChatGPT thrust large language models (LLMs) into the mainstream, generative AI has seen a flurry of advances—take it from a publication that’s tried to keep up with them all.

But some of that progress may be slowing in coming months, according to recent reports that have prompted much discussion in the AI world over the last couple weeks. At least three of the top AI companies—OpenAI, Google, and Anthropic—may be hitting a wall of diminishing returns as they try to scale up the next iterations of flagship models, according to reports in The Information, Bloomberg, and Reuters.

For years, LLM development has hinged on the idea that the more data and computing power is shoveled into training AI systems, the smarter these models will be. But tech companies are now reportedly hitting roadblocks—they’ve nearly run out of human-authored training data, accelerating costs are yielding disappointing results, and energy crunches have set back training, according to Reuters.

All of that could have big consequences for the future of AI development, as companies may decide to home in on more specialized tasks or pursue different kinds of gains, experts told Tech Brew. Tech stocks that have soared on AI promises may adjust accordingly.

But for businesses that are still trying to harness generative AI for everyday tasks, the news doesn’t necessarily mean much, these experts said. Many companies are already finding that the massive models on the market are often bigger than they need for their purposes, according to Arun Chandrasekaran, a distinguished VP analyst with Gartner.

“I haven’t spoken to a single CIO who’s told me, ‘I want a 10 trillion parameter model rather than an 8 trillion parameter model,’” Chandrasekaran said.

Keep reading here.—PK

   

a message from IBM

AI learner leader

IBM

FUTURE OF TRAVEL

Emissions expectations

An EV charger next to the Republican elephant Amelia Kinsinger

For a preview of how President-elect Trump will regulate the auto industry, look to his first administration, which weakened standards that require automakers to reduce vehicle tailpipe emissions.

Under President Biden, the Environmental Protection Agency unveiled what were touted as the strongest-ever standards. Now, Trump is preparing to make good on his campaign promise to “end the EV mandate,” or roll back policies aimed at decarbonizing the transportation sector, which accounts for nearly one-third of US greenhouse gas emissions.

Auto execs and their compliance teams have surely been preparing for such a scenario. But they’ll be watching closely in the coming months to see how, exactly, the Trump administration will alter key regulations like emissions standards.

“There’s a lot of war room meetings going on right now,” S&P Global Mobility analyst Michael Robinet told us. “We are still a long-range, high-capital industry; bets we make in 2022 start paying off in 2025, 2026, 2027.”

Industry leaders are used to navigating an ever-shifting regulatory landscape. But such changes would come at a time when automakers have already bet big on electrification, pouring billions of dollars into EV and battery development and production.

“The industry is not as flexible as legislators think we are,” Robinet added. “It’s a long-lead industry and you have to plan for as many outcomes as possible, within a boundary of trying to continue to make money.”

Keep reading here.—JG

   

FUTURE OF TRAVEL

Regulate me

Front seat of a self-driving car as viewed from the backseat. Metamorworks/Getty Images

It’s not often that you see industries asking to be regulated, but the prospect of a federal regulatory framework for autonomous vehicles may be welcome news to the AV sector.

The incoming Trump administration is laying the groundwork to implement federal regulations for AVs, Bloomberg recently reported. The details are still taking shape, but the Department of Transportation would reportedly lead the process. The move would likely speed the deployment of driverless vehicles on US roadways––and benefit Tesla, whose CEO, Elon Musk, has been playing an influential role in Trump’s transition back to the White House.

Win for Tesla: “This would be a huge step forward in easing US rules for self-driving cars and be a significant tailwind for Tesla’s autonomous and AI vision heading into 2025,” Wedbush Securities analysts wrote in a note. They said they expect the Trump White House to help accelerate Tesla’s AI and AV plans, thanks to Musk’s “big bet” on Trump: “Tesla and Musk are set to reap the benefits from a new friendlier regulatory era in the Beltway ahead.”

Musk has expressed opposition to the current state-by-state regulatory process for AVs in the US. “There should be a federal approval process for autonomous vehicles,” Musk said during Tesla’s Q3 earnings call.

Keep reading here.—JG

   

Together With DataRobot

DataRobot

BITS AND BYTES

Stat: 1 million. That’s how many new users Bluesky has added per day since Election Day, the Washington Post reported in a story about the upstart social media platform’s surge in users.

Quote: “We are in the business of deterrence…And if we do not once in a while use our most powerful tools, there’s no deterrence.”—Margrethe Vestager, the EU’s antitrust regulator, to the New York Times in an interview prior to her departure from the role last month

Read: I have some notes on Sam Altman’s note-taking advice (The Verge)

Tech transformers: AI can help you transform your company—if you know how to use it. IBM and The Harris Poll teamed up to learn how AI leaders harness the power of new tech. Read on.*

*A message from our sponsor.

SHARE THE BREW

Share Tech Brew with your coworkers, acquire free Brew swag, and then make new friends as a result of your fresh Brew swag.

We’re saying we’ll give you free stuff and more friends if you share a link. One link.

Your referral count: 2

Click to Share

Or copy & paste your referral link to others:
emergingtechbrew.com/r/?kid=303a04a9

         
ADVERTISE // CAREERS // SHOP // FAQ

Update your email preferences or unsubscribe here.
View our privacy policy here.

Copyright © 2024 Morning Brew. All rights reserved.
22 W 19th St, 4th Floor, New York, NY 10011

Older messages

☕ 2 years of ChatGPT

Sunday, December 1, 2024

What's new and weird in the AI world... Presented By Timeline December 01, 2024 | View Online | Sign Up | Shop Hannah Minn NOTE FROM THE WRITERS Good morning. Today is the kind of day the “Sunday

☕ Polar Brew

Saturday, November 30, 2024

Business is booming in the Arctic and Antarctica... November 30, 2024 View Online | Sign Up | Shop Morning Brew Presented By Pacaso Till Lukat Good morning. Today, we give you a special edition that is

☕ The new retail

Friday, November 29, 2024

The shopping experience has transformed... November 29, 2024 View Online | Sign Up | Shop Morning Brew Presented By Bose Anna Kim Good morning. We hope you had a better Thanksgiving than Chandler did

☕ Call me, beep me

Wednesday, November 27, 2024

How brands can make the most of their BFCM and holiday texts. November 27, 2024 Marketing Brew Presented By Frontify It's Wednesday. Walmart is rolling back investments in some DE&I programs,

☕ Best of retail media

Wednesday, November 27, 2024

Some of our favorite retail media reads this year. November 27, 2024 Retail Brew Presented By Passport It's Wednesday, and it's almost time to put the turkey in. If you have any questions, don

You Might Also Like

Wednesday Briefing: A brief martial law in South Korea

Tuesday, December 3, 2024

Plus, become a gladiator for a day. View in browser|nytimes.com Ad Morning Briefing: Asia Pacific Edition December 4, 2024 Author Headshot By Gaya Gupta Good morning. We're covering a short-lived

Steal Away

Tuesday, December 3, 2024

How to Shoplift in 90 Seconds ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏

Andy Jassy delivers big AI announcement at AWS re:Invent 

Tuesday, December 3, 2024

Seattle sushi restaurant reopens following TikTok critique controversy ADVERTISEMENT GeekWire SPONSOR MESSAGE: Improve focus and memory with Thinkie: For a limited time, save $50 on Thinkie plus get

I’m nervous. We’re falling short.

Tuesday, December 3, 2024

We're approaching our make-or-break Giving Tuesday fundraising deadline. You don't usually hear from me, but my name is Michael Sherrard, and I'm the person at The Intercept in charge of

Today is Giving Tuesday, check out a great opportunity to give back...

Tuesday, December 3, 2024

On this Giving Tuesday, we're sharing an urgent message from our partner, World Concern. ͏ ‌ ͏ ‌ ͏ ‌ ͏ ‌ ͏ ‌ ͏ ‌ ͏ ‌ ͏ ‌ ͏ ‌ ͏ ‌ ͏ ‌ ͏ ‌ ͏ ‌ ͏ ‌ ͏ ‌ ͏ ‌ ͏ ‌ ͏ ‌ ͏ ‌ ͏ ‌ ͏ ‌ ͏ ‌ ͏ ‌ ͏ ‌ ͏ ‌ ͏ ‌ ͏ ‌

☕ Nothing but blue skies

Tuesday, December 3, 2024

Inside Bluesky's rapid growth—and what new features are on the horizon. December 03, 2024 Marketing Brew Presented By Delta It's Tuesday, and the official Oxford word of the year is “brain rot.

☕ On the plus side

Tuesday, December 3, 2024

The benefits of photo-reviews from plus-sized shoppers. December 03, 2024 Retail Brew Presented By National Retail Federation It's Tuesday, and Black Friday weekend is officially over. Shipping

The Hunter Biden pardon.

Tuesday, December 3, 2024

Plus, we catch you up on everything we missed. The Hunter Biden pardon. Plus, we catch you up on everything we missed. By Isaac Saul • 3 Dec 2024 View in browser View in browser President Biden and son

Gift of the Day: Our Favorite Sateen Sheets That Won't Make Them ‘Sweat to Death’

Tuesday, December 3, 2024

Brooklinen's giving 27 percent off just for Strategist readers. The Strategist Gifts Every product is independently selected by editors. If you buy something through our links, New York may earn an

Dark Puzzle

Tuesday, December 3, 2024

Against The Dark Forest // Black Hole Puzzle Dark Puzzle By Kaamya Sharma • 3 Dec 2024 View in browser View in browser Against The Dark Forest Erin Kissane | Wreckage/Salvage | 29th November 2024 | U