TheSequence - Generative AI Unicorn Capitulation
Was this email forwarded to you? Sign up here Next Week in The Sequence:
You can subscribe to The Sequence below:📝 Editorial: Gen AI Unicorn CapitulationThe week in generative AI was dominated by the news from the Microsoft Build conference, where "copilots, copilots, copilots" seems to be the new "developers, developers, developers." We also had another OpenAI drama with allegations from Scarlett Johansson about her voice being copied. And yet, today’s editorial is about none of those topics ;) Instead, I would like to focus on an emerging phenomenon we are seeing in the market related to the “capitulation” of many high-flying startups that raised billions in venture funding. Just this week, we saw news of Adept and Humane AI both looking for prospective buyers. Adept was founded by some of the authors of the transformer paper with the promise of reimagining productivity agents using foundation models. Specifically, Adept leveraged a computer-vision-based model to learn from user interactions so they can be automated. The company delivered incredible IP in this area with the Fuyu models but seems to have issues scaling the business model. Humane is another high-profile AI company that tackled the big problem of creating an AI-first consumer device. The idea that AI will power a new hardware form factor makes perfect sense, and Humane’s pin is a very clever design. However, Humane didn’t have a particularly successful launch and is facing the traditional scaling challenges of hardware companies. Adept and Humane joined recent stories such as Inflection, which proves that building businesses relying on generalist AI models is capital intensive and hard to scale. These early capitulations are the result of a heavily funded market evolving at a lightning-fast speed, making it really hard to identify successful business models this early. Regardless of this outcome, Adept and Humane have brought a tremendous level of innovation to generative AI, and likely a lot of their products will continue to evolve in their next phase. 🔎 ML ResearchInside the Mind of an LLMAnthropic published a research paper outlining major advancements in foundation model interpretability. The research highlights how to identify interpretable features in mega large models like Claude Sonnet —> Read more. Key-Value in Cross Layer AttentionResearchers from MIT published a paper outlining an optimization technique for key-value(KV) caching. The method, called l Cross-Layer Attention (CLA), extends paradigms such as Multi-Query Attention (MQA) to share values between adjacent layers —> Read more. Modular LLMMicrosoft Research published a paper detailing module LLM architecture based on a library of LoRA adapters. The paper also introduce Arrow, a zero-shot routing mechanism for selecting the right adapter for a given task —> Read more. LANISTRGoogle Research published a paper introducing LANguage, Image, and STRuctured data(LANISTR), a multimodal model that is able to learn from unstructured and structured data. LANISTR works with both text, image as well as time-series and tabular datasets —> Read more. KV-RunaheadApple Research published a paper proposing a technique for parallelizing key-value cache generation. The key principle of this technique is to minimize the time to first token which optimizes the computation efficiency of the attention layer —> Read more. 🤖 Cool AI Tech ReleasesPhi-3Microsoft’s Phi-3 family of models is now available on Microsoft Azure —> Read more. More Microsoft AnnouncementsMicrosoft has many AI announcements at its Build conference —> Read more. Aya 23Cohere released Aya 23, an 8 and 35 billion parameter LLM supporting 23 languages —> Read more. PaliGemmaGoogle’s small language-vision model PaliGemma is now open source —> Read more. Llama3-ChatQANVIDIA released a RAG optimized version of Llama3 —> Read more. SynthIDGoogle DeepMind expanded SynthID’s capabilities to insert watermark in AI generated text, images and videos —> Read more. 🛠 Real World AIData Management at MetaMeta engineering discusses the composable data infrastructure powering part of its AI infrastructure —> Read more. 📡AI Radar
You’re on the free list for TheSequence Scope and TheSequence Chat. For the full experience, become a paying subscriber to TheSequence Edge. Trusted by thousands of subscribers from the leading AI labs and universities. |
Older messages
Edge 399: Understanding External-Aid Planning and Autonomous Agents
Monday, June 3, 2024
How do we supply an agents with external help to improve its planning capabilities? ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏
Edge 400: Inside AlphaFold 3: Google DeepMind's Amazing BioScience Model
Monday, June 3, 2024
The model expands from its predecessors and is able to predict the structure of many of the life's molecules. ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏
Mistral Codestral is the Newest AI Model in the Code Generation Race
Monday, June 3, 2024
Plus updates from Elon Musk's xAI , several major funding rounds and intriguing research publications. ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏
Inside Phi-3: Microsoft's Amazing Small Language Model
Thursday, May 23, 2024
The new family of models notoriously outperform models many times their size. ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏
Edge 397: Multi-Plan Selection in Autonomous Agents
Tuesday, May 21, 2024
Agents that can generate and evaluate multiple plans simultaneously. ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏
You Might Also Like
📳 Galaxy Z Flip 6 Review — How to Watch the 2024 Summer Olympics for Free
Friday, July 26, 2024
Also: Fixing Spotify's Repeating Ads, and More! How-To Geek Logo July 26, 2024 Did You Know The rectangular area of a flag found in the upper left corner (top hoist corner) of the flag, such as the
Your monthly update has arrived
Friday, July 26, 2024
What's new in Google Play and Android July 2024 The Collections surface engages users with content Introducing Collections, a new on-device surface for your content Collections present users with
iOS Dev Weekly - Issue 671
Friday, July 26, 2024
There are two types of apps on the visionOS App Store. Will you create an app that makes people reach for the headset? 🥽 View on the Web Archives ISSUE 671 July 26th 2024 Comment In the last two weeks
Ranked | The 10 Busiest Ports in the World, by Cargo Traffic 🚢
Friday, July 26, 2024
As critical nodes for trade and commercial activity, we show the top 10 busiest ports in the world by cargo volume. View Online | Subscribe Presented by: Is Your Portfolio Powering the Future? >>
Let the Games Begin
Friday, July 26, 2024
Week of July 22, 2024 Let the Games Begin Week of July 22, 2024 By MG Siegler • 26 Jul 2024 View in browser View in browser Mark Zuckerberg loves two things above all else right now: llamas and
Daily Coding Problem: Problem #1508 [Hard]
Friday, July 26, 2024
Daily Coding Problem Good morning! Here's your coding interview problem for today. This problem was asked by Uber. Given an array of integers, return a new array such that each element at index i
OpenAI announces SearchGPT - Weekly News Roundup - Issue #477
Friday, July 26, 2024
Plus: Will billionaires live forever; a police robot dog jamming wireless networks; Alphabet to invest $5B into Waymo; warnings about “model collapse”; a new partnership for AI security; and more! ͏ ͏
Using Data as a Product Manager
Friday, July 26, 2024
If you had your choice between a little data or a lot of data on which to guide decisions, which would you pick?
Last Mile of Blockchains: RPC and Node-as-a-Service
Friday, July 26, 2024
Top Tech Content sent at Noon! Find the hottest jobs from top tech companies Read this email in your browser How are you, @newsletterest1? 🪐 What's happening in tech today, July 26, 2024? The
⚙️ Generative AI is making workers less productive
Friday, July 26, 2024
Plus: Runway trained video generator on thousands of YouTube videos