TheSequence - Generative AI Unicorn Capitulation
Was this email forwarded to you? Sign up here Next Week in The Sequence:
You can subscribe to The Sequence below:📝 Editorial: Gen AI Unicorn CapitulationThe week in generative AI was dominated by the news from the Microsoft Build conference, where "copilots, copilots, copilots" seems to be the new "developers, developers, developers." We also had another OpenAI drama with allegations from Scarlett Johansson about her voice being copied. And yet, today’s editorial is about none of those topics ;) Instead, I would like to focus on an emerging phenomenon we are seeing in the market related to the “capitulation” of many high-flying startups that raised billions in venture funding. Just this week, we saw news of Adept and Humane AI both looking for prospective buyers. Adept was founded by some of the authors of the transformer paper with the promise of reimagining productivity agents using foundation models. Specifically, Adept leveraged a computer-vision-based model to learn from user interactions so they can be automated. The company delivered incredible IP in this area with the Fuyu models but seems to have issues scaling the business model. Humane is another high-profile AI company that tackled the big problem of creating an AI-first consumer device. The idea that AI will power a new hardware form factor makes perfect sense, and Humane’s pin is a very clever design. However, Humane didn’t have a particularly successful launch and is facing the traditional scaling challenges of hardware companies. Adept and Humane joined recent stories such as Inflection, which proves that building businesses relying on generalist AI models is capital intensive and hard to scale. These early capitulations are the result of a heavily funded market evolving at a lightning-fast speed, making it really hard to identify successful business models this early. Regardless of this outcome, Adept and Humane have brought a tremendous level of innovation to generative AI, and likely a lot of their products will continue to evolve in their next phase. 🔎 ML ResearchInside the Mind of an LLMAnthropic published a research paper outlining major advancements in foundation model interpretability. The research highlights how to identify interpretable features in mega large models like Claude Sonnet —> Read more. Key-Value in Cross Layer AttentionResearchers from MIT published a paper outlining an optimization technique for key-value(KV) caching. The method, called l Cross-Layer Attention (CLA), extends paradigms such as Multi-Query Attention (MQA) to share values between adjacent layers —> Read more. Modular LLMMicrosoft Research published a paper detailing module LLM architecture based on a library of LoRA adapters. The paper also introduce Arrow, a zero-shot routing mechanism for selecting the right adapter for a given task —> Read more. LANISTRGoogle Research published a paper introducing LANguage, Image, and STRuctured data(LANISTR), a multimodal model that is able to learn from unstructured and structured data. LANISTR works with both text, image as well as time-series and tabular datasets —> Read more. KV-RunaheadApple Research published a paper proposing a technique for parallelizing key-value cache generation. The key principle of this technique is to minimize the time to first token which optimizes the computation efficiency of the attention layer —> Read more. 🤖 Cool AI Tech ReleasesPhi-3Microsoft’s Phi-3 family of models is now available on Microsoft Azure —> Read more. More Microsoft AnnouncementsMicrosoft has many AI announcements at its Build conference —> Read more. Aya 23Cohere released Aya 23, an 8 and 35 billion parameter LLM supporting 23 languages —> Read more. PaliGemmaGoogle’s small language-vision model PaliGemma is now open source —> Read more. Llama3-ChatQANVIDIA released a RAG optimized version of Llama3 —> Read more. SynthIDGoogle DeepMind expanded SynthID’s capabilities to insert watermark in AI generated text, images and videos —> Read more. 🛠 Real World AIData Management at MetaMeta engineering discusses the composable data infrastructure powering part of its AI infrastructure —> Read more. 📡AI Radar
You’re on the free list for TheSequence Scope and TheSequence Chat. For the full experience, become a paying subscriber to TheSequence Edge. Trusted by thousands of subscribers from the leading AI labs and universities. |
Older messages
Edge 399: Understanding External-Aid Planning and Autonomous Agents
Monday, June 3, 2024
How do we supply an agents with external help to improve its planning capabilities? ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏
Edge 400: Inside AlphaFold 3: Google DeepMind's Amazing BioScience Model
Monday, June 3, 2024
The model expands from its predecessors and is able to predict the structure of many of the life's molecules. ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏
Mistral Codestral is the Newest AI Model in the Code Generation Race
Monday, June 3, 2024
Plus updates from Elon Musk's xAI , several major funding rounds and intriguing research publications. ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏
Inside Phi-3: Microsoft's Amazing Small Language Model
Thursday, May 23, 2024
The new family of models notoriously outperform models many times their size. ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏
Edge 397: Multi-Plan Selection in Autonomous Agents
Tuesday, May 21, 2024
Agents that can generate and evaluate multiple plans simultaneously. ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏
You Might Also Like
📱 Ditch Your Webcam for an Android Phone — How I Use My KDE Plasma Linux Desktop
Sunday, June 30, 2024
Also: How I Fixed This Windows Update Error, and More! How-To Geek Logo June 30, 2024 📩 Get expert reviews, the hottest deals, how-to's, breaking news, and more delivered directly to your inbox by
PD#581 The Itanic Saga
Sunday, June 30, 2024
Itanium was intended to be a ubiquitous replacement for x86, but failed to compete against AMD64
RD#462 Web Workers, Comlink, Vite and TanStack Query
Sunday, June 30, 2024
A great way to offload work from the main thread
C#512 Programmatically monitoring and reacting to logs in .NET Aspire
Sunday, June 30, 2024
React to any changes in resources and their logs
Daily Coding Problem: Problem #1482 [Easy]
Sunday, June 30, 2024
Daily Coding Problem Good morning! Here's your coding interview problem for today. This problem was asked by Palantir. Write a program that checks whether an integer is a palindrome. For example,
Sunday Digest | Featuring 'The Countries Receiving the Most Remittances From Abroad' 📊
Sunday, June 30, 2024
Every visualization published this week, in one place. Visual Capitalist Sunday Digest logo Jun 30, 2024 | View Online | Subscribe | VC+ The Best of This Week's Visuals Presented by Voronoi: The
Limit Cloud Data Costs with MinIO on Equinix
Sunday, June 30, 2024
Top Tech Content sent at Noon! Join MongoDB's AI Dev Quest Read this email in your browser How are you, @newsletterest1? 🪐 What's happening in tech today, June 30, 2024? The HackerNoon
Android Weekly #629 🤖
Sunday, June 30, 2024
View in web browser 629 June 30th, 2024 Articles & Tutorials Sponsored Microsoft Clarity SDK: see what your app users see Gain invaluable insights into how users are using your app with detailed
AI versus publishers
Sunday, June 30, 2024
Plaid grows to 1000+ enterprise customers View this email online in your browser By Anthony Ha Sunday, June 30, 2024 Image Credits: Getty Images / anuwat meereewee AI companies and publishers still
BONUS! The problem with the No-Code AI Toolkit...
Sunday, June 30, 2024
...is that it's incomplete