TheSequence - The Single-Algorithm AI Chip
Was this email forwarded to you? Sign up here The Single-Algorithm AI ChipPlus a tremendous activity in funding activity in generative AI startups.Next Week in The Sequence:
You can subscribe to The Sequence below:📝 Editorial: The Single-Algorithm AI ChipThe dominance of the transformer architecture in generative AI represents a pivotal moment for the AI chip industry. This revolution has sparked a renaissance in chip design, propelling NVIDIA to become one of the world's most valuable companies and fueling substantial funding for new AI chip startups. The demand for AI-based hardware seems limitless, driven not only by the rapid pace of AI advancements but also by the slow evolution of AI model architectures beyond transformers. Simply put, transformer dominance as the preferred architecture in generative AI is the best thing to have happened to the AI chip industry. The rationale is clear: when most AI software innovation centers around a single architecture, it becomes logical for AI chip manufacturers to optimize for that paradigm. Given that AI chip production cycles are significantly longer than software development cycles, such optimization is only feasible if model architectures remain stable for years. Conversely, constant changes in architecture paradigms would render AI chip optimization impractical and economically unviable. Last week provided a notable example of this market dynamic between AI chips and software: Etched, a new AI chip startup, secured $120 million in funding to develop chips specialized in transformer architectures. Etched's chip, Sohu, is capable of processing 500,000 tokens per second with the throughput of a Llama 70B model, surpassing NVIDIA's Blackwell (B200) GPUs in speed and cost efficiency. Sohu's specialization in a single algorithm allows for a streamlined logic flow, accommodating more mathematical blocks and achieving an impressive 90% FLOPS utilization. The dominance of transformer architecture empowers startups like Etched to optimize chip designs to compete effectively with established industry giants. The greatest paradox of the AI chip renaissance lies in the fact that innovation is spurred not by rapid AI evolution, but by its deliberate pace. 🌝 Recommended – Finally: Instant, accurate, low-cost GenAI evaluationsWhy are Fortune 500 companies everywhere switching to Galileo Luna for enterprise GenAI evaluations?
🔎 ML ResearchFineWebHuggingFace published a paper detailing how they built FineWeb, one of the largest open source datasets for LLM pretraining ever built. FineWeb boosts and impressive 15 trillion tokens from 96 Common Crawl snapshots —> Read more. Agent Symbolic LearningResearchers from AIWaves published a paper introducing a technique known as agent symbolic learning aimed to self-improve agents. The core idea is to draw a parallel between an agent pipeline and a neural net and use symbolic optimizers to improve the agent network —> Read more. APIGenSalesforce Research published a paper introducing APIGen, a pipeline designed to synthesize function-calling datasets. APIGen was used to train models over 7B parameters based on state-of-the-art benchmarks —> Read more. MISeDGoogle Research published a paper introducing Meeting Information Seeking Dialogs(MISeD), a dataset focused on meeting transcripts. MISeD tries to optimize for finding factual information in meeting transcripts which could be a notoriously difficult task —> Read more. Olympic ArenaResearchers from Shanghai Jiao Tong University, Generative AI Research Lab published a paper detailing the results of the Olympic Arena superintelligence benchmark. Olympic Arena was designed to evaluate models across many disciplines and modalities —> Read more. Exams for RAG PipelinesAmazon Science published a paper discussing a technique to evaluate the accuracy of RAG applications. The methods mimics an exam generation process based on item response theory —> Read more. 🤖 Cool AI Tech ReleasesMLflow at SageMakerAmazon is launching support for Mlflow in its SageMaker platform —> Read more. Multimodal ArenaChatbot Arena just added support for multimodal models —> Read more. Meta LLM CompilerMeta AI open sourced its LLM Compiler, a family of Code LLama based models with compiter and optimization capabilities —> Read more. Character CallsCharacter AI introduced Character Calls, a voice interaction experience with Characters —> Read more. 🛠 Real World AIIncident Response at MetaMeta shares some details about their usage of generative AI for incident response —> Read more. ETA at LyftLyft discusses the ML techniques used to ensure estimated time of arrival(ETA) reliability for riders —> Read more. 📡AI Radar
You’re on the free list for TheSequence Scope and TheSequence Chat. For the full experience, become a paying subscriber to TheSequence Edge. Trusted by thousands of subscribers from the leading AI labs and universities. |
Older messages
📝 Guest Post: Designing Prompts for LLM-as-a-Judge Model Evals*
Friday, June 28, 2024
In this guest post, Nikolai Liubimov, CTO of HumanSignal provides helpful resources to get started building LLM-as-a-judge evaluators for AI models. HumanSignal recently launched a suite of tools
Edge 406: Inside OpenAI's Recent Breakthroughs in GPT-4 Interpretability
Thursday, June 27, 2024
A new method helps to extract interpretable concepts from large models like GPT-4. ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏
Edge 407: LLMs with Infininite Context Windows? Short-Term Memory and Autonomous Agents
Tuesday, June 25, 2024
The role of context windows in LLMs ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏
📽 [Virtual Talk] Powering millions of real-time rankings at GetYourGuide
Monday, June 24, 2024
Hi there, Curious about how GetYourGuide, a leading online marketplace for travel excursions, delivers millions of personalized rankings daily, adapting to users' preferences in real time? Join us
Beyond OpenAI: Apple’s On-Device AI Strategy
Sunday, June 23, 2024
Plus a new super coder model, Meta's new AI releases, DeepMind's video-to-audio models and much more. ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏
You Might Also Like
JSter #222 - Libraries and more
Tuesday, July 2, 2024
It's a JavaScript. I set up a playlist based on Future Frontend 2024 content. There's also a photo album. Libraries Announcing TanStack Query v5 stan-js - Fast and elegant state management
You’re invited: Elevate your RAG systems
Tuesday, July 2, 2024
Learn advanced techniques and best practices for implementing RAG.ㅤㅤㅤㅤㅤㅤㅤㅤㅤㅤㅤㅤㅤㅤㅤㅤㅤㅤㅤㅤㅤㅤㅤㅤㅤㅤㅤㅤㅤㅤㅤㅤㅤㅤㅤㅤㅤㅤㅤㅤㅤㅤㅤㅤㅤㅤㅤㅤㅤㅤㅤㅤㅤㅤㅤㅤㅤㅤㅤㅤㅤㅤㅤㅤㅤㅤㅤㅤㅤㅤ elastic | Search. Observe. Protect ㅤㅤㅤㅤㅤㅤㅤㅤㅤㅤㅤㅤㅤㅤㅤㅤㅤㅤㅤㅤㅤㅤㅤㅤㅤㅤㅤㅤㅤ
New Blogs on ThomasMaurer.ch for 07/02/2024
Tuesday, July 2, 2024
View this email in your browser Thomas Maurer Cloud & Datacenter Update This is the update for blog posts on ThomasMaurer.ch. Azure Stack HCI in the HPE Customer Innovation Center in Geneva By
Talking His Own Facebook
Monday, July 1, 2024
Mark Zuckerberg takes on the sinners in the hands of an AI God Talking His Own Facebook Mark Zuckerberg takes on the sinners in the hands of an AI God By MG Siegler • 1 Jul 2024 View in browser View in
Evolve Bank data breach affects Wise customers
Monday, July 1, 2024
Plus, Robinhood acquires Pluto and YouTube changes its privacy policy View this email online in your browser By Christine Hall Monday, July 1, 2024 Welcome to TechCrunch PM! Today, we found out that
😺 AI for personal growth
Monday, July 1, 2024
AI is rapidly transforming our lives with automated tools and innovations, such as AI girlfriends, assistants, travel guides, and even... Product Hunt Read in browser This newsletter is brought to you
📲 4 Alternatives to the Google Play Store – Speeding Up Your Workflow in Microsoft Word
Monday, July 1, 2024
Also: Switchbot S10 Robot Vacuum Mop Review, and More! How-To Geek Logo July 1, 2024 Did You Know Buttermilk has no butter in it; the milk is called such because it's what is left over after the
JSK Daily for Jul 1, 2024
Monday, July 1, 2024
JSK Daily for Jul 1, 2024 View this email in your browser A community curated daily e-mail of JavaScript news Easily Build an Interactive BPMN Viewer and Editor in Angular A business process model and
TechCrunch Space: Star spangled
Monday, July 1, 2024
NASA awards $843M contract to SpaceX to develop the vehicle that will deorbit the International Space Station. View this email online in your browser By Aria Alamalhodaei Monday, July 1, 2024 Hello and
Daily Coding Problem: Problem #1483 [Medium]
Monday, July 1, 2024
Daily Coding Problem Good morning! Here's your coding interview problem for today. This problem was asked by Square. A competitive runner would like to create a route that starts and ends at his