Edge 437: Inside BlackMamba, One of the Most Important SSM Models Ever Created
Was this email forwarded to you? Sign up here Edge 437: Inside BlackMamba, One of the Most Important SSM Models Ever CreatedThe model combines SSMs, MoEs in a single architecture.In this issue:
💡 ML Concept of the Day: BlackMamba Combines MoEs and SSMs in a Single ArchitectureThe combination of mixture-of-experts(MoEs) and transformers in an incredible popular architecture choice in generative AI. Can we do the same with state space models(SSMs) ? BlackMamba introduces a new approach to processing long sequences and handling diverse AI tasks. It merges the strengths of SSMs MoE frameworks. Specifically, BlackMamba builds on the Mamba SSM, known for its efficiency in managing long sequences, and incorporates MoE strategies to streamline performance while addressing scalability... Subscribe to TheSequence to unlock the rest.Become a paying subscriber of TheSequence to get access to this post and other subscriber-only content. A subscription gets you:
|
Older messages
Meta Gets Into AI Video Generation
Sunday, October 6, 2024
Movie Gen promises to generate high fidelity videos with synchronized audio. ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏
📝 Guest Post: Multimodal Retrieval –Bridging the Gap Between Language and Diverse Data Types*
Friday, October 4, 2024
Generative AI has recently witnessed an exciting development: using language to understand images, video, audio, molecules, time-series, and other "modalities." Multimodal retrieval
Edge 436: Salesforce's xLAM is a New Model for Agentic Tasks
Thursday, October 3, 2024
The new model excels in tasls such as function calling, tool integration and planning. ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏
Edge 435: Learn About Hungry Hungry Hippos and SSMs
Tuesday, October 1, 2024
One of the most important layers of state space models. ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏
Meta AI’s Big Announcements
Sunday, September 29, 2024
New AR glasses, Llama 3.2 and more. ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏
You Might Also Like
Daily Coding Problem: Problem #1586 [Hard]
Tuesday, October 22, 2024
Daily Coding Problem Good morning! Here's your coding interview problem for today. This problem was asked by Airbnb. An 8-puzzle is a game played on a 3 x 3 board of tiles, with the ninth tile
Mapped | The Home Price-to-Income Ratio of Large U.S. Cities 🏘️
Tuesday, October 22, 2024
The top five large US cities have a home price-to-income ratio more than double the national average of 4.7. View Online | Subscribe | Download Our App Presented by Hinrich Foundation NEW REPORT:
Ushering In
Tuesday, October 22, 2024
Netflix's Theatrical Strategy • Blade Runner vs. Elon Musk • Disney vs. App Store • Anthropic's AI PC Control • AirPods Hearing Boost Ushering In Netflix's Theatrical Strategy • Blade
Speeding up with SIMD and Go assembly
Tuesday, October 22, 2024
Plus some Go code generation magic, test parallelism, and working with Excel spreadsheets. | #528 — October 22, 2024 Unsub | Web Version Together with Ardan Labs Go Weekly A Taste of Go Code Generator
LW 155 - Optimizing Shopify Themes for Long Product Descriptions
Tuesday, October 22, 2024
Optimizing Shopify Themes for Long Product Descriptions Shopify Development news and articles
Secure Your Election 2024 eBook at the Best Value Today ⏰
Tuesday, October 22, 2024
Stay informed with our visual guide to the US Presidential Election—exclusively for VC+ members, along with additional updates. View email in browser Now Available: The Visual Guide to the US Election
Startups of The Year: How To Vote
Tuesday, October 22, 2024
Top Tech Content sent at Noon! How the world collects web data Read this email in your browser How are you, @newsletterest1? 🪐 What's happening in tech today, October 22, 2024? The HackerNoon
JS0/JSSugar; converting CommonJS to ESM; top-level await in Node.js; Node.js v23.0.0; Bun v1.1.31;
Tuesday, October 22, 2024
We have 8 links for you - Stay up-to-date on JavaScript and tools Discussing JS0/JSSugar docs.google.com We linked to the JS0/JSSugar slides in last week's issue. We now have reactions to those
Gartner's 2025 tech trends: Adapt - and fast
Tuesday, October 22, 2024
iPhone 16 Camera Control secrets; Lyft Election Day discount; Best TVs -- ZDNET ZDNET Tech Today - US October 22, 2024 future-tunne-gettyimages-108356213 Gartner's 2025 tech trends show how your
⚙️ Microsoft, Google & AI Agents
Tuesday, October 22, 2024
Plus: Europeans would let an AI vote for them