Neuro-Symbolic Models are Making a Comeback
Was this email forwarded to you? Sign up here Neuro-Symbolic Models are Making a ComebackA new startup called Symbolica comes out of stealth with a very different value proposition.Next Week in The Sequence:
You can subscribed to The Sequence below:📝 Editorial: Neuro-Symbolic Models are Making a ComebackLarge language models (LLMs) have dominated the AI narrative in recent years to the point that we almost need to wonder about the future of other areas of machine learning. Despite the remarkable capabilities of LLMs, they remain quite impractical in many business scenarios. High computation costs, hallucinations, lack of interpretability, and the constant vulnerabilities associated with relying on stochastic machines are some of the known limitations of LLMs, with no clear solutions in the current state of technology. One of the most interesting options to address these limitations comes from a pretty old ML school: neuro-symbolic models. As the name indicates, neuro-symbolic models combine neural networks, such as LLMs, with smaller, easier-to-interpret symbolic models to adapt LLMs to specific domains. One of the recent breakthroughs in neuro-symbolic models came from Google DeepMind with their work on AlphaGeometry, a model that was able to solve geometry problems at the level of math Olympiad gold medalists. AlphaGeometry combines a geometry symbolic model with an LLM used mostly for exploring possible solutions to a given problem. Can we expand the AlphaGeometry approach to mainstream use cases? Last week, a new AI startup called Symbolica emerged from stealth mode with $33 million in new funding from iconic VCs such as Khosla Ventures. Symbolica uses mathematical techniques such as category theory to build simpler models that are easier to manage and interpret. In their press release, Symbolica cited AlphaGeometry as one of the inspirations for their work. As every company transitions to AI-first business processes, there is no doubt that we need smaller, easier-to-manage and understand models. Neuro-symbolic architectures are making a comeback as one of the possible architectures to play a role in this movement. Symbolica certainly brings a different value proposition from the common mantra of building bigger and more complex models. Neuro-symbolic models are back! 🔎 ML ResearchPersuasiveness in LLMsAnthropic Research published a paper proposing a method to measure persuasiveness in LLMs. The method uses LLMs to match claims and the corresponding explanations and evaluate its effectiveness convincing human evaluators of their validity —> Read more. SambaLingoSamba Nova published the paper behind SambaLingo, their method for teaching a pretrained LLMs new languages. The method was applied to several LLMs and covers aspects such as vocabulary extension, direct preference optimization and the data scarcity problem —> Read more. Ferret-UIApple Research published a paper introducing Ferret-UI, a multimodal LLM optimized for understanding mobile UI screens. Ferret-UI could be one of the foundations for building LLM agents in IPhones —> Read more. SOARGoogle Research published a paper proposing pilling with Orthogonality-Amplified Residuals (SOAR), a new method for vector search. The method is included in the ScaNN library which is actively used in embedding search in LLMs and RAG applications —> Read more. 🤖 Cool AI Tech ReleasesGemini in Google CloudGoogle announced integrations of its Gemini model across many products in Google Cloud —> Read more. Google Gen AI ProductsGoogle announced several generative AI products at its Cloud Next conference —> Read more. Mistral 8x22BMistral released a new MoE model via torrent link —> Read more. Stable LM 12BStability AI open sourced Stable LM 12B, a 12 billion parameter LLM trained on multiple languages such as English, Spanish, German, Italian, French, Portuguese, and Dutch —> Read more. JetStreamGoogle open sourced JetStream, an engine for high performance LLM inference and optimization. 🛠 Real World MLAirbnb ML PlatformAirbnb open sourced Chronon, its platform for ML observability and management —> Read more. AIOps at SalesforceSalesforce shared some details about its AI operations(AIOps) practices including the implementation of a similarity model —> Read more. 📡AI Radar
You’re on the free list for TheSequence Scope and TheSequence Chat. For the full experience, become a paying subscriber to TheSequence Edge. Trusted by thousands of subscribers from the leading AI labs and universities. |
Older messages
Edge 386: Inside Yi, 01's Model Leading the Chinese LLM Movement
Saturday, April 13, 2024
Yi has achieved remarkable performance across language and image tasks. ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏
Edge 385: The Two Big Schools for Building Autonomous Agents
Tuesday, April 9, 2024
Language or computer-vision based agents? ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏
Generative Audio Models Just Had a Great Week
Sunday, April 7, 2024
Three major generative audio released in the last seven days. ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏
📝 Guest Post: The EU AI Act – A Guide for Developers*
Friday, April 5, 2024
In this guest post, Raza Habib, CEO and co-founder of Humanloop, shares insights on the EU AI Act's implications for developers and startups, emphasizing that the act primarily affects high-risk
Edge 384: Inside Genie: Google DeepMind's Astonishing Model that can Build 2D Games from Text and Images
Thursday, April 4, 2024
The model represents a new category in generative AI. ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏
You Might Also Like
📧 Implementing API Gateway Authentication With YARP
Saturday, May 4, 2024
Implementing API Gateway Authentication With YARP Read on: my website / Read time: 5 minutes BROUGHT TO YOU BY Supercharging Development With AI and APIs Announcing Postman v11: Streamline API
Software Testing Weekly - Issue 218
Friday, May 3, 2024
Unit, Integration and End-to-End Tests 🔧 View on the Web Archives ISSUE 218 May 4th 2024 COMMENT Welcome to the 218th issue! I loved going through this discussion among software engineers: What is your
gpt2-chatbot and OpenAI search engine - Weekly News Roundup - Issue #465
Friday, May 3, 2024
Plus: Med-Gemini; Vidu - Chinese answer to OpenAI's Sora; the first race of Abu Dhabi Autonomous Racing League; deepfaking celebrities to teach math and physics; and more! ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏
NASA comes to the rescue of crowded rocket launch sites
Friday, May 3, 2024
Plus: Fisker's legal woes and Sprinklr lays off 100 View this email online in your browser By Christine Hall Friday, May 3, 2024 Good afternoon, and welcome to TechCrunch PM. We made it to Friday,
🎮 Forget the PS5 Pro, I Still Love My PS4 — The Best Lock Screen Widgets for iPhone
Friday, May 3, 2024
Also: Smart Home Mistakes to Avoid, and More! How-To Geek Logo May 3, 2024 Did You Know Half of the world's geysers are located in Yellowstone National Park. 🔑 More Passkeys Happy Friday! You can
JSK Daily for May 3, 2024
Friday, May 3, 2024
JSK Daily for May 3, 2024 View this email in your browser A community curated daily e-mail of JavaScript news The Power of React's Virtual DOM: A Comprehensive Explanation Modern JavaScript
Musk raises $6B for AI startup
Friday, May 3, 2024
Also, is TikTok dodging Apple's commissions? View this email online in your browser By Haje Jan Kamps Friday, May 3, 2024 Welcome to Startups Weekly — Haje's weekly recap of everything you can
SWLW #597: Seek first to understand, The "Iterative Adjacent Possible", and more.
Friday, May 3, 2024
Weekly articles & videos about people, culture and leadership: everything you need to design the org that makes the product. A weekly newsletter by Oren Ellenbogen with the best content I found
iOS Dev Weekly - Issue 659
Friday, May 3, 2024
Is Swift 6 hitting one of the REAL hard problems? Not generics, not data race safety, but naming things! 😬 View on the Web Archives ISSUE 659 May 3rd 2024 Comment Naming things is one of the two hard
Daily Coding Problem: Problem #1430 [Easy]
Friday, May 3, 2024
Daily Coding Problem Good morning! Here's your coding interview problem for today. This problem was asked by Facebook. You have a large array with most of the elements as zero. Use a more space-