Inside Phi-3: Microsoft's Amazing Small Language Model
Was this email forwarded to you? Sign up here Inside Phi-3: Microsoft's Amazing Small Language ModelThe new family of models notoriously outperform models many times their size.Phi-3 has been one of the models at the center of Microsoft’s generative AI announcemements at its BUILD conference so we thought it might be relevant to deep dive. The Phi family of models have been associated with the term small language model(SLM) which has been gaining traction in the world of generative AI. The term was originally coined by Microsoft after publishing a paper with a catchy title: “Textbooks is all You Need” that challenged this assumption by creating a small coding language model trained solely in textbook quality datasets. The paper unveiled the Phi model that was able to outperform much larger alternatives. That was followed by the release of the Phi-2 models later last year, which showed Microsoft’s commitment to continue this line of work. A few weeks ago, Microsoft unveiled Phi-3, which, although not that small anymore, outperforms models 25 times its size. Let’s dive into some of the details behind Phi-3... Subscribe to TheSequence to read the rest.Become a paying subscriber of TheSequence to get access to this post and other subscriber-only content. A subscription gets you:
|
Older messages
Edge 397: Multi-Plan Selection in Autonomous Agents
Tuesday, May 21, 2024
Agents that can generate and evaluate multiple plans simultaneously. ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏
[Virtual talk] How to remove the biggest blocker to production AI/ML
Monday, May 20, 2024
ML teams are being asked to power every customer experience and interaction with AI/ML. The pressure to go faster is high, but the reality is that the complex data engineering to get the right data to
Reading Beyond the Hype: Some Observations About OpenAI and Google’s Announcements
Sunday, May 19, 2024
Google vs. OpenAI is shaping up as one of the biggest rivarly of the generative AI era. ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏
Edge 396: Inside Ferrett-UI: One of Apple's First Attempts to Unlock Multimodal LLMs for Mobile Devices
Friday, May 17, 2024
The new model excels at mobile screen understanding. ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏
Edge 395: Task Decomposition in Autonomous Agents
Tuesday, May 14, 2024
The cornerstone of planning in autonomous agents. ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏
You Might Also Like
📱 Ditch Your Webcam for an Android Phone — How I Use My KDE Plasma Linux Desktop
Sunday, June 30, 2024
Also: How I Fixed This Windows Update Error, and More! How-To Geek Logo June 30, 2024 📩 Get expert reviews, the hottest deals, how-to's, breaking news, and more delivered directly to your inbox by
PD#581 The Itanic Saga
Sunday, June 30, 2024
Itanium was intended to be a ubiquitous replacement for x86, but failed to compete against AMD64
RD#462 Web Workers, Comlink, Vite and TanStack Query
Sunday, June 30, 2024
A great way to offload work from the main thread
C#512 Programmatically monitoring and reacting to logs in .NET Aspire
Sunday, June 30, 2024
React to any changes in resources and their logs
Daily Coding Problem: Problem #1482 [Easy]
Sunday, June 30, 2024
Daily Coding Problem Good morning! Here's your coding interview problem for today. This problem was asked by Palantir. Write a program that checks whether an integer is a palindrome. For example,
Sunday Digest | Featuring 'The Countries Receiving the Most Remittances From Abroad' 📊
Sunday, June 30, 2024
Every visualization published this week, in one place. Visual Capitalist Sunday Digest logo Jun 30, 2024 | View Online | Subscribe | VC+ The Best of This Week's Visuals Presented by Voronoi: The
Limit Cloud Data Costs with MinIO on Equinix
Sunday, June 30, 2024
Top Tech Content sent at Noon! Join MongoDB's AI Dev Quest Read this email in your browser How are you, @newsletterest1? 🪐 What's happening in tech today, June 30, 2024? The HackerNoon
Android Weekly #629 🤖
Sunday, June 30, 2024
View in web browser 629 June 30th, 2024 Articles & Tutorials Sponsored Microsoft Clarity SDK: see what your app users see Gain invaluable insights into how users are using your app with detailed
AI versus publishers
Sunday, June 30, 2024
Plaid grows to 1000+ enterprise customers View this email online in your browser By Anthony Ha Sunday, June 30, 2024 Image Credits: Getty Images / anuwat meereewee AI companies and publishers still
BONUS! The problem with the No-Code AI Toolkit...
Sunday, June 30, 2024
...is that it's incomplete