TheSequence - Meta AI’s Big Announcements
Was this email forwarded to you? Sign up here Next Week in The Sequence:
You can subscribe to The Sequence below:📝 Editorial: Meta AI’s Big AnnouncementsMeta held its big conference, *Connect 2024*, last week, and AI was front and center. The two biggest headlines from the conference were the launch of the fully holographic Orion AI glasses, which represent one of the most important products in Meta’s ambitious and highly controversial AR strategy. In addition to the impressive first-generation Orion glasses, Meta announced that the company is developing a new brain-computer interface for the next version. The other major release at the conference was Llama 3.2, which includes smaller language models of sizes 1B and 3B, as well as larger 11B and 90B vision models. This is Meta’s first major attempt to open source image models, signaling its strong commitment to open-source generative AI. Additionally, Meta AI announced the Llama Stack, which provides standard APIs in areas such as inference, memory, evaluation, post-training, and several other aspects required in Llama applications. With this release, Meta is transitioning Llama from isolated models to a complete stack for building generative AI apps. There were plenty of other AI announcements at *Connect 2024*:
It was an impressive week for Meta AI, to say the least. 🔎 ML ResearchAlphaProteoGoogle DeepMind published a paper introducing AlphaProteo, a new family of model for protein design. The model is optimized for novel, high strength proteins that can improve our understanding of biological processes —> Read more. Molmo and PixMoResearchers from the Allen Institute for AI published a paper detailing Molmo and Pixmo, an open wegit and open data vision-language model(VLM). Molmo showcased how to train VLMs from scratch while Pixmo is the core set of datasets used during training —> Read more. Instruction Following Without Instruction TuningResearchers from Stanford University published a paper detailing a technique called implicit instruction tuning that surfaces instruction following behaviors without explicity fine tuning the model. The paper also suggests some simple changes to a model distribution that can yield that implicity instruction tuning behavior —> Read more. Robust Reward ModelGoogle DeepMind published a paper discussing some of the challenges of traditional reward models(RMs) to identify preferences in prompt indepdendent artifacts. The paper introduces the notion of robust reward model(RRM) that addresses this challenge and shows great improvements in models like Gemma —> Read more. Real Time NotetakingResearchers from Carnegie Mellon University published a paper outlining NoTeeline, a real time note generation method for video streams. NoTeeline generates micronotes that capture key points in a video while maintaining a consistent writing style —> Read more. AI WatermarkingResearchers from Carnegie Mellon University published a paper evaluating different design choices in LLM watermarking. The paper also studies different attacks that result in the bypassing or removal of different watermarking techniques —> Read more. 🤖 AI Tech ReleasesLlama 3.2Meta open sourced Llama 3.2 small and medium size models —> Read more. Llama StackAs part of the Llama 3.2 release, Meta open sourced the Llama Stack, a series of standarized building blocks to develop Llama-powered applications —> Read more. Gemini 1.5Google released two updated Gemini models and new pricing and performance tiers —> Read more. Cohere APIsCohere launched a new set of APIs that improve its experience for developers —> Read more. 🛠 Real World AIData Apps at AirbnbAirbnb discusses Sandcastle, an internal framework that allow data scientists rapidly protype data driven apps —> Read more. Feature Caching at PinterestThe Pinterest engineering team discusses its internal architecture for feature caching in AI recommender systems —> Read more. 📡AI Radar
You’re on the free list for TheSequence Scope and TheSequence Chat. For the full experience, become a paying subscriber to TheSequence Edge. Trusted by thousands of subscribers from the leading AI labs and universities. |
Older messages
How Does AI "See" Us?
Friday, September 27, 2024
A fascinating study that analyzed over 1200 images from four global AI models. ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏
Edge 434: How Google DeepMind’s GameNGen can Simulate Entire 1993’s DOOM Game in Real Time
Thursday, September 26, 2024
A major milestone in creating generative AI models that can interact with complex real world environments. ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏
Edge 433: Samba, Unlimited Context Windows and State Space Models
Tuesday, September 24, 2024
How long of a context can SSM models process? ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏
The Big Bucks in Gen AI Investments
Sunday, September 22, 2024
Two massive strategic VC funds were announced this week. ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏
Edge 432: NVIDIA Created Minitron by Distilling Llama 3.1
Thursday, September 19, 2024
The two resulting models of 8B and parameters respectively highlight the potential of distillation. ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏
You Might Also Like
Building Secure and Scalable APIs in .NET 8, Integration Testing in ASP.NET Core, Java Tooling in VS Code and Azure Cloud, More
Thursday, October 3, 2024
Home | News | How To | Webcasts | Whitepapers | Advertise .NET Insight October 3, 2024 THIS ISSUE SPONSORED BY: ■ Build Great UI With Easily Customizable Page Templates and Building Blocks ■ Live! 360:
💎 Issue 437 - It has to be the most beautiful open source project written in Ruby
Thursday, October 3, 2024
This week's Awesome Ruby Newsletter Read this email on the Web The Awesome Ruby Newsletter Issue » 437 Release Date Oct 03, 2024 Your weekly report of the most popular Ruby news, articles and
💻 Issue 437 - Void(0) seems fascinating
Thursday, October 3, 2024
This week's Awesome JavaScript Weekly Read this email on the Web The Awesome JavaScript Weekly Issue » 437 Release Date Oct 03, 2024 Your weekly report of the most popular JavaScript news, articles
📱 Issue 431 - Preventing app removal on iOS
Thursday, October 3, 2024
This week's Awesome iOS Weekly Read this email on the Web The Awesome iOS Weekly Issue » 431 Release Date Oct 03, 2024 Your weekly report of the most popular iOS news, articles and projects Popular
💻 Issue 430 - Taking a look at the Problem Details enhancements in ASP.NET 9
Thursday, October 3, 2024
This week's Awesome .NET Weekly Read this email on the Web The Awesome .NET Weekly Issue » 430 Release Date Oct 03, 2024 Your weekly report of the most popular .NET news, articles and projects
💻 Issue 437 - How to Create Your Own Job Board Web App Using React.js, Node.js, SerpApi, and MUI
Thursday, October 3, 2024
This week's Awesome Node.js Weekly Read this email on the Web The Awesome Node.js Weekly Issue » 437 Release Date Oct 03, 2024 Your weekly report of the most popular Node.js news, articles and
📱 Issue 434 - 2024 Server-Side Swift Conference Videos Now Available
Thursday, October 3, 2024
This week's Awesome Swift Weekly Read this email on the Web The Awesome Swift Weekly Issue » 434 Release Date Oct 03, 2024 Your weekly report of the most popular Swift news, articles and projects
💻 Issue 432 - Google's Shift to Rust Programming Cuts Android Memory Vulnerabilities by 52%
Thursday, October 3, 2024
This week's Awesome Rust Weekly Read this email on the Web The Awesome Rust Weekly Issue » 432 Release Date Oct 03, 2024 Your weekly report of the most popular Rust news, articles and projects
💻 Issue 355 - 12 Essential Web APIs Every Developer Should Know
Thursday, October 3, 2024
This week's Awesome React Weekly Read this email on the Web The Awesome React Weekly Issue » 355 Release Date Oct 03, 2024 Your weekly report of the most popular React news, articles and projects
📱 Why I Bought the iPhone 16 Pro Max — Getting Your Money's Worth Out of Plex Pass
Thursday, October 3, 2024
Also: 5 Things You Can Do on Linux but Not on Windows, and More! How-To Geek Logo October 3, 2024 Did You Know Ancient Greek statues were painted with bright colors, the light stone color we associate