TheSequence - 🦾 Serverless ML Execution
Was this email forwarded to you? Sign up here 📝 EditorialOne of the most challenging aspects of modern ML solutions is to match the right infrastructure for executing a given ML model. Some are executed continuously, while others intermittently. Some models experience periods of high demand and traffic followed by idle times. The point is that accommodating a single server infrastructure to a variety of ML models is nothing short of a nightmare. The serverless computing paradigm has evolved over the last few years under the premise of executing code functions without the need to pre-provisioning a server infrastructure. Recently, we have seen several attempts to adapt serverless computing to ML models. Just this week, we saw one of the biggest announcements in this new ML trend. Amazon SageMaker Serverless Inference was initially announced at the end of 2021 with the premise of deploying ML models for inference without requiring the provisioning of server infrastructure. A few days ago, Amazon announced this platform's general availability, making it one of the first large-scale attempts to integrate serverless computing in the lifecycle of ML models. It is not surprising that Amazon decided to optimize for inference models, given that they account for a large percentage of ML scenarios. Just like traditional serverless computing scenarios, SageMaker Serverless Inference dynamically launches and scales the infrastructure required to execute ML inference models based on their traffic. Serverless Inference is another addition to the robust serving and execution capabilities of the SageMarker platform. 🔺🔻TheSequence Scope – our Sunday edition with the industry’s development overview – is free. To receive high-quality content about the most relevant developments in the ML world every Tuesday and Thursday, please subscribe to TheSequence Edge 🔺🔻 🗓 Next week in TheSequence Edge: Edge#185: we overview Centralized vs. Decentralized Distributed Training Architectures; +GPipe, an Architecture for Training Large Scale Neural Networks; +TorchElastic, a Distributed Training Framework for PyTorch Edge#186: a deep dive into the Evolution of Feature Stores Now, let’s review the most important developments in the AI industry this week 🔎 ML ResearchLanguage for Object Detection Google Research published a paper detailing Pix2Seq, a model that can tackle object detection in images as a language problem →read more on Google Research blog Data Drift on Edge ML Models Microsoft Research published a paper detailing a continuous learning technique to minimize the impact of data drift in edge ML models →read more on Microsoft Research blog Learning to Prompt Google Research published a paper detailing Learning to Prompt, a continual learning technique that addresses the catastrophic forgetting in ML models →read more on Google Research blog Selecting and Optimizing Objectives OpenAI published an insightful blog post about the mathematics used to select, evaluate and optimize objectives in complex ML models →read more on OpenAI blog 🛠 Real World MLSageMaker Server Inference AWS announced the general availability of SageMaker Serverless Inference which enables the serving of ML inference models as serverless functions →read more on AWS blog 51-Language Dataset Amazon Research released a massive dataset containing labeled data in 51-languages targeted to advance research in multilanguage models →read more on Amazon Research blog ✏️ A Survey: Data Labeling for ML, part 4Please take a simple survey to help us work on our articles about data labeling. It will take about 2-3 minutes. As a thank you, we will send you a cheat sheet with 40+ free ML & data science books and courses! We appreciate your help. 🤖 Cool AI Tech ReleasesMeta’s Looper Meta (Facebook) AI Research (FAIR) unveiled some details about Looper, an API for the optimization and personalization of internal ML models →read more in this blog post from the FAIR team 💸 Money in AIAutomation&ML&AI:
AI-powered:
You’re on the free list for TheSequence Scope and TheSequence Chat. For the full experience, become a paying subscriber to TheSequence Edge. Trusted by thousands of subscribers from the leading AI labs and universities. |
Key phrases
Older messages
📌 Event: Join us at apply() – the ML Data Engineering Community Conference
Friday, April 22, 2022
It's free
🧑🎨 Edge#184: Inside DALL-E 2: OpenAI’s Upgraded Supermodel that can Generate Artistic Images from Text
Thursday, April 21, 2022
The new model outperforms its predecessor by generating higher quality images from highly complex language descriptions
📝 Guest post: How to setup MLOps at a reasonable scale: tips, tool stacks, and templates from companies that did
Wednesday, April 20, 2022
No subscription is needed
⚙️ Edge#183: Data vs Model Parallelism in Distributed Training
Tuesday, April 19, 2022
In this issue: we explore data vs model parallelism in distributed training; we discuss how AI training scales; we overview Microsoft DeepSpeed, a training framework powering some of the largest neural
🛍 Machine Learning at Shopify
Sunday, April 17, 2022
Weekly news digest curated by the industry insiders
You Might Also Like
Data Science Weekly - Issue 543
Friday, April 19, 2024
Curated news, articles and jobs related to Data Science, AI, & Machine Learning ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏
A deal made in cloud security heaven
Thursday, April 18, 2024
Meta's Llama 3 goes public and hackers hold World-Check data for ransom View this email online in your browser By Christine Hall Thursday, April 18, 2024 Welcome to TechCrunch PM! I'm glad you
💎 Issue 413 - RubyJS-Vite
Thursday, April 18, 2024
This week's Awesome Ruby Newsletter Read this email on the Web The Awesome Ruby Newsletter Issue » 413 Release Date Apr 18, 2024 Your weekly report of the most popular Ruby news, articles and
💻 Issue 406 - Swift for C++ Practitioners, Part 1
Thursday, April 18, 2024
This week's Awesome .NET Weekly Read this email on the Web The Awesome .NET Weekly Issue » 406 Release Date Apr 18, 2024 Your weekly report of the most popular .NET news, articles and projects
💻 Issue 413 - How to implement HLS Video Streaming in a React App
Thursday, April 18, 2024
This week's Awesome Node.js Weekly Read this email on the Web The Awesome Node.js Weekly Issue » 413 Release Date Apr 18, 2024 Your weekly report of the most popular Node.js news, articles and
📱 Issue 407 - Textual Healing: iOS Text Editing Minutiae
Thursday, April 18, 2024
This week's Awesome iOS Weekly Read this email on the Web The Awesome iOS Weekly Issue » 407 Release Date Apr 18, 2024 Your weekly report of the most popular iOS news, articles and projects Popular
💻 Issue 413 - Interview with Senior JavaScript Developer 2024 [video]
Thursday, April 18, 2024
This week's Awesome JavaScript Weekly Read this email on the Web The Awesome JavaScript Weekly Issue » 413 Release Date Apr 18, 2024 Your weekly report of the most popular JavaScript news, articles
💻 Issue 331 - 30+ app ideas with complete source code
Thursday, April 18, 2024
This week's Awesome React Weekly Read this email on the Web The Awesome React Weekly Issue » 331 Release Date Apr 18, 2024 Your weekly report of the most popular React news, articles and projects
💻 Issue 408 - Curl: Hyper, is it worth it?
Thursday, April 18, 2024
This week's Awesome Rust Weekly Read this email on the Web The Awesome Rust Weekly Issue » 408 Release Date Apr 18, 2024 Your weekly report of the most popular Rust news, articles and projects
📱 Issue 410 - Swift for C++ Practitioners, Part 1
Thursday, April 18, 2024
This week's Awesome Swift Weekly Read this email on the Web The Awesome Swift Weekly Issue » 410 Release Date Apr 18, 2024 Your weekly report of the most popular Swift news, articles and projects