Security: The Most Ignored Area of MLOps
Was this email forwarded to you? Sign up here Security: The Most Ignored Area of MLOpsSundays, The Sequence Scope brings a summary of the most important research papers, technology releases and VC funding deals in the artificial intelligence space.📝 EditorialIn the last few years, we have seen remarkable levels of innovations across most areas of the MLOps stack. Model serving, monitoring, interpretability, testing are some areas that have quickly become incredibly fragmented with numerous innovative startups and incumbents launching incredibly compelling offerings. Security seems to be the one area lacking behind in innovation in the ML space. This might seem surprising as, in the traditional DevOps space, security have become an integral part of the lifecycle of applications. In the case of ML, security is often treated as an afterthought or try to be addressed by using traditional stacks which don’t quite adapt to the dynamics of ML applications. Securing ML pipelines is not only different but quite challenging. The nature and surface of attacks in ML solutions doesn’t share the DNA of traditional applications often involving areas such as data or policy manipulation. This problem is even worse in the era of large foundation models which are currently dominating the ML landscape. If we don’t even understand how a large model makes predictions, how can we protect it? Just like MLOps was the evolution of DevOps for the ML era, ML security needs a new stack. The ML space needs a new generation of ML-first security platforms. Most of the innovation in ML security has been constrained to research and experimental efforts but that’s starting to change. Last week, ML security Protect.ai came out of stealth mode announcing a new series A and one of the most complete and pragmatic ML-first security stacks ever released. Their initial platform is segmented in two fundamental product. NB Defense is a tool that scans for security vulnerabilities directly in Jupyter networks which incetivizes data scientists to incorporate security since the experimentation phase of an ML solution. AI Radar will be the second product of Protect.ai with a focus on enabling more comprehensive suite for testing and discovering vulnerabilities in ML pipelines. From networking to cloud computing, every software trend in history have created a parallel cyber security industry. ML needs ML-first security. Protect.ai is a good starting point but we are likely to see security evolve into its own market in the ML space. 🗓 Next week in TheSequence Edge:Edge#253: Our series about ML interpretability continues by discussing the partial dependency plot methods. The research section dives into interpretable time series forecasting transfromers and the technology section is dedicated to Google’s fairness interpretability indicators. Edge#254: We review InstructGPT, one of the key models behind the ChatGPT phenomena. 🔎 ML ResearchData2vec 2.0Meta AI published a paper discussing Data2vec 2.0, a self-supervised learning model that can learning in three different modalities: speech, vision and text —> Read more. Recorder’s Speaker LabelingGoogle Brain published a paper detailing the technique used to label speaker in the Pixel Recorder app —> Read more. Robotics TransformerNo, this is not the movie but a research paper published by Google Brain detailing RT-1, a transformer model that can handle robotics inputs —> Read more. 🤖 Cool AI Tech ReleasesText-Embedding-Ada-002OpenAI released text-embedding-ada-002 , a new embedding model that is significatively smaller and more efficient than other embedding methods in the OpenAI API including marquee Davinci model —> Read more. Five Years of SageMakerAmazon SageMaker just turned five and the team has some interesting reflections about the past and future roadmap —> Read more. 🛠 Real World MLCausal Inference at LinkedInLinkedIn discussed Ocelot, their internal platform for observational causal inference —> Read more. 💸 Money in AI
You’re on the free list for TheSequence Scope and TheSequence Chat. For the full experience, become a paying subscriber to TheSequence Edge. Trusted by thousands of subscribers from the leading AI labs and universities. |
Older messages
Edge 252: Another Foundation Super Model: Google’s DreamFusion Can Convert Text to 3D
Friday, December 16, 2022
Another breakthrough in generative AI. DreamFusion uses diffusion models to generage 3D objects.
Edge 251: Global Model-Agnostic Interpretability
Tuesday, December 13, 2022
Global model-agnostic interpretability, student-teacher intrepetability methods and the Lucid library.
Diplomacy: The AI Benchmark that Gets Us Closer to the Turing Test
Sunday, December 11, 2022
📝 Editorial A few days ago, we discussed the release of CICERO, a language model created by Meta AI that was able to master the complex game of Diplomacy. Last week, DeepMind published a paper oin the
🚀🚀 Edge#250: Meta AI’s New Super Model: CICERO is Able to Negotiate and Cooperate with People
Thursday, December 8, 2022
CICERO combines language understanding and strategic reasoning to achieve top-human performance in the game of Diplomacy.
🔮 Edge#249: Model-Intrinsic vs. Post-Hoc Interpretability Methods
Monday, December 5, 2022
Model-intrinsic vs. post-hoc interpretability, activation atlases visualizations and TensorBoard.
You Might Also Like
Last chance to register: SecOps made smarter
Monday, November 25, 2024
Don't miss this opportunity to learn how gen AI can transform your security workflowsㅤㅤㅤㅤㅤㅤㅤㅤㅤㅤㅤㅤㅤㅤㅤㅤㅤㅤㅤㅤㅤㅤㅤㅤㅤㅤㅤㅤㅤㅤㅤㅤㅤㅤㅤㅤㅤㅤㅤㅤㅤㅤㅤㅤㅤㅤㅤㅤㅤㅤㅤㅤㅤㅤㅤㅤㅤㅤㅤㅤㅤㅤㅤㅤㅤㅤㅤㅤㅤㅤ elastic | Search. Observe. Protect
SRE Weekly Issue #452
Monday, November 25, 2024
View on sreweekly.com A message from our sponsor, FireHydrant: Practice Makes Prepared: Why Every Minor System Hiccup Is Your Team's Secret Training Ground. https://firehydrant.com/blog/the-hidden-
Corporate Casserole 🥘
Monday, November 25, 2024
How marketing and lobbying inspired Thanksgiving traditions. Here's a version for your browser. Hunting for the end of the long tail • November 24, 2024 Hey all, Ernie here with a classic
WP Weekly 221 - Bluesky - WP Assets on CDN, Limit Font Subsets, ACF Pro Now
Monday, November 25, 2024
Read on Website WP Weekly 221 / Bluesky Have you joined Bluesky, like many other WordPress users, a new place for an online social presence? Also in this issue: CrawlWP, Asset Management Framework,
🤳🏻 We Need More High-End Small Phones — Linux Terminal Setup Tips
Sunday, November 24, 2024
Also: Why I Switched From Google Maps to Apple Maps, and More! How-To Geek Logo November 24, 2024 Did You Know Medieval moats didn't just protect castles from invaders approaching over land, but
JSK Daily for Nov 24, 2024
Sunday, November 24, 2024
JSK Daily for Nov 24, 2024 View this email in your browser A community curated daily e-mail of JavaScript news JavaScript Certification Black Friday Offer – Up to 54% Off! Certificates.dev, the trusted
OpenAI's turbulent early years - Sync #494
Sunday, November 24, 2024
Plus: Anthropic and xAI raise billions of dollars; can a fluffy robot replace a living pet; Chinese reasoning model DeepSeek R1; robot-dog runs full marathon; a $12000 surgery to change eye colour ͏ ͏
Daily Coding Problem: Problem #1618 [Easy]
Sunday, November 24, 2024
Daily Coding Problem Good morning! Here's your coding interview problem for today. This problem was asked by Zillow. Let's define a "sevenish" number to be one which is either a power
PD#602 How Netflix Built Self-Healing System to Survive Concurrency Bug
Sunday, November 24, 2024
CPUs were dying, the bug was temporarily un-fixable, and they had no viable path forward
RD#602 What are React Portals?
Sunday, November 24, 2024
A powerful feature that allows rendering components outside their parent component's DOM hierarchy