TheSequence - Welcome to TheSequence!

Hi there, you’re on the free list for our news digest TheSequence Scope. Every Sunday we pick the most relevant ML research papers, cool ML tech releases, and cover important investments in AI. Thank you for signing up! Follow us on Twitter.

To ensure the newsletter reaches your inbox, add thesequence@substack.com to your contacts. If you use Gmail, drag this email to your “Primary” tab. Or just reply to this email - it will help your AI understand what you want to read ;)

—

The other really cool thing that we’ve created is our Premium newsletter TheSequence Edge

Why subscribe?

To save yourself time and nerves, and to become much smarter about AL&ML.

It’s brutally hard to follow what’s happening in the AI&ML world by yourself. It’s just TOO much.

We explain the most relevant ML concept, link it to the important research paper and connect with practical implementation. We also cover What’s New in AI, providing you with deep dives into significant research papers and tech frameworks that are worth it. Our subscribers tell us that TheSequence Edge often gives them new ideas for the projects they are working on.

The content is unique, it’s trusted by the main AI labs and universities of the world. Usually, it is $5/month or $50/year.

Subscribe today with 10% OFF, this is only for newcomers.

You will be in good company:

Join the best

A few topics we’ve already covered in TheSequence Edge:

Automated Machine Learning

AutoML and ideas for automating the creation of machine learning models are becoming a super hot topic. We covered that topic in the following editions of The Sequence Edge: 

Edge#4: Neural Architecture Search (read it without subscription) 

• we look at Neural Architecture Search (NAS) that is equal to or outperform hand-designed architectures; 

• we explain the research paper “A Survey on Neural Architecture Search” and how it helps to understand NAS; 

• we speak about Uber’s Ludwig toolbox that lowers the entry point for developers by enabling the training and testing of ML models without writing any code. 

Edge#2: AutoML (read it without subscription) 

• we explain the concept of AutoML; 

• we discuss AutoML-Zero, which proposes a method to expand the frontiers of AutoML models; 

• we speak about TransmogriAI, an open-source framework that Salesforce.com used to build Einstein.   

Edge#11: Meta-Learning (read it without subscription) 

• we discuss the concept of meta-learning; 

• we explore Berkeley AI Research Lab’s famous paper about an algorithm for meta-learning that is model-agnostic;  

• we deep dive into Comet.ml, which many people call the GitHub of machine learning. 

Generative Models

How to generate synthetic data that looks just like the real thing? How about networks competing with each other to improve learning. Check out the following issues of The Sequence Edge which cover topics related to generative models. 

Edge#7: Generative Models

• we evaluate the concept of generative models that gave us GANs;  

• we discuss Microsoft’s Optimus, one of the first generative models that can be used in super large-scale language tasks; 

• we dive deep into ART, an open-source framework that uses generative models for protecting neural networks. 

Edge#8: Generative Adversarial Neural Networks

• we explain the concept of GANs;  

• we walk you through the original GANs paper by Ian Goodfellow; 

• we discuss TF-GANs, one of the most popular libraries for implementing GANs. 

Feature Engineering

Considered by many one of the most important topics in real-world machine learning solutions, feature selection and engineering is a never-ending area of research and innovation. You can learn more about it in the following issues.

Edge#10: Feature Extraction vs. Feature Selection

• we explain the difference between feature extraction and feature selection; 

• we explore a feature visualization method known as Activation Atlases;  

• we review the HopsWorks feature store platform. 

Edge#25: Representation Learning

• we present the concept of representation learning;   

• we overview the paper from Microsoft Research about representation and multi-task learning in language;   

• we explore Facebook’s fastText framework. 

Practical Machine Learning 

TheSequence Edge regularly discusses topics related to best practices and techniques to run machine learning models in production at scale. Here are some of our favorites. 

Edge#9: Parallel Training

• we discuss the concept of parallel training;  

• we review a famous OpenAI research paper that proposes GNS, a metric to measure training scalability;  

• we explore Horovod, the parallel training framework created by Uber. 

Edge#12: Model Serving

• we explain the concept of model serving; 

• we review a paper in which Google Research outlined the architecture of a serving pipeline for TensorFlow models;  

• we discuss MLflow, one of the most complete machine learning lifecycle management frameworks on the market. 

Edge#20: MLOps

• we discuss the concept of machine learning operations (MLOps);  

• we review Google’s TFX paper;  

• we provide an overview of some of the top technologies in the MLOps space. 

Emerging Learning Methods

Modern machine learning goes beyond supervised and unsupervised learning. Check out some of the new learning paradigms that are likely to become more relevant in the near future. 

Edge#14: Semi-Supervised Learning

• we discuss the concept of semi-supervised learning; 

• we deep dive into a paper that proposes a data augmentation method to advance semi-supervised learning;  

• we explore Labelbox, a fast-growing platform for data labeling.   

Edge#26: Self-Supervised Learning

• we explain the concept of self-supervised learning; 

• we overview the self-supervised method for image classification proposed by Facebook; 

• we explore Google’s SimCLR framework for advancing self-supervised learning. 

Edge#27: Contrastive Learning

• we present the concept of contrastive learning;   

• we explore Google’s research on view selection for contrastive learning;   

• we review Uber’s impressive open-sourced machine learning contributions.    

No-nonsense, no-hype repository of information, TheSequence will help you gradually and easily learn different parts and aspects of the ML Universe.