TheSequence - ♟♟ Chess Learning Explainability
Was this email forwarded to you? Sign up here 📝 EditorialChess has long been considered a solved problem in machine learning (ML) as many chess programs have achieved superhuman performance. However, chess still continues contributing to the ML field in surprising ways. One of those new areas of contributions has to do with understanding how deep learning models build knowledge representations in complex scenarios such as chess. Traditional chess engines often start with extensive collections of games as well as established knowledge pools of openings and mid-game and end-game tactics. That approach was challenged with recent chess models like DeepMind’s AlphaZero that mastered chess by simply playing games. AlphaZero quickly became the strongest chess engine in the world and also discovered all set of new lines in chess openings that challenged conventional wisdom. Despite the success and popularity of AlphaZero, we still know very little about how it builds its knowledge. This is starting to change by a collaboration between DeepMind, Google Brain, and one of the brightest minds in chess history. In a paper released this week, DeepMind and Google Brain collaborated with former chess world champion Vladimir Kramnik to evaluate how AlphaZero develops knowledge representations of chess positions. This level of analysis is incredibly relevant to add a layer of interpretability to superhuman neural networks. The general assumption is that complex neural networks build opaque and nearly impossible to interpret knowledge representations. However, some recent empirical evidence seems to challenge that belief suggesting that those neural networks develop plenty of human-understandable concepts. The study of AlphaZero added more evidence to this thesis illustrating how the super neural network developed several widely understood human chess concepts during its learning process. Furthermore, the research showed exactly when AlphaZero developed these concepts during training, helping us understand how explainable knowledge representations are built in complex neural networks. Certainly one of the most fascinating papers of this year. 🍂🍁 TheSequence Scope is our Sunday free digest. To receive high-quality educational content about the most relevant concepts, research papers and developments in the ML world every Tuesday and Thursday, please subscribe to TheSequence Edge 🍂🍁 🗓 Next week in TheSequence Edge is Thanksgiving Week: we will share a few important content series, deep dives, and best interviews. Now, let’s review the most important developments in the AI industry this week 🔎 ML ResearchUnderstanding Chess Acquisition Knowledge DeepMind collaborated with former world chess champion Vladimir Kramnik in a fascinating paper about how AlphaZero acquires and develops chess knowledge →read more in this article from Chessbase Self-Supervised Speech in 128 Languages Facebook AI Research (FAIR) published a paper detailing XLS-R, a self-supervised model that can master speech tasks in 128 languages →read more on FAIR blog Evaluation and Reporting in Reinforcement Learning Google Research published a paper and open-sourced RLiable, a method for quantifying uncertainty in RL models →read more on Google Research blog Predicting Text Readability Google Research published a paper proposing a method to predict text readability based on screen interactions, such as scrolls →read more Google Research blog 🛠 Real World MLDataOps vs. MLOps Walmart Labs published a blog post explaining their ideas about DataOps and its relevance in MLOps pipelines →read more on Walmart Global Tech blog 🤖 Cool AI Tech ReleasesGNNs in TensorFlow TensorFlow open-sourced TensorFlow Graph Neural Networks (GNNs), a new framework designed to streamline GNNs implementation and graph data processing in deep learning models →read more on TensorFlow blog SynapseML Microsoft Research open-sourced SynapseML (formerly MMLSpark), a library that enables the implementation of massively parallel machine learning pipelines →read more on Microsoft Research blog OpenAI API General Availability OpenAI removed the waitlist requirement to access its popular API that includes models like GPT-3 and Codex →read more on OpenAI blog 💸 Money in AIFor ML&AI:
AI-powered
Merging:
You’re on the free list for TheSequence Scope and TheSequence Chat. For the full experience, become a paying subscriber to TheSequence Edge. Trusted by thousands of subscribers from the leading AI labs and universities. |
Older messages
🤖Edge#142: How Microsoft Built a 530 Billion Parameter Model
Thursday, November 18, 2021
The biggest innovation behind Megatron-Turing NLG
☝️ CoreWeave is allocating $50 million to scale the best compute infrastructure for ML*
Wednesday, November 17, 2021
How are they going to do it? Read along
🩺 Edge#141: MLOPs – Model Monitoring
Tuesday, November 16, 2021
plus the building blocks of interpretability and a few ML monitoring platforms to keep up with
🐉 NVIDIA's ML Software Moment
Sunday, November 14, 2021
Weekly news digest curated by the industry insiders
🌟Share your opinion on MLOps and get rewarded*
Friday, November 12, 2021
Receive the result of the survey and a $25 Amazon gift card
You Might Also Like
Scoop: Tiger Global-backed Innovaccer in talks to raise $250M
Wednesday, May 1, 2024
Plus: An update on Google's layoffs and the social platform X didn't see coming View this email online in your browser By Christine Hall Wednesday, May 1, 2024 Welcome to TechCrunch PM. Today,
🖥️ Why I'm Never Going Back to a Windows PC — Tips Before You Buy a Smart Ring
Wednesday, May 1, 2024
Also: How to Clear the Moisture Detected Warning on Samsung Phones, and More How-To Geek Logo May 1, 2024 Did You Know A single 1 oz shot of espresso only has approximately 40 mg of caffeine, whereas a
Daily Coding Problem: Problem #1428 [Hard]
Wednesday, May 1, 2024
Daily Coding Problem Good morning! Here's your coding interview problem for today. This problem was asked by Microsoft. Given an array of positive integers, divide the array into two subsets such
Top Tech Deals 👀 Samsung Gaming Monitor, Pixel Watch 2, MacBook Air, and More
Wednesday, May 1, 2024
Get a discounted M3 MacBook Air or expand your Xbox storage. How-To Geek Logo May 1, 2024 Top Tech Deals: Samsung Gaming Monitor, Pixel Watch 2, MacBook Air, and More Get a discounted M3 MacBook Air or
Infographic | Visualizing Global Gold Production in 2023 🏅
Wednesday, May 1, 2024
Gold production in 2023 was led by China, Australia, and Russia, with each outputting over 300 tonnes. View Online | Subscribe Presented by: Access European benchmarks with a trusted 25-year history
⚙️ GPT-5 may be releasing sooner than expected
Wednesday, May 1, 2024
Plus: Amazon rebrands AI branch
Noonification: How to Create a CI/CD Pipeline Using GitHub and AWS EC2
Wednesday, May 1, 2024
Top Tech Content sent at Noon! Get Algolia: AI Search that understands How are you, @newsletterest1? 🪐 What's happening in tech today, May 1, 2024? The HackerNoon Newsletter brings the HackerNoon
Arc for Windows is better than Chrome
Wednesday, May 1, 2024
Adobe bug bounty; Rabbit's first R1 software update; Dream podcaster mic -- ZDNET ZDNET Tech Today - US May 1, 2024 placeholder Arc browser is now available for Windows and it's so much better
Is TikTok trying to get banned from the App Store early?
Wednesday, May 1, 2024
TikTok is offering some users a way to buy its in-app tipping tokens outside of Apple's App Store. View this email online in your browser By Alex Wilhelm Wednesday, May 1, 2024 Good morning, and
Get Compliant in 2024 - Download Ultimate PAM Policy Template Today
Wednesday, May 1, 2024
Privileged Access Management Policy Template What are your PAM policies for 2024? Get ready for the New Year Is your approach to Privileged Access Management as current and effective as it could be? In