The Sequence Chat: Thinking About Transformers as Computers
Was this email forwarded to you? Sign up here The Sequence Chat: Thinking About Transformers as ComputersA different way to reflect about the capabilities of transformers.
I mentioned last week that these opinion pieces are trying to offer a different perspective about various topics in AI. Today, I would like to share some opinions about transformer architectures. Beyond completely revolutionizing the generative AI field, transformers can be considered a true marvel given its unique scaling properties and incredible adaptability. One analogy that has worked for me recently is to think of transformers as computers. The transformer architecture has revolutionized the field of artificial intelligence, particularly in natural language processing. But beyond its impressive performance on language tasks, there's a compelling argument to be made that transformers represent something even more profound - an emergent form of computation that blurs the line between neural networks and traditional computers. Let's explore this provocative thesis and its far-reaching implications. The Programmable Nature of Transformers...Subscribe to TheSequence to unlock the rest.Become a paying subscriber of TheSequence to get access to this post and other subscriber-only content. A subscription gets you:
|
Older messages
Edge 443: EVERYTHING you Need to Know About State Space Models
Tuesday, October 29, 2024
A summary of our series about the most viable alternative to transformers. ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏
Anthropic, WOW
Sunday, October 27, 2024
New models, an agent that can interact with your computer and a new code generation tool. ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏
Edge 442: If You Thought DeepMind's AlphaFold was Impressive, Wait Until You Learn About AlphaProteo
Thursday, October 24, 2024
DeepMind's new model pushes the boundaries of protein design. ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏
Edge 441: SSMs Beyond Language
Tuesday, October 22, 2024
In this issue: ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏
The Sequence Chat: Why Transformers are the Best Thing that Ever Happened to NVIDIA
Monday, October 21, 2024
A discussion about some controvertial and original ideas in AI. ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏
You Might Also Like
Zombies Among Us: Deadcoins How to Spot Them
Friday, November 1, 2024
Top Tech Content sent at Noon! NODES 2024, a Dev Conference on AI, Knowledge Graphs & Apps Read this email in your browser How are you, @newsletterest1? 🪐 What's happening in tech today,
Feature | The Best Visualizations from October on Voronoi 🏆
Friday, November 1, 2024
See the most popular, most discussed, and most liked visualizations on our new data storytelling app Voronoi from October. View Online | Subscribe In December 2023, we publicly launched Voronoi, our
Last Call: One Month Left to Win Your Share of $17,500 in the #bitcoin Writing Contest
Friday, November 1, 2024
5 Winners Left to Announce – and You Could Be One of Them! ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏
Daily Coding Problem: Problem #1596 [Easy]
Friday, November 1, 2024
Daily Coding Problem Good morning! Here's your coding interview problem for today. This problem was asked by Amazon. A tree is symmetric if its data and shape remain unchanged when it is reflected
I've got the power
Friday, November 1, 2024
Platform Product Management The Unseen Power Behind Your Favorite Apps Platform product management might not be the flashiest role, but it's a crucial backbone of modern tech companies. While
Feature | The Best Visualizations from October on Voronoi 🏆
Friday, November 1, 2024
See the most popular, most discussed, and most liked visualizations on our new data storytelling app Voronoi from October. View Online | Subscribe In December 2023, we publicly launched Voronoi, our
Markets Shaken, Stirred
Friday, November 1, 2024
ChatGPT Search • Apple's Q4 • Alexa's Delay • Amazon's Q3 • Intel's Q3 • AI Writing Versus Learning Markets Shaken, Stirred ChatGPT Search • Apple's Q4 • Alexa's Delay •
iOS Dev Weekly - Issue 685
Friday, November 1, 2024
Something a bit different this week. What do you all hope for from WWDC2025? 🚀 View on the Web Archives ISSUE 685 November 1st 2024 Comment Thanks to everyone who responded to last week's question
Ditching Windows? Try this Linux distro
Friday, November 1, 2024
Passkeys rising; Early Black Friday deals; Call recording on iOS 18.1 -- ZDNET ZDNET Tech Today - US November 1, 2024 The default SDesk desktop. If you're ready to leave Windows 11 behind, I
ASP.NET Core News - 11/01/2024
Friday, November 1, 2024
View this email in your browser Get ready for this weeks best blog posts about ASP.NET Core! Blazor in .NET 9 — by danroth27 Named HttpClient Registrations — by rjperes75 Enabling automatic trust for