Edge 434: How Google DeepMind’s GameNGen can Simulate Entire 1993’s DOOM Game in Real Time
Was this email forwarded to you? Sign up here Edge 434: How Google DeepMind’s GameNGen can Simulate Entire 1993’s DOOM Game in Real TimeA major milestone in creating generative AI models that can interact with complex real world environments.
Simulating and interacting with real-world environments is one of the next frontiers for generative AI models. From robotics to self-driving vehicles, there are countless of scenarios that require generative AI agents to perform actions in real-world environments. Part of the challenges when building these models has to do with the size of the training corpus. Collecting data from real-world environments is particularly complex and expensive. But can we create generative AI agents that simulate entire environments with high fidelity? This is the goal of a new research from Google DeepMind that showcased GameNGen, pronounced as “game engine”, a model that can simulate a DOOM game using a diffusion model. GameNGen operates as a generative diffusion model designed to simulate video games. Traditional video games rely on a loop that gathers player inputs, updates the game state, and renders visuals on the screen. This loop runs at high speeds, creating the immersive experience that players enjoy. While these games usually run on standard computers, some unconventional hardware has been used to emulate games like DOOM, though the underlying software remains manually crafted. Regardless of the hardware, the core of game simulation involves predefined rules set by programmers. Before we dive into GameNGen, check out the quality of simulations we are talking about:... Subscribe to TheSequence to unlock the rest.Become a paying subscriber of TheSequence to get access to this post and other subscriber-only content. A subscription gets you:
|
Older messages
Edge 433: Samba, Unlimited Context Windows and State Space Models
Tuesday, September 24, 2024
How long of a context can SSM models process? ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏
The Big Bucks in Gen AI Investments
Sunday, September 22, 2024
Two massive strategic VC funds were announced this week. ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏
Edge 432: NVIDIA Created Minitron by Distilling Llama 3.1
Thursday, September 19, 2024
The two resulting models of 8B and parameters respectively highlight the potential of distillation. ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏
Edge 431: Meet the Multimodal State Space Models
Tuesday, September 17, 2024
Extending SSMs behind language. ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏
Some Non-Obvious Points About OpenAI 01
Sunday, September 15, 2024
Plus some major funding rounds by World Labs and Glean , Mistral's new release and more. ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏
You Might Also Like
MVP!
Friday, September 27, 2024
Make Your MVP an MVP Add Minimum Viable Product to the list of good ideas that have become buzzwords and, as a result, horribly misapplied. Once framed as a way to get validated learning about your
🔒 The Vault Newsletter: September issue 🔑
Friday, September 27, 2024
Get the latest business security news, updates, and advice from 1Password. ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏
Wolfs in the Henhouse
Friday, September 27, 2024
Tech Leaving Theaters, A's Leaving Oakland, ARM Circling Intel, Apple's 'FacePod', OpenAI Of Course, Meta's Cheap Quest Wolfs in the Henhouse Tech Leaving Theaters, A's Leaving
Charted | Government Debt Projections for G7 Countries (2024-2029F) 📈
Friday, September 27, 2024
The US is predicted to see the greatest accumulation in government debt among G7 countries in the next five years. View Online | Subscribe Presented by: BHP >> Read More Insights in the Economic
⚙️ Government goes after AI firms
Friday, September 27, 2024
Plus:
200+ hours of research on AI tools & hacks packed in 3 hours
Friday, September 27, 2024
The only AI & ChatGPT Workshop you need to master 20+ AI tools, multiple hacks & prompting techniques in just 3 hours. ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏
New Notion AI is Here + New Template!
Friday, September 27, 2024
Is Notion AI worth it now? Your most requested template is coming... 🔥 ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏
iOS Cocoa Treats
Friday, September 27, 2024
View in browser Hello, you're reading Infinum iOS Cocoa Treats, bringing you the latest iOS related news straight to your inbox every week. Getting started with Mesh Gradients on iOS 18 With iOS 18
This hidden Google AI tool is stunning
Friday, September 27, 2024
PostgreSQL 17; Mind-reading headphones; Disney+ password crackdown -- ZDNET ZDNET Tech Today - US September 27, 2024 placeholder Google's hidden AI tool turns your text into stunningly lifelike
Hackers Could Have Remotely Controlled Kia Cars Using Only License Plates
Friday, September 27, 2024
THN Daily Updates Newsletter cover Kubernetes Anti-Patterns ($39.99 Value) FREE for a Limited Time As the popularity of Kubernetes continues to grow, it's essential to understand and navigate the