TheSequence - The Generative Audio Momentum
Was this email forwarded to you? Sign up here The Generative Audio MomentumSundays, The Sequence Scope brings a summary of the most important research papers, technology releases and VC funding deals in the artificial intelligence space.Next Week in The Sequence:
📝 Editorial: The Generative Audio MomentumThe field of generative AI innovation has primarily been dominated by large language models (LLMs) and computer vision models for images. However, other domains like audio, video, and 3D are also progressing rapidly, albeit not at the same pace. While there is an ongoing debate about which domain will achieve mainstream adoption in generative AI, there are early indications that audio/speech might take the lead. In the audio/speech space, there are several well-established disciplines, such as speech translation, recognition, and audio synthesis, that are witnessing tremendous momentum in research and technology. These disciplines are particularly intriguing when we consider that the amount of pretraining data available for audio is relatively smaller compared to language and computer vision. Just last week, audio/speech models grabbed the headlines in generative AI. Meta AI open sourced VoiceBox, a text-to-speech generative model that has demonstrated proficiency across six languages. Google Research also introduced AudioPaLM, a multimodal speech model that combines techniques from PaLM2 and AudioLM. ElevenLabs, one of the most captivating startups in the generative AI for audio/speech field, recently announced a new funding round led by a16z, significantly elevating their profile. The momentum in the generative AI audio/speech domain is palpable. Unlike the LLM or computer vision space, there are currently no clear leaders in generative audio. The race is definitely underway! 🔎 ML ResearchVoiceBoxMeta AI Research published a paper unveiling VoiceBox, a text-to-speech generative model that achieved state-of-the-art performance in tasks that was not originally trained on. The model can synthesize speech across six languages, as well as perform noise removal, content editing, style conversion, and diverse sample generation —> Read more. RoboCatDeepMind published a paper unveiling RoboCat, a self-improving robotic agent. RoboCat is able to perform different tasks. RoboCat combines language understanding with real world actionability and is able to generate training data to improve itself —> Read more. TartResearchers from Cornell and Stanford University published a paper discussing Tart, a module that uses logistic regression to improve reasoning in LLMs. The module can be added to existing transformer architectures to improves their deductive abilities —>Read more. Responsible AI Maturity ModelMicrosoft Research published a paper outlining a framework for responsible AI. The framework includes 24 dimensions that compose a roadmap for organizations to achieve responsible AI maturity à Read More. AudionPaLMGoogle Research published a paper detailing AudioPaLM, a speech language that mastered different tasks such as text-to-speech, speech translation and recognition. AudioPaLM combines the techniques from models such as PaLM 2 and AudioLM into a single architecture —> Read more. 🤖 Cool AI Tech ReleasesInflecion-1Inflection, the well-funded generative AI startup created by LinkedLin’s founder Reid Hoffman, previewed a version of Inflection-1, the LLM powering its Pi.ai assistant —> Read more. FinGPTAI researchers from Columbia University open sourced FinGPT, a foundation model fine tuned using financial datasets —> Read more. AnythingLLMThe team from Mintplex Labs open sourced AnythingLLM, a tool that can transform any document or piece of content into an artifact that can be referenced in an conversational interaction with an LLM —> Read more. 🛠 Real World MLDetecting AI Profile Photos at LinkedInLinkedIn discussed the computer vision techniques used to detect AI generated photos for profiles —> Read more. GitHub Copilot TipsThe GitHub team discusses best practices and tips to use CoPilot —> Read more. 📡AI Radar
You’re on the free list for TheSequence Scope and TheSequence Chat. For the full experience, become a paying subscriber to TheSequence Edge. Trusted by thousands of subscribers from the leading AI labs and universities. |
Key phrases
Older messages
Edge 302: Inside MPT-7B: MosaicML's Suite of Open Source LLMs that Supports 65k Tokens
Thursday, June 22, 2023
The new suite of models was released by MosaicML and support models optimized for Instructions, Chats, Stories and More.
The Sequence Chat: Vipul Ved Prakash, CEO, Together on Decentralized, Open Source Foundation Models
Wednesday, June 21, 2023
Together has been behind some of the most interesting releases in open source foundation models.
Edge 301: Retrieval-Augmented Language Models Methods
Tuesday, June 20, 2023
The ideas for decoupling model knowledge from language generation.
The Sequence Pulse: Inside Merlin, the Platform Powering Machine Learning at Shopify
Tuesday, June 20, 2023
The eCommerce giant published some details about the platform powering its ML workflows
Edge 300: Meet Falcon LLM: The Most Powerful Open Source LLM Released to Date
Tuesday, June 20, 2023
The model quickly top the Open LLM Leaderboard that ranks the performance of open source LLMs.
You Might Also Like
BetterDev #258 - Build an 8-bit computer from scratch and Home automation with ESP8266
Wednesday, May 1, 2024
Better Dev #258 Apr 30, 2024 Hi all, We come back with a new issue this week. If you like BetterDev, please help spead word out by refer to your friends. Buy me a coffee would be great too. Build an 8-
Interface Interference 👎
Wednesday, May 1, 2024
Amid the AI device dunking, should everything “just be an app”? Here's a version for your browser. Hunting for the end of the long tail • April 30, 2024 Interface Interference The problem
Some Tesla Supercharger jobs get a jolt
Tuesday, April 30, 2024
Plus: Amazon CodeWhisperer changes its name and Arc gets a Windows version View this email online in your browser By Christine Hall Tuesday, April 30, 2024 Welcome to TechCrunch PM, bringing you the
Relief From Tinnitus: Free Discovery Call!
Tuesday, April 30, 2024
Do you suffer from tinnitus or a ringing in your ears? 1 in 3 adults over the age of 65 will suffer from this condition and often don't know there are things you can do to help. Our friends at
WebAIM April 2024 Newsletter
Tuesday, April 30, 2024
WebAIM April 2024 Newsletter Read this newsletter online at https://webaim.org/newsletter/2024/april Feature Web Accessibility in the 2024 Presidential Campaigns WebAIM's John Northup ran the US
👀 Being More Productive on a Smaller Screen — How to Hide Games on Steam Family Sharing
Tuesday, April 30, 2024
Also: What to Expect From Apple's "Let Loose" Event, and More! How-To Geek Logo April 30, 2024 Did You Know The letter J is the only letter that makes no appearance on the Periodic Table.
PEP 686, Lazy Evaluation, Serverless Python, and More
Tuesday, April 30, 2024
PEP 686: Make UTF-8 Mode Default #627 – APRIL 30, 2024 VIEW IN BROWSER The PyCoder's Weekly Logo PEP 686: Make UTF-8 Mode Default This Python Enhancement Proposal outlines making UTF-8 the default
Daily Coding Problem: Problem #1427 [Easy]
Tuesday, April 30, 2024
Daily Coding Problem Good morning! Here's your coding interview problem for today. This problem was asked by Amazon. Given an array and a number k that's smaller than the length of the array,
🎙 My advice for film + TV creatives on the AI wave
Tuesday, April 30, 2024
Learning AI fast + Karate Kid references
Ranked | The Top 20 Countries in Debt to China 💸
Tuesday, April 30, 2024
The 20 nations featured in this graphic each owe billions in debt to China, often posing concerns for their economic future. View Online | Subscribe Presented by Voronoi: The App Where Data Tells the