Amazon’s Q has ‘severe hallucinations’ and leaks confidential data in public preview, employees warn
Here’s a preview of our latest scoop: severe hallucinations at Q, the crown jewel of Amazon’s generative AI strategy for the enterprise. Unveiled just three days ago, internal documents show the AI is already leaking confidential information. Amazon’s Q has ‘severe hallucinations’ and leaks confidential data in public preview, employees warnSome hallucinations could ‘potentially induce cardiac incidents in Legal,’ according to internal documentsThree days after Amazon announced its AI chatbot Q, some employees are sounding alarms about accuracy and privacy issues. Q is “experiencing severe hallucinations and leaking confidential data,” including the location of AWS data centers, internal discount programs, and unreleased features, according to leaked documents obtained by Platformer. An employee marked the incident as “sev 2,” meaning an incident bad enough to warrant paging engineers at night and make them work through the weekend to fix it. Q’s early woes come at a time when Amazon is working to fight the perception that Microsoft, Google, and other tech companies have surpassed it in the race to build tools and infrastructure that take advantage of generative artificial intelligence. In September, the company announced it would invest up to $4 billion in AI startup Anthropic. On Tuesday, at its annual Amazon Web Services developer conference, it announced Q — arguably the highest-profile release in the series of new AI initiatives the company unveiled this week. In a statement, Amazon played down the significance of the employee discussions. “Some employees are sharing feedback through internal channels and ticketing systems, which is standard practice at Amazon,” a spokesperson said. “No security issue was identified as a result of that feedback. We appreciate all of the feedback we’ve already received and will continue to tune Q as it transitions from being a product in preview to being generally available.” Q, which is now available in a free preview, was presented as a kind of enterprise-software version of ChatGPT. Initially, it will be able to answer developers’ questions about AWS, edit source code, and cite sources, Amazon executives said onstage this week. It will compete with similar tools from Microsoft and Google but be priced lower than rivals’, at least to start. In unveiling Q, executives promoted it as more secure than consumer-grade tools like ChatGPT. Adam Selipsky, CEO of Amazon Web Services, told the New York Times that companies “had banned these A.I. assistants from the enterprise because of the security and privacy concerns.” In response, the Times reported, “Amazon built Q to be more secure and private than a consumer chatbot.” An internal document about Q’s hallucinations and wrong answers notes that “Amazon Q can hallucinate and return harmful or inappropriate responses. For example, Amazon Q might return out of date security information that could put customer accounts at risk.” The risks outlined in the document are typical of large language models, all of which return incorrect or inappropriate responses at least some of the time. ... Keep reading with a 7-day free trialSubscribe to Platformer to keep reading this post and get 7 days of free access to the full post archives. A subscription gets you:
|
Older messages
Ten strategies for replacing Twitter from people who used to work there
Friday, December 1, 2023
Announcing 'Extremely Hardcore,' Zoë Schiffer's book on Musk's Twitter takeover
The OpenAI saga isn’t over just yet
Tuesday, November 28, 2023
A new board and a promised investigation could threaten Altman's happy ending
OpenAI's alignment problem
Tuesday, November 21, 2023
The company's board failed the institution. But did it have a point?
How banning one Palestinian slogan roiled Etsy
Tuesday, November 14, 2023
The company secretly banned the phrase “from the river to the sea” on sellers' wares. Some employees aren't happy
How OpenAI is building a path toward AI agents
Tuesday, November 7, 2023
Building a GPT-based copy editor showcases their promise — but the risks ahead are real
You Might Also Like
OpenAI loses its voice
Tuesday, May 21, 2024
The company hasn't been the same since Sam Altman's return — and its treatment of Scarlett Johansson should worry everyone Platformer Platformer OpenAI loses its voice By Casey Newton • 20 May
#180 | Spatial Computing, Energy Dilemma, AI Spending Patterns, & more
Monday, May 20, 2024
May 13–20th | Insights from Equal, Madrona, Bessemer, Greylock, Chamath, and others ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏
Chatting With Her - The ChatGPT App on Mac
Monday, May 20, 2024
Tomasz Tunguz Venture Capitalist If you were forwarded this newsletter, and you'd like to receive it in the future, subscribe here. Chatting With Her - The ChatGPT App on Mac For the past few
📂 How to test new pricing (and migrate legacy pricing)
Monday, May 20, 2024
Today's newsletter is proudly supported by xFusion 🎉 A few years ago I referred one of my consulting clients, SavvyCal, to xFusion to get help with customer support. And after seeing
When to Raise a Series A? 16 Silicon Valley Startups Raised $622.9M Last Week
Monday, May 20, 2024
💰 Sigma Computing Raised $200M Series D 💰 Top Universities For Funded Founders 🔢 Social Capital Fund Return (2011-2023) 👑 Palmer Luckey Wants to Be Silicon Valley's War King ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏
🦄 3D bioprinting for customizable tissue
Monday, May 20, 2024
FoldInk is building material, called bioinks, which are used to print real tissue.
NEW: state of AI
Monday, May 20, 2024
funding and deal size jumps, M&A exits drop, and six new unicorns join the club The State of AI Take a deeper look Hi there, Our newest State of AI Report is out. Spoiler: AI funding hit a 4-
How the customized learning pathway works
Monday, May 20, 2024
This is life-changing Hi , Many are asking how the customized learning pathway inside foundr+ works so I wanted to share. Here's how it works: Initial Assessment: When you first log in, you'll
April 2024 updates, new product!
Monday, May 20, 2024
Traveled to Bali and Sydney, some updates on Typing Mind, and a new product. ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏
Navigating hurdles as a migrant founder
Monday, May 20, 2024
Plus: Europe's first Black solo GP and the plant-based meat startup aiming for profitability View in browser Sponsor Card - Flagship (44)-2 Good morning there, First-generation migrants are a tough