Tomasz Tunguz - The AI Trust Fall
Tomasz TunguzVenture Capitalist If you were forwarded this newsletter, and you'd like to receive it in the future, subscribe here. The AI Trust Fall
If I asked you, “When someone turns in a work assignment, how accurate is it? 80%, 90%, 95% or perhaps 100%?” We don’t think this way about coworkers’ spreadsheets. But we will probably think this way about AI & this will very likely change the way product managers on-board users. When was the last time you signed up for a SaaS & wondered : Would the data be accurate? Would the database corrupt my data? Would the report be correct? But today, with every AI software now tucking a disclaimer at the bottom of the page, we will be wondering. “Gemini may display inaccurate info, including about people, so double-check its responses” & “ChatGPT/Claude can make mistakes. Check important info” are two examples. In the early days of this epoch, mistakes will be common. Over time, less so, as accuracies improve. The more important the work, the greater peoples’ need to be confident the AI is correct. We will demand much better than human error rates. Self-driving cars provide an extreme example of this trust fall. Waymo & Cruise have published data arguing self-driving cars are 65-94% safer. Yet, 2/3 of Americans surveyed by the AAA fear them. We suffer from a cognitive bias : work performed by a human is likely more trustworthy because we understand the biases & the limitations. AIs are a Schrodinger’s cat stuffed in a black box. We don’t comprehend how the box works (yet), nor can we believe our eyes if the feline is dead or alive when we see it. New product on-boarding will need to mitigate this bias. One path may be starting with low-value tasks where the software-maker has tested exhaustively the potential inputs & outputs. Another tactic may be to provide a human-in-the-loop to check the AI’s work. Citations, references, & other forms of fact-checking will be a core part of the product experience. Independent testing might be another path. As with any new colleague, the first impressions & a series of small wins will determine the person’s trust. Severe errors in the future will erode confidence, that must be rebuilt - likely with the help of human support teams who will explain, develop tests for the future, & assure users. I recently asked a financial LLM to analyze NVIDIA’s annual report. A question about the company’s increase in dividend amount vaporized its credibility, raising the question : is it less work to do the analysis myself than to check the AI’s work? That will be the trust fall for AI. Will the software catch us if we trust it? |
Older messages
NVIDIA
Thursday, May 23, 2024
Tomasz Tunguz Venture Capitalist If you were forwarded this newsletter, and you'd like to receive it in the future, subscribe here. NVIDIA NVIDIA's growth is an index on the growth of AI. “
Chatting With Her - The ChatGPT App on Mac
Monday, May 20, 2024
Tomasz Tunguz Venture Capitalist If you were forwarded this newsletter, and you'd like to receive it in the future, subscribe here. Chatting With Her - The ChatGPT App on Mac For the past few
AI Spending Patterns : It's Not What You Think
Friday, May 17, 2024
Tomasz Tunguz Venture Capitalist If you were forwarded this newsletter, and you'd like to receive it in the future, subscribe here. AI Spending Patterns : It's Not What You Think Ramp
BI's Third Form : Office Hours with Benn Stancil
Friday, May 17, 2024
Tomasz Tunguz Venture Capitalist If you were forwarded this newsletter, and you'd like to receive it in the future, subscribe here. BI's Third Form : Office Hours with Benn Stancil On
Are AI Companies Valued Differently Than Non-AI Companies?
Tuesday, May 14, 2024
Tomasz Tunguz Venture Capitalist If you were forwarded this newsletter, and you'd like to receive it in the future, subscribe here. Are AI Companies Valued Differently Than Non-AI Companies? The
You Might Also Like
🗞 What's New: Cold emails are your secret weapon
Tuesday, July 2, 2024
Also: Supercharge your marketing with AI!
Counterintuitive advice for building AI products
Tuesday, July 2, 2024
Lessons from 20+ top product builders, including Scott Belsky, Elad Gil, Rahul Vohra, and Sarah Guo ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏
Defence 'FOMO'?
Tuesday, July 2, 2024
Plus: The semiconductor startups to watch; Seaya's €300m climate fund View in browser Sponsor Card - Flagship-23 Good morning there, Some of the technology that we cover in this newsletter seems
This Wednesday: AMA Alert!
Monday, July 1, 2024
Save Your Spot for Our Upcoming Session!͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏
Meet your Lenny’s Newsletter Fellows ✨
Monday, July 1, 2024
Welcome Tara Seshan, Natalie Rothfels, and Jules Walter 👏 ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏
thought you’d be interested
Monday, July 1, 2024
venture's midyear review (in under 30 mins) Hi there, Want to learn about the major trends in venture capital so far in 2024? Then this webinar is for you. It's being led by CB Insights'
🦄 Maximize your credit card rewards
Monday, July 1, 2024
Kudos is web extension helping shoppers maximize their credit card rewards.
🔥 Back by popular demand - FREE 5-Day Product Idea Challenge
Monday, July 1, 2024
LIVE with our top coaches Hi , It's back! The 5-DAY Find & Validate Your Product Idea Challenge was so good and so impactful for our community that we're doing it again to help you. Yes,
What Would John Wooden Look for in a President?
Monday, July 1, 2024
💰 12 Silicon Valley Startups Raised $545.5M - Week of June 24, 2024 👓 How to Read a Founder? ✨ Are these new innovations or distractions for VC? 🗺️ The Enterprise AI Roadmap ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏
📂 Crisp adds days to your trial for completing actions
Monday, July 1, 2024
Today's newsletter is proudly supported by ReactSquad 🎉 I decided to partner with ReactSquad after experiencing first-hand how hard it was to hire a reliable engineer without paying Silicon