Centaurs & Cyborgs : The Jagged Frontier of AI
Tomasz TunguzVenture Capitalist If you were forwarded this newsletter, and you'd like to receive it in the future, subscribe here. Centaurs & Cyborgs : The Jagged Frontier of AI
Last week, Harvard Business School released its analysis of LLMs on 758 consultants’ performance when using AI. Three key insights emerged. In the first experiment (inside AI’s capability frontier), consultants randomly assigned access to GPT-4 AI completed 12.2% more tasks on average & 25.1% faster. Quality improved by 40%. Lower performing consultants benefit the most from AI augmentation, increasing performance by 43% compared to 17% for higher performers. This rising-tide effect seems common across AI applications. The benefit to the lower quartiles is dramatic across sales, customer support, & consulting. This has broader implications, something I aim to write about later this week. In the second experiment, consultants analyze business data to offer strategic recommendations. Here, AI reduces performance - those using AI are 19 percentage points less likely to produce correct solutions. The “jagged frontier” conceptualizes how AI profoundly increases productivity on some tasks but provides no value or even diminishes performance on seemingly similar tasks. As with any tool, we need to learn the best applications & techniques for hewing knowledge work effectively. Last, the paper discusses two types of human/AI collaboration : centaurs & cyborgs. Centaurs ask for high-level help with AI. Cyborgs train the AI to act as a character. The difference remains a bit nebulous to me, but the last section of the paper in Appendix E highlights different techniques, some of which I hadn’t explored.
I haven’t yet asked an LLM to impersonate someone but given the impact to education, I could imagine LLMs becoming sales & customer support trainers for new employees in those roles. Especially since the impact on lower quartiles (presumably many of which are ramping) is so marked. |
Older messages
Wednesday, September 27, 2023
Tomasz Tunguz Venture Capitalist If you were forwarded this newsletter, and you'd like to receive it in the future, subscribe here. Artisanal Emails Artisanal chocolate, artisanal candles,
Avoiding the PLG Trap : Office Hours with Oliver Jay
Monday, September 25, 2023
Tomasz Tunguz Venture Capitalist If you were forwarded this newsletter, and you'd like to receive it in the future, subscribe here. Avoiding the PLG Trap : Office Hours with Oliver Jay On
Building Applications with AI - Lessons from LangChain, Hearth, & Context.ai
Thursday, September 21, 2023
Tomasz Tunguz Venture Capitalist If you were forwarded this newsletter, and you'd like to receive it in the future, subscribe here. Building Applications with AI - Lessons from LangChain, Hearth,
Building a Generational Business Databrick by Databrick
Monday, September 18, 2023
Tomasz Tunguz Venture Capitalist If you were forwarded this newsletter, and you'd like to receive it in the future, subscribe here. Building a Generational Business Databrick by Databrick Last
4 Key Takeaways from the AI Panel at Saastr 2023
Sunday, September 17, 2023
Tomasz Tunguz Venture Capitalist If you were forwarded this newsletter, and you'd like to receive it in the future, subscribe here. 4 Key Takeaways from the AI Panel at Saastr 2023 Last week at
Thursday, November 30, 2023
N26's results, a new French deeptech lobby, how to get a job at a startup and an AI concierge welcomes Eleanor to Slush. View in browser Logo - Zoom_flagship (1) Good morning there, On the agenda
Thursday, November 30, 2023
View in browser Top News OpenAI's board officially began work today. Microsoft has a board observer seat, but CEO and cofounder Sam Altman has no seat on the board whatsoever, a key concession he
Managing Data as Product : Office Hours with Philip Zelitchenko
Wednesday, November 29, 2023
Tomasz Tunguz Venture Capitalist If you were forwarded this newsletter, and you'd like to receive it in the future, subscribe here. Managing Data as Product : Office Hours with Philip Zelitchenko
Wednesday, November 29, 2023
New Shopify apps hand-picked for you 🙌 Week 47 Nov 20, 2023 - Nov 27, 2023 New Shopify apps hand-picked for you 🙌 What's New at Shopify? 🌱 Shopify Flow - Get notified when errors happen New ⸱ Apps
Boildown, Roam Around, Pico, Taskily, Guideflow, and more
Wednesday, November 29, 2023
Learn coding the fun way by building popular games BetaList BetaList Weekly Taskily Task management tool with a goal to perfectly balance simplicity and depth Roam Around Personalised travel plans for
Wednesday, November 29, 2023
we break down the players to watch, who's ahead of the pack and the emerging tech shaping the space Hi there, The way we manage our money is transforming, so what's at stake? Our expert will
Wednesday, November 29, 2023
View this email in your browser Founder Weekly Welcome to issue 614 of Founder Weekly. Let's get straight to the links this week. General Big TAM Founders, Small TAM Startups This post explores a
Wednesday, November 29, 2023
here's what you need to know… Hi , There's a reason why Start & Scale has helped over 20000 entrepreneurs launch a profitable online store. It's not just because the program is the most
Today's featured projects in 10 words
Wednesday, November 29, 2023
Today's projects: Flowshot • StashLeads • caspa AI • Makeyourwp • Unshape • GravityWrite 10words Discover new apps and startups in 10 words or less Flowshot: Use AI in Google Sheets without setup
Andrew Hodson — A Mechanic's Leap into Tech Entrepreneurship — The Bootstrapped Founder 272
Wednesday, November 29, 2023
Andrew Hudson (@MyBuddyAndrew) is an indie hacker who has taken an unconventional journey: from getting his hands dirty as an auto mechanic to SaaS.