Centaurs & Cyborgs : The Jagged Frontier of AI
Tomasz TunguzVenture Capitalist If you were forwarded this newsletter, and you'd like to receive it in the future, subscribe here. Centaurs & Cyborgs : The Jagged Frontier of AI
Last week, Harvard Business School released its analysis of LLMs on 758 consultants’ performance when using AI. Three key insights emerged. In the first experiment (inside AI’s capability frontier), consultants randomly assigned access to GPT-4 AI completed 12.2% more tasks on average & 25.1% faster. Quality improved by 40%. Lower performing consultants benefit the most from AI augmentation, increasing performance by 43% compared to 17% for higher performers. This rising-tide effect seems common across AI applications. The benefit to the lower quartiles is dramatic across sales, customer support, & consulting. This has broader implications, something I aim to write about later this week. In the second experiment, consultants analyze business data to offer strategic recommendations. Here, AI reduces performance - those using AI are 19 percentage points less likely to produce correct solutions. The “jagged frontier” conceptualizes how AI profoundly increases productivity on some tasks but provides no value or even diminishes performance on seemingly similar tasks. As with any tool, we need to learn the best applications & techniques for hewing knowledge work effectively. Last, the paper discusses two types of human/AI collaboration : centaurs & cyborgs. Centaurs ask for high-level help with AI. Cyborgs train the AI to act as a character. The difference remains a bit nebulous to me, but the last section of the paper in Appendix E highlights different techniques, some of which I hadn’t explored.
I haven’t yet asked an LLM to impersonate someone but given the impact to education, I could imagine LLMs becoming sales & customer support trainers for new employees in those roles. Especially since the impact on lower quartiles (presumably many of which are ramping) is so marked. |
Older messages
Artisanal Emails
Wednesday, September 27, 2023
Tomasz Tunguz Venture Capitalist If you were forwarded this newsletter, and you'd like to receive it in the future, subscribe here. Artisanal Emails Artisanal chocolate, artisanal candles,
Avoiding the PLG Trap : Office Hours with Oliver Jay
Monday, September 25, 2023
Tomasz Tunguz Venture Capitalist If you were forwarded this newsletter, and you'd like to receive it in the future, subscribe here. Avoiding the PLG Trap : Office Hours with Oliver Jay On
Building Applications with AI - Lessons from LangChain, Hearth, & Context.ai
Thursday, September 21, 2023
Tomasz Tunguz Venture Capitalist If you were forwarded this newsletter, and you'd like to receive it in the future, subscribe here. Building Applications with AI - Lessons from LangChain, Hearth,
Building a Generational Business Databrick by Databrick
Monday, September 18, 2023
Tomasz Tunguz Venture Capitalist If you were forwarded this newsletter, and you'd like to receive it in the future, subscribe here. Building a Generational Business Databrick by Databrick Last
4 Key Takeaways from the AI Panel at Saastr 2023
Sunday, September 17, 2023
Tomasz Tunguz Venture Capitalist If you were forwarded this newsletter, and you'd like to receive it in the future, subscribe here. 4 Key Takeaways from the AI Panel at Saastr 2023 Last week at
You Might Also Like
🗞 What's New: YouTube just launched Hype to help small creators get discovered
Thursday, September 19, 2024
Also: Running newsletter ads!
SaaSHub Weekly - Sep 19
Thursday, September 19, 2024
SaaSHub Weekly - Sep 19 Featured and useful products Schedul Threads logo Schedul Threads Boost your Threads following, reach monetization status fast and automate your Threads content publishing for
95 new Shopify apps for you 🌟
Thursday, September 19, 2024
New Shopify apps hand-picked for you 🙌 Week 37 Sep 9, 2024 - Sep 16, 2024 New Shopify apps hand-picked for you 🙌 What's New at Shopify? 🌱 New granular staff permissions for Gift cards Improvement ⸱
[SaaS Club] How firing customers built a 7-figure SaaS
Thursday, September 19, 2024
The SaaS Club Newsletter Hey Reader Here's a quick round up of what's been going on at SaaS Club: In this week's newsletter: 🎧 Discover how firing customers fueled SaaS growth 📈 Turn
The MrBeast Guide
Thursday, September 19, 2024
Today's newsletter is brought to you by LCA. We help companies build their future. From new products to websites, apps, and AI solutions. We work with businesses doing $10M-$10B in revenue. We
Writing Software for Robots
Thursday, September 19, 2024
Tomasz Tunguz Venture Capitalist If you were forwarded this newsletter, and you'd like to receive it in the future, subscribe here. Writing Software for Robots In a few years, most feature flags
KoppieOS, ScrapX, Notch, Magic Inspector, and Entyx
Thursday, September 19, 2024
KoppieOS, where Ai meets Personality. BetaList BetaList Daily Magic Inspector Automate browser testing in natural language KoppieOS KoppieOS, where Ai meets Personality. ScrapX Monitor your competitors
“I’m waiting for the right time”
Thursday, September 19, 2024
Read time: 1 min. 03 sec. "Hey Pat, can I talk to you for a second?" My buddy pulled me aside at a wedding last weekend. I already knew what he wanted to ask... "I really want to do what
Mastering Portfolio Construction
Thursday, September 19, 2024
How to build a strategy that maximizes returns. ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏
join me: Big Tech in Fintech
Thursday, September 19, 2024
thought you would be interested Hi there, Laura here, Principal Analyst at CB Insights. Thought you would be interested in this new briefing on big tech's activity in financial services. In under