Building Applications with AI - Lessons from LangChain, Hearth, & Context.ai
Tomasz TunguzVenture Capitalist If you were forwarded this newsletter, and you'd like to receive it in the future, subscribe here. Building Applications with AI - Lessons from LangChain, Hearth, & Context.ai
Yesterday at TechCrunch Disrupt, Harrison Chase, founder of LangChain, Ashe Magalhaes founder of Hearth, & Henry Scott-Green, founder of Context.ai, & I discussed the future of building LLM-enabled applications. We assembled the panel as a three layer cake : Hearth, the application ; Langchain, the infrastructure ; Context.ai, the product analytics. Here are my takeaways from the conversation. First, it’s very early in LLM application development in every sense of the word. Few applications are managing significant user volumes. Many remain in testing & are working to develop quality scores for LLM performance before launch. The state of the art is using “vibes” ; how much better did the model feel? Fine-tuning may top the conversations in social media, but not many have launched fine-tuned models into production. Second, the stack is maturing at the same time. The core components include technologies to provide context to a model (retrieving relevant information), the models themselves, & then the monitoring (LangChain’s LangSmith)/analytics (Context.ai) infrastructure to investigate performance. It’s possible that the world will move to “constellations of models.” A user issues a query, the system adds the right context. Then a router sends to the best model for the task. (either a large language model or a bespoke small model). But, today, most traffic is going to the most accurate LLMs. There’s not much specialization in models just yet. Third, user intent data — following a user to understand their goal in a product — is essential to building great LLM applications. Part of this data set will be derived from product use; some of it will be imputed using analysis ; & human labeling may play a role. Understanding when a model acts unexpectedly or inappropriately is critical but hard to do & even harder to catch in real time. But this will be an important part of the stack. Last, agentic applications, those which act on behalf of users, have the potential to transform work. There are new product design challenges to solve including how to fashion these products to work for an individual & a team. Most of the LLM products today are single-player. Thanks to Ashe, Harrison, & Henry for joining me on the panel. |
Older messages
Building a Generational Business Databrick by Databrick
Monday, September 18, 2023
Tomasz Tunguz Venture Capitalist If you were forwarded this newsletter, and you'd like to receive it in the future, subscribe here. Building a Generational Business Databrick by Databrick Last
4 Key Takeaways from the AI Panel at Saastr 2023
Sunday, September 17, 2023
Tomasz Tunguz Venture Capitalist If you were forwarded this newsletter, and you'd like to receive it in the future, subscribe here. 4 Key Takeaways from the AI Panel at Saastr 2023 Last week at
A Little Yellow Book in the Corner Bookshelf of a Coffee Shop
Monday, September 11, 2023
Tomasz Tunguz Venture Capitalist If you were forwarded this newsletter, and you'd like to receive it in the future, subscribe here. A Little Yellow Book in the Corner Bookshelf of a Coffee Shop
Whispers of the Future
Friday, September 8, 2023
Tomasz Tunguz Venture Capitalist If you were forwarded this newsletter, and you'd like to receive it in the future, subscribe here. Whispers of the Future I've been fascinated by dictation
The Rise of Data Lakes in Software Architecture
Thursday, September 7, 2023
Tomasz Tunguz Venture Capitalist If you were forwarded this newsletter, and you'd like to receive it in the future, subscribe here. The Rise of Data Lakes in Software Architecture Historically,
You Might Also Like
🗞 What's New: YouTube just launched Hype to help small creators get discovered
Thursday, September 19, 2024
Also: Running newsletter ads!
SaaSHub Weekly - Sep 19
Thursday, September 19, 2024
SaaSHub Weekly - Sep 19 Featured and useful products Schedul Threads logo Schedul Threads Boost your Threads following, reach monetization status fast and automate your Threads content publishing for
95 new Shopify apps for you 🌟
Thursday, September 19, 2024
New Shopify apps hand-picked for you 🙌 Week 37 Sep 9, 2024 - Sep 16, 2024 New Shopify apps hand-picked for you 🙌 What's New at Shopify? 🌱 New granular staff permissions for Gift cards Improvement ⸱
[SaaS Club] How firing customers built a 7-figure SaaS
Thursday, September 19, 2024
The SaaS Club Newsletter Hey Reader Here's a quick round up of what's been going on at SaaS Club: In this week's newsletter: 🎧 Discover how firing customers fueled SaaS growth 📈 Turn
The MrBeast Guide
Thursday, September 19, 2024
Today's newsletter is brought to you by LCA. We help companies build their future. From new products to websites, apps, and AI solutions. We work with businesses doing $10M-$10B in revenue. We
Writing Software for Robots
Thursday, September 19, 2024
Tomasz Tunguz Venture Capitalist If you were forwarded this newsletter, and you'd like to receive it in the future, subscribe here. Writing Software for Robots In a few years, most feature flags
KoppieOS, ScrapX, Notch, Magic Inspector, and Entyx
Thursday, September 19, 2024
KoppieOS, where Ai meets Personality. BetaList BetaList Daily Magic Inspector Automate browser testing in natural language KoppieOS KoppieOS, where Ai meets Personality. ScrapX Monitor your competitors
“I’m waiting for the right time”
Thursday, September 19, 2024
Read time: 1 min. 03 sec. "Hey Pat, can I talk to you for a second?" My buddy pulled me aside at a wedding last weekend. I already knew what he wanted to ask... "I really want to do what
Mastering Portfolio Construction
Thursday, September 19, 2024
How to build a strategy that maximizes returns. ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏ ͏
join me: Big Tech in Fintech
Thursday, September 19, 2024
thought you would be interested Hi there, Laura here, Principal Analyst at CB Insights. Thought you would be interested in this new briefing on big tech's activity in financial services. In under