How to make LLMs fast: KV Caching, Speculative Decoding, and Multi-Query Attention | Cursor Team

Описание: Lex Fridman Podcast full episode:    • Cursor Team: Future of Programming with AI...  
Thank you for listening ❤ Check out our sponsors: https://lexfridman.com/sponsors/cv806...
See below for guest bio, links, and to give feedback, submit questions, contact Lex, etc.

GUEST BIO:
Aman Sanger, Arvid Lunnemark, Michael Truell, and Sualeh Asif are creators of Cursor, a popular code editor that specializes in AI-assisted programming.

CONTACT LEX:
Feedback - give feedback to Lex: https://lexfridman.com/survey
AMA - submit questions, videos or call-in: https://lexfridman.com/ama
Hiring - join our team: https://lexfridman.com/hiring
Other - other ways to get in touch: https://lexfridman.com/contact

EPISODE LINKS:
Cursor Website: https://cursor.com
Cursor on X: https://x.com/cursor_ai
Anysphere Website: https://anysphere.inc/
Aman's X: https://x.com/amanrsanger
Aman's Website: https://amansanger.com/
Arvid's X: https://x.com/ArVID220u
Arvid's Website: https://arvid.xyz/
Michael's Website: https://mntruell.com/
Michael's LinkedIn: https://bit.ly/3zIDkPN
Sualeh's X: https://x.com/sualehasif996
Sualeh's Website: https://sualehasif.me/

SPONSORS:
To support this podcast, check out our sponsors & get discounts:
Encord: AI tooling for annotation & data management.
Go to https://lexfridman.com/s/encord-cv806...
MasterClass: Online classes from world-class experts.
Go to https://lexfridman.com/s/masterclass-...
Shopify: Sell stuff online.
Go to https://lexfridman.com/s/shopify-cv80...
NetSuite: Business management software.
Go to https://lexfridman.com/s/netsuite-cv8...
AG1: All-in-one daily nutrition drinks.
Go to https://lexfridman.com/s/ag1-cv8062-sb

PODCAST LINKS:
Podcast Website: https://lexfridman.com/podcast
Apple Podcasts: https://apple.co/2lwqZIr
Spotify: https://spoti.fi/2nEwCF8
RSS: https://lexfridman.com/feed/podcast/
Podcast Playlist:    • Lex Fridman Podcast  
Clips Channel:    / lexclips  

SOCIAL LINKS:
X: https://x.com/lexfridman
Instagram:   / lexfridman  
TikTok:   / lexfridman  
LinkedIn:   / lexfridman  
Facebook:   / lexfridman  
Patreon:   / lexfridman  
Telegram: https://t.me/lexfridman
Reddit:   / lexfridman