Baseten CEO and co-founder Tuhin Srivastava on inference and feedback loops

Описание: The episode features Baseten CEO and cofounder Tuhin, who shares Baseten’s journey from a small team in the pre-GenAI era to scaling rapidly and raising $150M in Series D funding. The discussion delves into building robust inference infrastructure for AI applications, navigating market shifts, and developing tools that prioritize speed, developer experience, and customer feedback loops.

This episode is brought to you by WorkOS. If you're thinking about selling to enterprise customers, WorkOS can help you add enterprise features like Single Sign On and audit logs. https://workos.com/

Links:
• Baseten: https://www.baseten.co/
• Tuhin's Linkedin:   / tuhin-srivastava  

Chapters:
00:00 - Intro
00:30 - Baseten origin story
05:13 - Keeping up with demand
06:42 - WorkOS Sponsor
07:41 - How do you move fast?
10:26 - Managing time
11:30 - Inference
15:29 - Developer experience in inference
18:50 - Baseten model training
20:30 - GPUs
22:12 - Advice to DevTool founders