Skip to content
No PriorsNo Priors

No Priors Ep 56 | With Baseten CEO and Co-Founder Tuhin Srivastava

At a time when users are being asked to wait unthinkable seconds for AI products to generate art and answers, speed is what will win the battle heating up in AI computing. At least according to today’s guest, Tuhin Srivastava, the CEO and co-founder of Baseten which gives customers scalable AI infrastructures starting with interference. In this episode of No Priors, Sarah, Elad, and Tuhin discuss why efficient code solutions are more desirable than no code, the most surprising use cases for Baseten, and why all of their jobs are very defensible from AI. Show Notes: (0:00) Introduction (1:19) Capabilities of efficient code enabled development (4:11) Difference in training inference workloads (6:12) AI product acceleration (8:48) Leading on inference benchmarks at BaseTen (12:08) Optimizations for different types of models (16:11) Internal vs open source models (19:01) timeline for enterprise scale (21:53) Rethinking investment in compute spend (27:50) Defensibility in AI industries (31:30) Hardware and the chip shortage (35:47) Speed is the way to win in this industry (38:26) Wrap

Sarah GuohostTuhin SrivastavaguestElad Gilhost
Mar 21, 202438mWatch on YouTube ↗

CHAPTERS

  1. 0:00 – 1:19

    Introduction

  2. 1:19 – 4:11

    Capabilities of efficient code enabled development

  3. 4:11 – 6:12

    Difference in training inference workloads

  4. 6:12 – 8:48

    AI product acceleration

  5. 8:48 – 12:08

    Leading on inference benchmarks at BaseTen

  6. 12:08 – 16:11

    Optimizations for different types of models

  7. 16:11 – 19:01

    Internal vs open source models

  8. 19:01 – 21:53

    timeline for enterprise scale

  9. 21:53 – 27:50

    Rethinking investment in compute spend

  10. 27:50 – 31:30

    Defensibility in AI industries

  11. 31:30 – 35:47

    Hardware and the chip shortage

  12. 35:47 – 38:26

    Speed is the way to win in this industry

  13. 38:26 – 38:32

    Wrap

Get more out of YouTube videos.

High quality summaries for YouTube videos. Accurate transcripts to search & find moments. Powered by ChatGPT & Claude AI.

Add to Chrome