The Winds of AI Winter (Q2 Four Wars of the AI Stack Recap)

ℹ️ EPISODE INFO

Released

August 2, 2024

Duration

1h 23m

Channel

Latent Space

Watch on YouTube

▶ Open ↗

📝 EPISODE DESCRIPTION

Thank you for 1m downloads of the podcast and 2m readers of the Substack! 🎉 This is the audio discussion following The Winds of AI Winter essay that also serves as a recap of Q2 2024 in AI viewed through the lens of our Four Wars framework. Enjoy! 00:00:00 Intro Song by Suno.ai 00:02:01 Swyx and Alessio in Singapore 00:05:49 GPU Rich vs Poors: Frontier Labs 00:06:35 GPU Rich Frontier Models: Claude 3.5 00:10:37 GPU Rich helping Poors: Llama 3.1: The Synthetic Data Model 00:15:41 GPU Rich helping Poors: Frontier Labs Vibe Shift - Phi 3, Gemma 2 00:18:26 GPU Rich: Mistral Large 00:21:56 GPU Rich: Nvidia + FlashAttention 3 00:23:45 GPU Rich helping Poors: Noam Shazeer & Character.AI 00:28:14 GPU Poors: On Device LLMs: Mozilla Llamafile, Chrome (Gemini Nano), Apple Intelligence 00:35:33 Quality Data Wars: NYT vs The Atlantic lawyer up vs partner up 00:37:41 Quality Data Wars: Reddit, ScarJo, RIAA vs Udio & Suno 00:41:03 Quality Data Wars: Synthetic Data, Jagged Intelligence, AlphaProof 00:45:33 Multimodality War: ChatGPT Voice Mode, OpenAI demo at AIEWF 00:47:34 Multimodality War: Meta Llama 3 multimodality + Chameleon 00:50:54 Multimodality War: PaliGemma + CoPaliGemma 00:52:55 Renaming Rag/Ops War to LLM OS War 00:55:31 LLM OS War: Ops War: Prompt Management vs Gateway vs Observability 01:02:57 LLM OS War: BM42 Vector DB Wars, Memory Databases, GraphRAG 01:06:15 LLM OS War: Agent Tooling 01:08:26 LLM OS War: Agent Protocols 01:10:43 Trend: Commoditization of Intelligence 01:16:45 Trend: Vertical Service as Software, AI Employees, Brightwave, Dropzone 01:20:44 Trend: Benchmark Frontiers after MMLU 01:23:31 Crowdstrike will save us from Skynet

🎤 SPEAKERS

• Alessio Fanelli

  host

  Partner and CTO-in-Residence at Decibel Partners; co-host of Latent Space covering AI industry and infrastructure.

• swyx

  host

  Co-host of Latent Space focused on AI engineering, agents/LLMOS, and AI news/community building.

🧾 EPISODE SUMMARY

In this episode of Latent Space, featuring Alessio Fanelli and swyx, The Winds of AI Winter (Q2 Four Wars of the AI Stack Recap) explores Four AI stack wars: models, data fights, multimodality, LLM OS The episode recaps recent AI developments using the “Four Wars” framework: GPU-rich vs GPU-poor, data quality/legal battles, multimodality, and a renamed “LLM OS” layer that includes RAG, ops, memory, and agents.

🔗 RELATED EPISODES

Answer.ai & AI Magic with Jeremy Howard

Efficiency is Coming: 3000x Faster, Cheaper, Better AI Inference

Segment Anything 2: Memory + Vision = Object Permanence — with Nikhila Ravi and Joseph Nelson

Training Llama 2, 3 & 4: The Path to Open Source AGI — with Thomas Scialom of Meta AI

The 10,000x Yolo Researcher Metagame — with Yi Tay of Reka

State of the Art: Training 70B LLMs on 10,000 H100 clusters