Stanford CS153 Frontier Systems | Amit Jain from Luma AI on Unified Intelligence Systems

ℹ️ EPISODE INFO

Released

May 6, 2026

Duration

57m

Channel

Stanford Online

Watch on YouTube

▶ Open ↗

📝 EPISODE DESCRIPTION

For more information about Stanford's online Artificial Intelligence programs, visit: https://stanford.io/ai Follow along with the course schedule and syllabus, visit: https://cs153.stanford.edu/ In week three of CS153, the instructor hosts Amit Jain from Luma to discuss “Unified Intelligence Systems” as a follow-up to a prior lecture on visual intelligence. Jain recounts his Apple work on LiDAR for projects including Titan and Vision Pro, and how early exploration of generative models and differentiable 3D led to founding Luma with an initial focus on large-scale 3D capture. Luma then shifted to generative video in 2023 to leverage the scale of internet video data, releasing the Dream Machine model in March 2024 and rapidly reaching millions of users, while building preference-based feedback loops and human annotation pipelines. Jain explains Luma’s multimodal AI factory—pretraining, post-training, deployment, and reinforcement learning—its security constraints for studio clients, and a move toward unified transformer architectures that jointly reason across text, images, video, and audio to enable end-to-end creative and professional workflows. Guest speaker: Amit Jain is the CEO and co-founder of Luma AI, a research lab developing multimodal foundation models aimed at "unified intelligence." Under his leadership, Luma has scaled from a 3D-capture pioneer into a leader in generative video, raising a $900M Series C following the success of its Dream Machine and Ray video-reasoning models. By 2026, he has steered the company into large-scale infrastructure projects including Project Halo — a 2-gigawatt AI supercluster — to build the next generation of "world models" capable of simulating physical reality. He founded Luma in 2022 from Apple, where he was a Systems and Machine Learning Engineer. At Apple, he led development of the Passthrough feature for Apple Vision Pro and was instrumental in integrating the first LiDAR sensors into the iPhone — foundational work for modern spatial computing. His background also includes physics and mathematical simulation. Follow the playlist: https://youtube.com/playlist?list=PLoROMvodv4rN447WKQ5oz_YdYbS74M5IA&si=DOJ5amlyRdyMJBhG

🎤 SPEAKERS

• CS153 Instructor

  host

  Instructor for Stanford CS153 who hosts the session and leads the interview/Q&A with the guest.

• Amit Jain

  guest

  Founder/leader at Luma AI, previously worked at Apple on iPhone LiDAR systems, speaking about Luma’s unified intelligence systems and products like Dream Machine.

🧾 EPISODE SUMMARY

In this episode of Stanford Online, featuring CS153 Instructor and Amit Jain, Stanford CS153 Frontier Systems | Amit Jain from Luma AI on Unified Intelligence Systems explores luma AI’s unified multimodal models for end-to-end creative work automation Luma began with the thesis that differentiable learning over rich world observations enables understanding and generation, initially focusing on 3D capture (NeRF/Gaussian splats) before realizing 3D data could not reach internet-scale volume.

🔗 RELATED EPISODES

Stanford CS153 Frontier Systems | Andreas Blattmann from Black Forest Labs on Visual Intelligence

Stanford CS153 Frontier Systems | Nikhyl Singhal from Skip on Product Management in the AI Era

Stanford CS153 Frontier Systems | Mati Staniszewski from ElevenLabs on The Future of Voice Systems

Stanford CS153 Frontier Systems | Anjney Midha from AMP PBC on Frontier Systems

Stanford CS230 | Autumn 2025 | Lecture 8: Agents, Prompts, and RAG