Vijay Kumar: Flying Robots | Lex Fridman Podcast #37
Lex Fridman (host), Vijay Kumar (guest)
In this episode of Lex Fridman Podcast, featuring Lex Fridman and Vijay Kumar, Vijay Kumar: Flying Robots | Lex Fridman Podcast #37 explores vijay Kumar reveals future of agile flying robots and swarms Vijay Kumar discusses the evolution of robotics from massive hexapod walkers to agile micro aerial robots capable of coordinated 3D formations and complex autonomous missions.
Vijay Kumar reveals future of agile flying robots and swarms
Vijay Kumar discusses the evolution of robotics from massive hexapod walkers to agile micro aerial robots capable of coordinated 3D formations and complex autonomous missions.
He explains how inspiration from biological swarms like ants informs robust, decentralized multi-robot systems, and contrasts nature’s emergent behavior with engineered, mission-driven coordination.
Kumar distinguishes true autonomy from today’s GPS- and communication-dependent systems, outlining the sensing, control, and planning needed for agile flight in cluttered, GPS-denied environments.
The conversation ranges from drone delivery and flying cars to the limits of machine learning, safety, weaponization risks, human-robot collaboration, and the broad, math-heavy education needed for future roboticists.
Key Takeaways
True autonomy requires operating without GPS, communications, maps, or human pilots.
Kumar defines real autonomy as a robot’s ability to navigate and make decisions when it has no external infrastructure to rely on, which is significantly harder than current autopilot or remotely supervised systems.
Get the full analysis with uListen AI
Swarm behavior should be engineered at the collective level, not micro-managed at the individual level.
To scale to many robots, you must design simple local rules, robust individuals, and resilient group strategies so large populations can reorganize, reestablish communication, and adapt without centralized control.
Get the full analysis with uListen AI
Quadrotors are powerful because a simple four-motor configuration enables full 3D maneuverability.
By carefully controlling motor RPMs using IMUs and other sensors, quadrotors can hover, translate, and rotate, turning a seemingly under-actuated system (four inputs, six degrees of freedom) into a highly versatile platform.
Get the full analysis with uListen AI
Learning already quietly underpins control, but model-based and data-driven methods must be combined.
Kumar notes that iterative learning in flight control has long existed, even if not labeled as machine learning, and argues the future lies in hybrid systems—using learning for perception and adaptation, and models for reliable, safety-critical planning and control.
Get the full analysis with uListen AI
Relying solely on vision and data-driven learning has diminishing returns and huge energy costs.
Improving perception accuracy from 90% to 99. ...
Get the full analysis with uListen AI
Battery energy and power density are a major bottleneck for scalable aerial robotics and flying cars.
Current lithium-based batteries limit range and demand very high power (e. ...
Get the full analysis with uListen AI
Robotics must be developed in a human context, with engineers actively engaging in ethics and policy.
Kumar emphasizes that robots are built for human problems, warns about the ease of weaponizing swarms, and argues that both engineers and politicians must understand technology deeply to manage risks and design effective defenses.
Get the full analysis with uListen AI
Notable Quotes
“Drones to me is a pejorative word. It signifies something that's dumb, that's pre-programmed, that does one little thing. And robots are anything but drones.”
— Vijay Kumar
“As engineers, what we want to do is to go beyond the individual components and think about it as a cohesive unit without worrying about the individual components.”
— Vijay Kumar
“If there are no pilots, no communications with any base station, no knowledge of position, and no a priori map, can robots navigate? So that is true autonomy.”
— Vijay Kumar
“We think about this as an information processing problem. Actually, it is an energy processing problem.”
— Vijay Kumar
“Technology is the new liberal art. Understanding how technology will change your life is important and every human being needs to understand that.”
— Vijay Kumar
Questions Answered in This Episode
How can we design swarm algorithms that remain safe and controllable when used by adversaries with destructive goals?
Vijay Kumar discusses the evolution of robotics from massive hexapod walkers to agile micro aerial robots capable of coordinated 3D formations and complex autonomous missions.
Get the full analysis with uListen AI
What breakthroughs in materials, propulsion, or storage could realistically overcome current battery energy and power density limits for aerial robots?
He explains how inspiration from biological swarms like ants informs robust, decentralized multi-robot systems, and contrasts nature’s emergent behavior with engineered, mission-driven coordination.
Get the full analysis with uListen AI
Where is the line between acceptable model-based control and risky end-to-end learned control in safety-critical robotics like aviation and driving?
Kumar distinguishes true autonomy from today’s GPS- and communication-dependent systems, outlining the sensing, control, and planning needed for agile flight in cluttered, GPS-denied environments.
Get the full analysis with uListen AI
How should regulations evolve to handle dense skies filled with delivery drones and possibly flying taxis in crowded urban environments?
The conversation ranges from drone delivery and flying cars to the limits of machine learning, safety, weaponization risks, human-robot collaboration, and the broad, math-heavy education needed for future roboticists.
Get the full analysis with uListen AI
What educational models best prepare future roboticists to balance deep mathematical foundations, hands-on building, and ethical responsibility?
Get the full analysis with uListen AI
Transcript Preview
The following is a conversation with Vijay Kumar. He's one of the top roboticists in the world, a professor at the University of Pennsylvania, a dean of Penn Engineering, former director of GRASP Lab, or the General Robotics Automation Sensing and Perception Laboratory at Penn that was established back in 1979. That's 40 years ago. Vijay is perhaps best known for his work in multi-robot systems, robot swarms, and micro aerial vehicles, robots that elegantly cooperate in flight under all the uncertainty and challenges that the real-world conditions present. This is the Artificial Intelligence Podcast. If you enjoy it, subscribe on YouTube, give it five stars on iTunes, support it on Patreon, or simply connect with me on Twitter at Lex Fridman, spelled F-R-I-D-M-A-N. And now, here's my conversation with Vijay Kumar. What is the first robot you've ever built or were a part of building?
Way back when I was in graduate school, I was part of a fairly big project that involved building a very large hexapod. This weighed close to 7,000 pounds, and it was powered by hydraulic actuation, or was actuated by hydraulics with 18 motors, hydraulic motors, each controlled by an Intel 8085, uh, processor and an Inte- 8086 co-processor. And so imagine this huge, uh, monster that had 18 joints, each controlled by an independent computer, and there was a 19th computer that actually did the coordination between these 18 joints. So I was part of this project and my thesis work was how do you coordinate the 18 legs, and in particular, the-the pressures in the hydraulic cylinders to get efficient locomotion.
It sounds like a giant mess. So how difficult is it to make all the motors communicate? Presumably, you have to send signals hundreds of times a second, or at least-
Yeah, so this was not my work, but the-the folks who worked on this wrote what I believe to be the first multiprocessor operating system. This was-
Mm-hmm.
... in the '80s. And you have to make sure that, uh, obviously messages got across from one joint to another. You have to remember, the-the clock speeds on those computers were about half a megahertz.
(laughs) Right.
So.
The '80s. So not to romanticize the notion, but how did it make you feel to make-to see that robot move?
It was amazing. In hindsight, it looks like, well, we built this thing which really should have been much smaller. And of course, today's robots are much smaller. You look at, you know, Boston Dynamics or Ghost Robotics, a spinoff from-from Penn. But back then, you were stuck with the substrate you had, the compute you had, so things were unnecessarily big. But at the same time, uh, and this is just human psychology, somehow bigger means grander. You know, people never have the same appreciation for nanotechnology or nano devices as they do for the space shuttle or the Boeing 747.
Install uListen to search the full transcript and get AI-powered insights
Get Full TranscriptGet more from every podcast
AI summaries, searchable transcripts, and fact-checking. Free forever.
Add to Chrome