By playing, you agree to uListen's Terms and Privacy Policy and YouTube's Terms of Service.
Lex Fridman PodcastNeil Gershenfeld: Self-Replicating Robots and the Future of Fabrication | Lex Fridman Podcast #380
Summaries, chapters, transcripts, and FAQs on this page are made by uListen, not YouTube.
Partial transcript
75 min read · 15,001 wordsIntroduction
Neil Gershenfeld 0:00 The ribosome, who I mentioned a little while back, can make an elephant one molecule at a time.
Lex Fridman 0:04 Mm-hmm.
Neil Gershenfeld 0:05 Ribosomes are slow. They run at about one molecule a second, but ribosomes make ribosomes, so you have trillions (laughs) of them and that makes an elephant. In the same way, these little assembly robots I'm describing can make giant structures, at heart because a r- the robot can make the robot. (laughs) So more recently, two of my students, Amira and Miana, had a Nature Communication paper showing how this robot can be made out of the parts it's making, so the robots can make the robots, so you build up the capacity of robotic assembly.
Lex Fridman 0:40 The following is a conversation with Neil Gershenfeld, the director of MIT's Center for Bits and Atoms, an amazing laboratory that is breaking down boundaries between the digital and physical worlds, fabricating objects and machines at all scales of reality, including robots and automata that can build copies of themselves and self-assemble into complex structures. His work inspires millions across the world as part of the maker movement to build cool stuff, to create, the very act that makes life so beautiful and fun. This is the Lex Fridman Podcast. To support it, please check out our sponsors in the description, and now, dear friends, here's Neil Gershenfeld.
What Turing got wrong
Lex Fridman 1:29 You have spent your life working at the boundary between bits and atoms, uh, so the digital and the physical. What have you learned about engineering and about nature of reality from, uh, working at this divide, trying to bridge this divide?
Neil Gershenfeld 1:45 I learned why von Neumann and Turing made fundamental mistakes.
Lex Fridman 1:50 (laughs) That's good stuff.
Neil Gershenfeld 1:52 Um, I learned the secret of life.
Lex Fridman 1:55 Yeah.
Neil Gershenfeld 1:56 Um, I- I- I learned how to ss-solve many of the world's most important problems, which all sound presumptuous, but all of those are things I learned at that boundary.
Lex Fridman 2:05 Okay, so, uh, Turing and von Neumann, let's start there.
Neil Gershenfeld 2:07 Okay.
Lex Fridman 2:07 Some of the most impactful, important humans who have ever lived in computing. Why were they wrong?
Neil Gershenfeld 2:12 So I worked with, uh, Andy Gleason, who was Turing's counterpart. So ju- just for background if anybody doesn't know, Turing is credited with the modern architecture of computing, among, uh, many other things. Uh, Andy Gleason was his US counterpart, and you might not have heard of Andy Gleason, but you might have heard of the Hilbert problems and Andy Gleason solved the fifth one, so he was a really notable mathematician. Uh, during the war, he was Turing's counterpart. Then von Neumann is credited with the modern architecture of computing and one of his students was Marvin Minsky, so I could ask Marvin what Johnny was thinking and I could ask Andy what Alan was thinking. And w- what came out from that, what I came to appreciate... As background, I never understood the difference between computer science and physical science.
Lex Fridman 3:01 Mm-hmm.
Neil Gershenfeld 3:01 But Turing's machine that's the foundation of modern computing has a simple physics mistake, which is the head is distinct from the tape. So in the Turing machine, there's a head that programmatically moves and reads and writes the tape. The head is distinct from the tape, which means persistence of information is separate from interaction with information.
Lex Fridman 3:25 Yeah.
Neil Gershenfeld 3:26 Then von Neumann wrote deeply and beautifully about many things, but not computing. He wrote a horrible men- memo called the First Draft of a Report on the EDVAC, which is how you program a very early computer. In it, he essentially s- roughly took Turing's architecture and built it into a machine. So the legacy of that is the computer somebody's using to watch this is spending much of its effort moving information from storage transis- transistors to processing transistors even though they have the same computational complexity. So in computer science, when you learn about computing, there's a ridiculous taxonomy of about a hundred different models of computation, but they're all fictions. In physics, a patch of space occupies space, it stores state, it takes time to transit, and you can interact. Th- that is the only model of computation that's physical. Everything else is a fiction. So I- I really came to appreciate that a few years back when I did a keynote for the annual meeting of the supercomputer industry, and then went into the halls and spent time with the supercomputer builders and came to appreciate... Oh, th- the, the, the... Let's see, if you're familiar with the movie The Metropolis-
Lex Fridman 4:49 Mm-hmm.
Neil Gershenfeld 4:49 Uh, people would frolic upstairs in the gardens and down in the basement people would move levers.
Lex Fridman 4:54 Yes.
Neil Gershenfeld 4:54 And that's how computing exists today, that we pretend software is not physical, it's separate from hardware, and the whole canon of computer science is based on this fiction that bits aren't constrained by atoms, but all sorts of scaling issues in computing come from that boundary, but all sorts of opportunities come from that boundary. And so you can trace it all the way back to Turing's machine making this mistake between the head and the tape. Von Neumann in- in... Um, crea- he never called it von Neumann's architecture. He wrote about it in this dreadful memo and then he wrote beautifully about other things we'll talk about.
Lex Fridman 5:32 Mm-hmm.
Neil Gershenfeld 5:32 Now to end a long answer, Turing and von Neumann both knew this, so all of the canon of computer scientists credits them for what was never meant to be a computer architecture. Both Turing and von Neumann ended their life studying exactly how software becomes hardware. So von Neumann studied self-reproducing automata, how a machine communicates its own construction. Uh, Turing studied morphogenesis, how genes give rise to form. They ended their life studying the embodiment of computation, something that's been forgotten by the canon of computing, but developed sort of off to the sides by a really interesting lineage.
Lex Fridman 6:12 So, there's no distinction between the head and the tape, between the computer and the computation. It is all computation.
Neil Gershenfeld 6:19 R-r-right. So I never understood the difference between computer science and physical science. And w-working at that boundary helped lead to things, like my lab was part of doing, with a number of interesting collaborators, the first faster-than-classical quantum, uh, computations. Uh, we were part of a collaboration creating the minimal synthetic organism where you design life in a computer.
Lex Fridman 6:42 Mm-hmm.
Neil Gershenfeld 6:42 Those both involve domains where you just can't separate hardware from software. The embodiment of com- you know, computation is embodied in these really profound ways.
MIT Center for Bits and Atoms
Lex Fridman 6:54 So the first quantum computations, synthetic life, so in the space of biology, the space of physics, at the lowest level, and the space of biology at the lowest level. So, uh, let's talk about, uh, CBA, Center of Bits and Atoms. What's the origin story of this MIT, legendary MIT center that you were, uh, a part of creating?
Neil Gershenfeld 7:16 In high school, I really wanted to go to vocational school where you learn to weld and fix cars and build houses. And I was told, "No, you're smart. You have to sit in a room."
Lex Fridman 7:26 Mm-hmm.
Neil Gershenfeld 7:27 And nobody could explain to me why I couldn't go to vocational school. Uh, I then worked at Bell Labs, this wonderful place, uh, before deregulation, legendary place.
Lex Fridman 7:39 Mm-hmm.
Neil Gershenfeld 7:39 And I would get union grievances because I would go into the workshop and try to make something, and they would say, "No, you're smart. You have to tell somebody what to do." And it wasn't until MIT, and I'll explain how CBA started, but I could create CBA, that I came to understand this is a mistake that dates back to the Renaissance. So in the Renaissance, the liberal arts emerged, and liberal doesn't mean politically liberal. This was the path to liberation, birth of humanism. And so the liberal arts were the trivium, quadrivium, roughly language, natural science, and th- at that moment, what emerged was this d- dreadful concept of the illiberal arts.
Lex Fridman 8:20 Mm-hmm.
Neil Gershenfeld 8:20 So anything that wasn't the liberal arts was for commercial gain and was just making stuff and wasn't valid for serious study. And so that's why we're left with learning to weld wasn't a subject for serious study. Um, but the means of expression have changed since the Renaissance, so micromachining or- or embedded coding is every bit ex- expressive as painting a painting or writing a sonnet. So, uh, never understanding this difference between computer science and physical science, uh, th- the path that led me to create CBA with colleagues was I was what's called a junior fellow at Harvard. I was visiting MIT through Marvin because I was interested in the physics of musical instruments.
Lex Fridman 9:06 Mm-hmm.
Neil Gershenfeld 9:07 I, uh, this will be another slight digression. I, uh, in Cornell, I would study physics, and- and then I would cross the street and go to the music department where I played the bassoon and I would trim reeds and play the reeds.
Lex Fridman 9:19 Right.
Neil Gershenfeld 9:19 And they'd be beautiful, but then they'd get soggy. And then I discovered in the basement of the music department at Cornell was David Borden, uh, who you might not have heard of, but is legendary in electronic music because he was really the first electronic musician. So Bob Moog, who invented, um, Moog synthesizers, was a physics student at Cornell, like me, crossing the street, and eventually he was kicked out and invented electronic music. David Borden was the first musician who created electronic music, so he's legendary for people like Phil Glass and Steve Reich. And so that got me thinking about I would behave as a scientist in the music department, but not in, uh, in the physics department, but not in the music department. It got me thinking about what's the computational capacity of a musical instrument. And through Marvin, he introduced me to Tod Machover at the Media Lab who was just about to start a project with Yo-Yo Ma to, um, that led to a collaboration, uh, to instrument a cello, to- to extract Yo-Yo's data and bring it out into computational environments.
Lex Fridman 10:20 What is the computational capacity of a musical instrument? Uh, uh, as we continue on this tangent and when we shall return to CBA.
Neil Gershenfeld 10:26 Yeah. So o- one part of that is to understand the computing. And if you look at, like, the finest time scale and length scale you need to model the physics, it- it's not heroic. You know, a- a- a good GPU can do teraflops today. That- that used to be a national class supercomputer. Now it's just a GPU. And that's about, if you take the time scales and length scales relevant for the physics, that's about the scale of the physics computing. For Yo-Yo, what was really driving it was he's completely unsentimental about the Strad. It's not that it makes some magical wiggles in the sound wave. It's, it's performance as a controller, h- how he can manipulate it as an interface device.
Lex Fridman 11:09 Interface between what and what exactly?
Neil Gershenfeld 11:11 H- h- him and sound.
Lex Fridman 11:12 Okay, him and sound.
Neil Gershenfeld 11:13 And so- so what it led to was l- I had started by thinking about ops per second, but Yo-Yo's question was really, um, resolution and bandwidth. It's, um, how fast can you measure what he does and, um, uh, the- the- the bandwidth and the resolution of detecting his controls and then mapping them into sounds.
Lex Fridman 11:37 Mm-hmm.
Neil Gershenfeld 11:38 And wha- what we found, what he found was if you instrument everything he does and connect it to almost anything, it sounds like Yo-Yo, that- that- that the magic is in the control, not in ineffable details in how the wood wiggles. And so with- with Yo-Yo and Tod, that led to a piece, and towards the end, I asked Yo-Yo what- what it would take for him to get rid of his Strad and use our stuff, and his answer was just logistics. It was, at that time, our stuff was like a rack of electronics and lots of cables and some grad students to- to make it work. Once the technology becomes as invisible as the Strad...... that, then sure, absolutely, h- he would take it. And by the way, as a footnote on the footnote, an accident in the sensing of Yo-Yo's cello led to $100 million a year auto safety business to control airbags in cars.
Lex Fridman 12:29 How did that work?
Neil Gershenfeld 12:31 I had to instrument the bow without interfering with it. So I, um, set up, um, local electromagnetic fields-
Lex Fridman 12:37 Mm-hmm.
Neil Gershenfeld 12:38 ... where I would, um, detect, um, how those fields interact with the bow he's playing. But we had a problem that his hand, whe- whenever his hand got near these sensing fields, I would start sensing his hand rather than the materials on the bow.
Lex Fridman 12:53 Nice.
Neil Gershenfeld 12:53 And I didn't quite understand what was going on with those, that, that interference. So my very first grad student ever, uh, Josh Smith, uh, did a thesis on tomography with electric fields, how to see in 3D with electric fields. Then through Todd and a, at that point a research scientist in my lab, Joe Paradiso, it led to a collaboration with, uh, Penn & Teller who, um, where we did a magic trick in Las Vegas to contact Houdini. And sort of these fields are sort of like, you know, contacting spirits.
Lex Fridman 13:27 Mm-hmm.
Neil Gershenfeld 13:28 So we did a magic trick in Las Vegas and then the, the crazy thing that happened after that was, uh, Phil Rittmueller, um, came running into my lab. He worked with, um, this became with Honda and NEC, airbags were killing infants in rear-facing child seats. Um, cars need to distinguish, uh, a front-facing adult where you'd save the life versus a bag of groceries where you don't need to fire the airbag versus a rear-facing infant where you would kill it. And so the, the, the seat needed to, in effect, see in 3D to understand the occupants. And so we took the Penn & Teller magic trick derived from Josh's thesis from Yo-Yo's cello to an auto show and all the car companies said, "Great. Where, when can we buy it?" And so that became Elesis, a hu- and it was $100 million a year business making sensors. There wasn't a lot of publicity because it was in the car so the car didn't kill you. So they didn't sort of advertise, "We have nice sensors so the car doesn't kill you."
Lex Fridman 14:26 Yeah.
Neil Gershenfeld 14:26 But it became a leading auto safety sensor.
Lex Fridman 14:28 And that started from the cello and the question of the computational capacity-
Neil Gershenfeld 14:33 Right.
Lex Fridman 14:33 ... of a musical instrument?
Neil Gershenfeld 14:34 Right. So now to get back to MIT, uh, I was spending a lot of outside time at IBM Research that had gods of the foundations of computing.
Lex Fridman 14:45 (laughs) Yeah.
Neil Gershenfeld 14:45 Um, there's just amazing people there. And I'd always expected to go to IBM to take over a lab, but at the last minute pivoted and, um, came to MIT to s- um, take a position in the M- Media Lab, um, and start what became the predecessor to CBA. M- Media Lab is well-known for Nicholas Negroponte. Uh, what's less well-known is the role of Jerry Wiesner. So Jerry was MIT's president, before that Kennedy's science advisor, grand old man of science.
Lex Fridman 15:19 Mm-hmm.
Neil Gershenfeld 15:20 At the end of his life, he was frustrated by how knowledge was segregated and so he wanted to create a department of none of the above, (laughs)
Lex Fridman 15:29 Mm-hmm.
Neil Gershenfeld 15:30 a department for work that didn't fit in departments. And the Media Lab, in a sense, was a cover story for him to hide a department. (laughs) It, it, as MIT's president towards the end of his tenure, if he said, "I'm gonna make a department for things that don't fit in departments," the departments would have screamed. But everybody was sort of paying attention to Nicholas creating the Media Lab and Jerry kind of hid in it, in it a department called Media Arts and Sciences. It's really the department of none of the above.
Lex Fridman 15:57 Mm-hmm.
Neil Gershenfeld 15:58 And Jerry explaining that and Nicholas then confirming it is really why I pivoted and went to MIT, um, because my students who cre- help create quantum computing or synthetic life get degrees from Media Arts and Sciences, this department of, uh, none of the above. So that led to coming to MIT-
Lex Fridman 16:16 Yeah.
Neil Gershenfeld 16:17 ... with, um, uh, Todd and Joe Paradiso and Mike Hawley. We started a consortium called Things That Think, and this was around the birth of Internet of Things-
Lex Fridman 16:27 Mm-hmm.
Neil Gershenfeld 16:27 ... and, um, RFID. But then we started doing things like work we can discuss that became the beginnings of quantum computing and cryptography and materials and logic and microfluidics. And those needed, uh, much more significant infrastructure and were much longer research arcs. So with a bigger team of about 20 people, we wrote a proposal to the NSF to assemble one of every tool to make anything of any size, was roughly the proposal.
Lex Fridman 16:57 One of any tool to make anything of any size?
Neil Gershenfeld 17:01 Yeah.
Lex Fridman 17:02 (laughs)
Neil Gershenfeld 17:02 So they're... Usually nanometers, micrometers, millimeters, meters are segregated. Input and output is segregated. Um, we wanted to look just very literally at how digital becomes physical and physical becomes digital.
Lex Fridman 17:16 Mm-hmm.
Neil Gershenfeld 17:17 And fortunately, we got NSF on a good day and they funded this facility of one of almost every tool to make anything.
Lex Fridman 17:26 Mm-hmm.
Neil Gershenfeld 17:27 And so, uh, with, um, a group of core colleagues, um, that included Joe Jacobson, Ike Chuang, Scott Manalis, um, we launched CBA.
Lex Fridman 17:39 And so you're talking about nanoscale, microscale, nanostructures, microstructures, macrostructures, electron microscopes with focused ion beam probes for nanostructures, laser micromachining, and x-ray microtomography for microstructures, multi-access machining and 3D printing for macrostructures is just some examples. What are we talking about in terms of scale? How can we build tiny things and big things all in one place?
Neil Gershenfeld 18:04 Yeah, so-
Lex Fridman 18:05 How's that possible?
Neil Gershenfeld 18:05 ... a, a well-equipped research lab has this sort of tools we're talking about-
Lex Fridman 18:09 Yeah.
Neil Gershenfeld 18:09 ... but they're segregated in different places. They're typically also run by technicians where you then have an account and a project and you charge. All of these tools are essentially...... when you don't know what you're doing, not when you do know what you're doing. In that they're- they're when you need to work across length scales where we don't, uh... Once projects are running, uh, in this facility, we don't charge for time, you don't make a formal proposal to schedule and the users really run the tools and it's for work that's kind of inchoate that needs to span these disciplines and length scales. Um, and so you... Uh, work in the project today, work in CBA today ranges from developing zeptojoule electronics for the lowest power computing to micromachining diamond to take million- 10 million RPM bearings for molecular spectroscopy studies, up to exploring robots to build 100-meter structures in space.
Lex Fridman 19:12 Okay. Can we... The three things you just mentioned-
Neil Gershenfeld 19:15 Yeah.
Lex Fridman 19:15 Let's start with the biggest. What are some of the biggest stuff you attempted to explore how to build in a lab?
Neil Gershenfeld 19:22 Sure. So viewed from one direction, what we're talking about is a crazy random seeming of almost unrelated projects.
Lex Fridman 19:32 Mm-hmm.
Neil Gershenfeld 19:32 But if you rotate 90 degrees, it's really just a core thought over and over again, just very literally how bits and atoms relate, how digital and, just going from digital to physical, um, in many different domains but it's really just the same idea over and over again. So to understand the biggest things, uh, let me go back to, uh, uh, bring in now Shannon as well as, uh, von Neumann.
Lex Fridman 19:59 Claude Shannon.
Digital logic
Neil Gershenfeld 20:00 Yeah. So what is digital? Uh, the casual obvious answer is digital in one and zero-
Lex Fridman 20:08 Mm-hmm.
Neil Gershenfeld 20:08 ... but that's wrong. There's a much deeper answer which is Claude Shannon at MIT wrote the best master's thesis ever.
Lex Fridman 20:18 Mm-hmm.
Neil Gershenfeld 20:18 In his master's thesis, he invented our modern notion of digital logic. Where it came from was, uh, Vannevar Bush, uh, was a grand old man at MIT. Uh, he created the post-war research establishment that led to the National Science Foundation and he made an important mistake which we can talk about. But he also made the la- the differential analyzer which was the last great analog computer. So it was a room full of gears and pulleys and the longer it ran, the worse the answer was.
Lex Fridman 20:49 (laughs)
Neil Gershenfeld 20:49 And Shannon-
Lex Fridman 20:50 Yeah.
Neil Gershenfeld 20:51 ... worked on it as a student and he got so annoyed, in his master's thesis he invented digital logic.
Lex Fridman 20:56 Mm-hmm.
Neil Gershenfeld 20:57 Um, but he then went on to Bell Labs and what he did there was communication was beginning to expand, there was more demand for phone lines and so there's a question about h- how much, how many phone lines you could, phone messages you could send down a wire and you could try to just make it better and better. He asked a question nobody had asked which is rather than make it better and better, what's the limit to how good it can be?
Lex Fridman 21:23 Mm-hmm.
Neil Gershenfeld 21:23 And, uh, he proved a couple of things but one of the main things he proved was a threshold theorem for channel capacity. And so what he showed was my voice to you right now is coming as a wave through sound-
Lex Fridman 21:38 Mm-hmm.
Neil Gershenfeld 21:38 ... and the further you get, the worse it sounds. But people watching this are getting it as, uh, as inf- packets of data in a network. Um, when they get... When the computer they're watching this gets the packet of information, um, it- it can detect and correct an error. And what Shannon showed is if the noise in- in the cable to the people watching this is above a threshold, they're doomed. But if the noise is below a threshold for a linear increase in the energy representing our conversation, the error rate goes down exponentially. Exponentials are fast, there's very few of them in engineering, and the exponential reduction of error below a threshold if you restore state is called a threshold theorem.
Lex Fridman 22:27 Mm-hmm.
Neil Gershenfeld 22:27 That's what led to digital. That- that means unreliable things can work reliably. So Shannon did that for communication. Then von Neumann was inspired by that and applied it to computation and he showed how an unreliable computer can operate reliably by using the same threshold property of restoring state. It was then forgotten many years. We had to rediscover it in effect in the quantum computing era when things are very unreliable again.
Lex Fridman 22:54 Mm-hmm.
Neil Gershenfeld 22:55 Um, but now to go back to how does this relate to the biggest things I've made? So in fabrication, MIT invented computer-controlled manufacturing in 1952.
Lex Fridman 23:09 Mm-hmm.
Neil Gershenfeld 23:09 Uh, jet aircraft were just emerging. There is a limit to turning cranks on a machine, on a milling machine, to make parts for jet aircraft. Now this is a messy story. MIT actually stole computer-controlled machining from an inventor who brought it to MIT-
Lex Fridman 23:25 Uh-oh.
Neil Gershenfeld 23:25 ... wanted to do a joint project with the Air Force and MIT effectively stole it from him. So it's kind of a messy history. But that sounds like the birth of computer-controlled machining, 1952. Um, there are a number of inventors of 3D printing. One of the companies spun off from my lab by Max Lobovsky is Formlabs, which is now a-
Lex Fridman 23:46 Mm-hmm.
Neil Gershenfeld 23:47 ... billion-dollar 3D printing company. That's the modern version. But all of that's analog, meaning the information is in the control computer, there's no information in the materials. And so it goes back to Vannevar Bush's analog computer. If you mista- make a mistake in printing or machining, just the mistake accumulates. The real birth of computerized digital manufacturing is four billion years ago. That's the evolutionary age of the ribosome. So the way you're manufactured-
Lex Fridman 24:20 Mm-hmm.
Neil Gershenfeld 24:21 ... is there's a code that describes you, the genetic code. It- it goes to a- a micromachine, the ribosome, which is this molecular factory that builds the, um, molecules that- that are you.The key thing to know about that is it, there are about 20 amino acids that get assembled.
Lex Fridman 24:43 Mm-hmm.
Neil Gershenfeld 24:43 And in that machinery, it does everything Shannon and von Neumann taught us. You detect and correct errors. So if you mix chemicals, the error rate is about a part in 100. When you make, elongate a protein in the ribosome, it's about a part in 10 to the 4. When you replicate DNA, there's an extra level of error correction. It's a part in 10 to the 8. And so in the molecules that make you, you can detect and correct errors, and you don't need a ruler to make you. The geometry comes from your parts. So now, compare a child playing with Lego and a state-of-the-art 3D printer or computerized milling machine. Uh, the tower made by a child is more accurate than their motor control because the act of snapping the bricks together...
Lex Fridman 25:31 Mm-hmm.
Neil Gershenfeld 25:31 ... gives you a constraint on the joints. Um, you can join bricks made out of dissimilar materials. You don't need a ruler for Lego 'cause the geometry locally gives you the global parts.
Lex Fridman 25:42 Mm-hmm.
Neil Gershenfeld 25:43 And there's no Lego trash. The parts have enough information to disassemble them.
Lex Fridman 25:47 Mm-hmm.
Neil Gershenfeld 25:47 Those are exactly the properties of a digital code.
Lex Fridman 25:52 The unreliable is made reliable.
Neil Gershenfeld 25:54 Yes, absolutely. So, um, what the ribosome figured out four billion years ago is how to embody these prob- these digital properties, but not for communication or computation, in effect, but for construction. So, um, a number of projects in my lab have been studying the idea of digital materials. And think of a digital material just as Lego bricks. What w- the precise meaning is a degreet set, discrete set of parts reversibly joined, um, with global geometry determined from local constraints.
Lex Fridman 26:30 Mm-hmm.
Neil Gershenfeld 26:30 And so it's digitizing the materials. And so I'm coming back to what are the biggest things I've made.
Self-assembling robots
Neil Gershenfeld 26:36 My lab was working with the aerospace industry. So Spirit Aero was Boeing's factories. Uh, they asked us for how to join composites. When you make a composite airplane, you make these giant wing and fuselage parts, and they asked us for a better way to stick them together.
Lex Fridman 26:51 Mm-hmm.
Neil Gershenfeld 26:52 'Cause the joints were a place of failure. And what we discovered was instead of making a few big parts, if you make little loops of carbon fiber, and you reversibly link them in joints, and you do it in a special geometry that balances being under-constrained and over-constrained with just the right degrees of freedom, um, we set the world record for the highest modulus ultralight material just by ef- in effect, making carbon fiber Lego.
Lex Fridman 27:24 (laughs) .
Neil Gershenfeld 27:24 So the, uh, so lightweight materials are crucial for energy efficiency. This let us make, make the, the lightest weight high modulus material. We then showed that with just, just a few part types, we can tune the material properties, and then you can create really wild robots that instead of having a tool the size of a jumbo jet to make a jumbo jet, you can make little robots that walk on these cellular structures to build the structures, where they error correct their position on the structure and they navigate on the structure. And so using all of that, uh, with, um, NASA, we made morphing airplanes. Um, a, a former student, Kenny Cheung and Ben Jeannette made a morphing airplane the size of NASA Langley's biggest wind tunnel. Um, with Toyota, we've made super-efficiency race cars. We're right now looking at projects with NASA to build these for things like space telescopes and space habitats, where the ribosome, who I mentioned a little while back, can make an elephant one molecule at a time.
Lex Fridman 28:27 Mm-hmm.
Neil Gershenfeld 28:28 Ribosomes are slow. They run at about one molecule a second, but ribosomes make ribosomes. So you have thousands of them, uh, trillions of them, and that makes an elephant. In the same way, these little assembly robots I'm describing can make giant structures, uh, at heart because a, the robot can make the robot. So more recently, two of my students, Samira and Miana, had a Nature Communication paper showing how this robot can be made out of the parts it's making. So the robots can make the robots. So you build up the capacity of robotic assembly.
Lex Fridman 29:02 A self- it can self-replicate. Can you linger on what that robot looks like? What is a robot that can walk along and do error correction, and what is a robot that can self-replicate, uh, from the materials it is given? What does that look like? What are we talking about?
Neil Gershenfeld 29:16 So, um...
Lex Fridman 29:17 This is fascinating.
Neil Gershenfeld 29:17 Yeah. Th- the answer is di- different at different length scales. S- so, to explain that, uh, in biology, primary structure is the code in the messenger RNA that says what the ribosome should build.
Lex Fridman 29:30 Yeah.
Neil Gershenfeld 29:30 Um, secondary structure are geometrical motifs. They're things like helices or sheets.
Lex Fridman 29:35 Mm-hmm.
Neil Gershenfeld 29:35 Tertiary structures are functional elements, like electron donors or acceptors. Quaternary structure is things like, um, molecular motors that are moving my mouth or making the synapses work in my brain. So there's that hierarchy of primary, secondary, tertiary, quaternary. Now what's interesting is if you want to buy electronics today from a vendor, there are hundreds of thousands of types of resistors or capacitors or transistors, huge inventory. All of biology is just made from this inventory of 20 parts, the amino acids.
Lex Fridman 30:11 Mm-hmm.
Neil Gershenfeld 30:11 And by composing them, you can create all of life. And so, uh, as part of this digitization of materials, we're in effect trying to create something like amino acids for engineering, creating all of technology from 20 parts. I, um, I, l- see, uh, as another digression, I helped start an office for science in Hollywood, and, um, there was a fun thing for the movie The Martian where-... I did a program with Bill Nye and a few others on how to actually build a civilization on Mars that they described in a way that I like, as I was talking about how to go to Mars without luggage.
Lex Fridman 30:49 (laughs) Yeah.
Neil Gershenfeld 30:49 And the, at heart, it's sort of how to create life in non-living materials. So if- if you think about this primary, secondary, tertiary, quaternary structure, um, in my lab, we're doing that, but on different length scales for different purposes. So we're making micro-bots out of, like, nano bricks. And to make the robots to build large scale structures in space, the elements of the robots now are centimeters rather than, um, micrometers. And so the assembly robots for the bigger structures are, uh, they are the cells that make up the structure, but then we have functional cells. And so cells that can process and actuate. Each- each cell can, like, move one degree of freedom, or attach or dis- detach or, um, process. Now, those elements I just described, we can make out of the still smaller parts. So eventually there's a hierarchy of the little parts make little robots that make bigger parts of bigger robots that, up- up through that hierarchy.
Lex Fridman 31:52 And- and that way you can move up the length scale.
Neil Gershenfeld 31:54 Right. Early on, I tried to go in a straight line from the bottom to the top, and that ended up being a bad idea. Instead, we're kind of doing all of these in parallel, and then they're growing together. And so to make the larger scale structures, we, um, like there's a lot of hype right now about 3D printing houses, where you have a printer the size of the house.
Lex Fridman 32:13 (laughs)
Neil Gershenfeld 32:13 We're right now working on using swarms of these, you know, uh, table scale robots that walk on the structures to place the parts, um, much more efficiently.
Lex Fridman 32:22 That's amazing. But you're saying you can't, for now, go from the very small to the very large.
Neil Gershenfeld 32:27 Th- that'll come. Um, that- that'll come in stages.
Lex Fridman 32:30 Can we just linger on this idea? Starting from von Neumann's, uh, self-replicating automata that you mentioned, it's just a beautiful idea.
Neil Gershenfeld 32:39 So that's at the heart of all of this, in the stack I described. So one student, Will Langford, made these micro-bots out of little parts that then we're using for Miana's bigger robots up through this hierarchy. And it's really realizing this idea of the self-reproducing automata. So von Neumann, when I complained about the von Neumann architecture-
Lex Fridman 33:00 Mm-hmm.
Neil Gershenfeld 33:01 ... it's not fair to von Neumann because he never claimed it as his architecture. He really wrote about it in this one fairly dreadful memo that led to all sorts of lawsuits and fights and, about the early days of computing. He did beautiful work on reliable computation and unreliable devices. And towards the end of his life, what he studied was how, and- and I have to say this precisely, how a computation communicates its own construction.
Lex Fridman 33:27 Yeah.
Neil Gershenfeld 33:28 So-
Lex Fridman 33:28 So beautiful.
Neil Gershenfeld 33:29 So a computation can store a description of how to build itself. But now there's a really s- hard problem which is ho- if you have that, i- in your mind, how do you transfer it and wake up a thing that then can contain it?
Lex Fridman 33:49 Mm-hmm.
Neil Gershenfeld 33:50 Um, so how do you give birth to a thing that knows how to make itself?
Lex Fridman 33:53 Mm-hmm.
Neil Gershenfeld 33:53 And so, um, with Stan Ulam, he invented cellular automata as a way to simulate these.
Lex Fridman 34:00 Mm-hmm.
Neil Gershenfeld 34:01 Uh, but that was theoretical. Um, now the work I'm describing in my lab is- is fundamentally how to realize it, how to rea- um, realize self-reproducing, uh, automata. And so, you know, this is something von Neumann thought very deeply and very beautiful of, beautifully about theoretically. And it's right at this intersection. It- it's not communication or computation or fabrication. It's right at this intersection where communication and computation meets fabrication. Now, the reason self-reproducing automata intellectually is so important, 'cause this is the foundation of life, this is really just understanding the essence of how to life- And in effect, we're trying to create life in non-living material. The reason it's so important technologically is because that's how you scale capacity. That's how you can make an elephant from a ribosome, 'cause the ele- uh, uh, assemblers make assemblers.
Lex Fridman 34:56 So simple building blocks-
Neil Gershenfeld 34:58 Yeah.
Lex Fridman 34:58 ... that inside themselves contain the information how to build more building blocks-
Neil Gershenfeld 35:03 Right.
Lex Fridman 35:03 ... and-
Neil Gershenfeld 35:03 So-
Lex Fridman 35:04 ... uh, between each other construct arbitrarily complex objects.
Neil Gershenfeld 35:07 Right. Now, let me give you the numbers. So let me relate this to right now we're living in AI mania explosion time. Let me relate that to what we're talking about.
Lex Fridman 35:18 Mm-hmm.
Neil Gershenfeld 35:19 100 petaflop computer, which is a current generation, uh, supercomputer, uh, not quite the biggest ones, uh, does ten to the 17 ops per second. Um, your brain does ten to the 17 ops per second. It does about ten to the 15 synapses and they run at about 100 hertz. So as of a year or two ago, the compu- th- the performance of a big computer matched the brain. So you could view AI as a breakthrough, but the real story is, um, within about a year or two ago, ju- un- let's see. Th- that- the supercomputer has about ten to the 15 transistors in the processors, ten to the 15 transistors in the memory, which is the synapses in your brain. So the real breakthrough was the computers match the computational capacity of a brain. And so we'd be sort of derelict if they couldn't do about the same thing. But now the reason I'm mentioning that is the chip fab making the supercomputer is placing about ten to the 10 transistors a second.
Lex Fridman 36:26 Mm-hmm.
Neil Gershenfeld 36:27 Um, while you're digesting your lunch right now, you're ma- you're placing about ten to the 18 parts per second.
Lex Fridman 36:33 Mm-hmm.
Neil Gershenfeld 36:34 Um, there's an eight order of magnitude difference, not, so in computational capacity, it's done, we've caught up. But there's eight orders of magnitude difference in the rate at which biology can build versus state-of-the-art manufacturing can build-And that distinction is what we're talking about. That distinction is not analogue, but this deep sense of digital fabrication, of embodying codes in construction. So a description doesn't describe a thing, but the- the description becomes
Digital fabrication
Neil Gershenfeld 37:04 the thing.
Lex Fridman 37:04 So you're saying, I mean, this is one of the cases you're making and, uh, that this is this third revolution. We've seen the Moore's Law in communication, we've seen the Moore's Law-like type of growth-
Neil Gershenfeld 37:15 Right.
Lex Fridman 37:15 ... in, uh, computation. And you're anticipating we're going to see that in digital fabrication. Can you actually, first of all, describe what you mean by this te- term, digital fabrication?
Neil Gershenfeld 37:26 So the casual meaning is a computer controls a tour- tool to make something.
Lex Fridman 37:31 Uh-huh.
Neil Gershenfeld 37:31 And that was invented when MIT stole it in 1952. (laughs)
Lex Fridman 37:35 Yeah.
Neil Gershenfeld 37:36 Um, there's the deep meaning of what the ribosome does, of a computa- uh, uh, uh, of- of a des- a, a digital description doesn't describe a thing, a digital description becomes the thing.
Lex Fridman 37:47 Yeah.
Neil Gershenfeld 37:48 That's where the- that's- that's the path to the Star Trek replicator, and that's the thing that doesn't exist yet. Now, I think the- the best way to understand what this roadmap looks like is to now s- bring in Fab Labs and how they relate to all of this.
Lex Fridman 38:04 What are Fab Labs?
Neil Gershenfeld 38:06 So here- here's the sequence. Uh, um, with colleagues, I accidentally started a network of what's now 2,500 digital fabrication community labs called Fab Labs right now in 125 countries and they double every year and a half. That's called Lass' Law after Sherry Lassiter, who I'll explain. So here's the sequence. Uh, we started Center for Bits and Atoms-
Lex Fridman 38:30 Mm-hmm.
Neil Gershenfeld 38:31 ... to do the kind of research we're talking about. We had all of these machines and then had a problem, it would take a lifetime of classes to learn to use all the machines. So with, you know, colleagues who helped start CBA, we began a class modestly called How to Make Almost Anything.
Lex Fridman 38:48 Yeah.
Neil Gershenfeld 38:48 And there's no big agenda. It was just, it was aimed at a few research students to use the machines and, uh, we were completely unprepared for the first time we taught it. We were swamped by, e- every year since, hundreds of students try to take the class. It's one of the most oversubscribed classes at MIT. Um, students would say things like, you know, "Can you teach this at MIT? It seems too useful." It's just how to work these machines.
Lex Fridman 39:12 Mm-hmm.
Neil Gershenfeld 39:13 And the students in the class, I w- you know, I would teach them all the skills to use all these tools and then they would do projects integrating them and they were amazing. So Kelly was a sculptor, no engineering background. Uh, her project was she made a device that saves up screams when you're mad and plays them back later and-
Lex Fridman 39:31 Uh, saves up screams when you're mad and plays them back later.
Neil Gershenfeld 39:34 Right. Y- you scream into this device and it- it- it deadens the sound, records it, and then when it's convenient, releases your scream.
Lex Fridman 39:40 Can we just- just, like, pause on the brilliance of that invention, creation, the art, I don't know, the brilliance? Who is this that created this?
Neil Gershenfeld 39:50 Kelly Dobson.
Lex Fridman 39:51 Kelly Dobson.
Neil Gershenfeld 39:52 Gone on to do a number of interesting things. Uh, Mijin, who's gone on to do a number of interesting things, uh, made a dress instrumented with sensors and spines and when somebody creepy comes close, it would defend your personal space.
Lex Fridman 40:02 Which are also very useful.
Neil Gershenfeld 40:03 Um, uh, uh, another project early on was a web browser for parrots which have the cognitive ability of a young child and lets parrots surf the internet, you know? Another w- another was an arm clock- an alarm clock you wrestle with and prove you're awake.
Lex Fridman 40:16 Mm-hmm.
Neil Gershenfeld 40:17 And what connects all of these is... So MIT made the first real-time computer, the Whirlwind.
Lex Fridman 40:23 Mm-hmm.
Neil Gershenfeld 40:23 That was transistorized as the TX. The TX was spun off from MIT as the PDP. PDPs were the mini computers that created the internet. So outside MIT was DEC, Prime, Wang, Data General, the whole mini computer industry. The whole computing industry was there and it all failed when computing became personal. Ken Olsen, the head of Digital, famously said, "You don't need a computer at home." There's a little background to that, but- but DEC, you know, completely missed computing became personal. So I mention all of that because I was asking how to do digital fabrication, but not really why. The students in this how to make class were showing me that the killer app of digital fabrication is personal fabrication.
Lex Fridman 41:12 Yeah. How do you jump to the personal fabrication?
Neil Gershenfeld 41:14 So Kelly didn't make the screen body because it was for a thesis. She wasn't writing a research paper. It wasn't a business model. She wanted... It was because she wanted one.
Lex Fridman 41:24 Yeah.
Neil Gershenfeld 41:25 It was personal expression going back to me in vocational school, is personal expression in these new means of expression. So that's happened every year since.
Lex Fridman 41:34 It literally is called, the course is literally called How to Make Almost Anything.
Neil Gershenfeld 41:40 Yep.
Lex Fridman 41:40 A legendary course at MIT.
Neil Gershenfeld 41:42 Yep. Yep.
Lex Fridman 41:43 Every year.
Neil Gershenfeld 41:44 Um, and it's grown to multiple labs at, um, at MIT with as many people involved as teaching as taking it. And there's even a Harvard lab for the MIT class.
Lex Fridman 41:53 What- what have you learned about humans colliding with the Fab Lab about what the capacity of humans to be creative and to build?
Neil Gershenfeld 42:02 So I- I- I mentioned Marvin. Another mentor at MIT, sadly no longer living, is Seymour Papert.
Lex Fridman 42:07 Mm-hmm.
Neil Gershenfeld 42:08 So Papert studied with Piaget. He came to MIT to get access to the early comp- uh, Piaget was a pioneer in how kids learn. Um, Papert came to MIT to get access to the early computers with the goal of letting kids play with them. Uh, Piaget helped show kids are like scientists. They- they- they learn as scientists, then it gets kind of throttled out of them. Seymour wanted to let h- kids have a broader landscape to play. Seymour's work led with Mitch Resnick to Lego, Logo, MindStorms, all of that stuff. As Fab Labs spread, um, and we started creating educational programs for kids in them, Seymour said something really interesting. He made a gesture. He said it was a thorn in his side that they invented what's called the Turtle, a robot kids could, early robot kids could program to connect it to a mainframe computer.
Lex Fridman 42:58 Mm-hmm.
Neil Gershenfeld 42:58 Seymour said...... the goal was not for the kids to program the robot, it was for the kids to create the robot. And so in that sense, the Fab Labs, which for me were just this accident, he described as sort of this fulfillment of the arc of kids learn by experimenting, it was to give them the tools to create, n- not just assemble things and program things, b- but actually create. So coming to your question, what I've learned is MIT a f- a few years back, somebody added- added up businesses from- spun off from MIT, and it's the world's 10th economy. It falls between India and Russia. And I view that, in a way, as a bad number because it's only a few thousand people and these aren't uniquely the 4,000 brightest people, it's just a productive environment for them.
Lex Fridman 43:46 Mm-hmm.
Neil Gershenfeld 43:47 And what we found is in rural Indian villages, in African shantytowns, in arctic, um, hamlets, I find exactly, precisely that profile. So, um, Lyngseid had a few hours above Tromsø, way above the Arctic Circles. It's so far north, the satellite dishes look at the ground, not the sky. Um, Hans Christian in the lab was considered a problem in the local school 'cause they couldn't teach him anything. I showed him a few projects. Next time I came back, he was designing and building little robot vehicles. And in, um, uh, South Africa in, I mentioned Shoshangovi, in this apartheid township, the local technical institute taught kids how to make bricks and fold sheets. It was- it was punitive. Um, but Tepiso in the Fab Lab was actually doing all the work of my MIT classes. And so over and over we found precisely the same kind of bright inventive, um, creativity. Uh, and historically, the answer was, "Go- you're smart, go away." It's sort of like me in vocational school. But in this lab network, what we could then do is, in effect, bring the world to them. Now let's look at the scaling of all of this. So there's one Earth, a thousand cities, a million towns, a billion people, a trillion things.
Lex Fridman 45:10 Mm-hmm.
Neil Gershenfeld 45:12 There was one Whirlwind computer, MIT made, uh, the first real-time computer. There were thousands of PDPs, there were millions of hobbyist computers that came from that, uh, billions of personal computers, trillions of Internet of Things.
Lex Fridman 45:26 Mm-hmm.
Neil Gershenfeld 45:27 So now if we look at this Fab Lab story, 1952 was the NC Mill, uh, there are now thousands of Fab Labs, and the Fab Lab costs exactly the same cost and complexity of the minicomputer.
Lex Fridman 45:42 Mm-hmm.
Neil Gershenfeld 45:42 So on the minicomputer, it- it didn't fit in your pocket, it- it filled a room.
Lex Fridman 45:47 Mm-hmm.
Neil Gershenfeld 45:47 But video games, email, word processing, really anything you do, the internet, anything you do with a computer today happened at that era because it got on the scale of a work group, not a corporation.
Lex Fridman 46:00 Mm-hmm.
Neil Gershenfeld 46:01 In the same way, Fab Labs are like the minicomputers inventing how does the world work if anybody can make anything. Then if you look at that scaling, Fab Labs today are transitioning from buying a machine to make- machines making machines. So we're transitioning to you can go to a Fab Lab not to make a project, to make- but to make a new machine. So we talked about the deep sense of self-replication. There's a very practical sense of Fab Lab machines making Fab Lab machines. And so that's the equivalent of the, uh, hobbyist computer era, or what are- what are called the Altair, historically. Then the work we spent a while talking about about assemblers and self-assemblers, that's the equivalent of smartphones and Internet of Things. That's when... So the- the- the assemblers are like the smartphone where a smartphone today has the capacity of what used to be a supercomputer in your pocket.
Lex Fridman 46:57 Mm-hmm.
Neil Gershenfeld 46:58 And then the smart thermostat on your wall has the power of, eh, the original PDP computer-
Lex Fridman 47:07 Mm-hmm.
Neil Gershenfeld 47:07 ... not metaphorically but literally, and now there's trillions of those. In the same sense, the- when we finally merge materials with the machines and the self-assembly, that's like the Internet of Things stage. But here's the important lesson. If you look at the computing analogy, computing expanded exponentially, but it really didn't fundamentally change. The- the core things happened in- i- i- in that transition in the minicomputer era. So in the same sense, the research now, and we spent a while talking about this, how we get to the replicator, today you can do all of that if you close your eyes and view the whole Fab Lab as a machine.
Lex Fridman 47:48 Mm-hmm.
Neil Gershenfeld 47:49 In that room, you can make almost anything, but you need a lot of inputs. Bit by bit, the inputs will go down and the size of the room will go down as we go through each of these stages.
Self-reproducing machine
Lex Fridman 47:59 So how difficult is it to create a self-replicating assembler, self-replicating machine that builds copies of itself or builds a more complicated version of itself, which is kind of the dream towards which you're pushing in a generic arbitrary sense?
Neil Gershenfeld 48:16 I had a student, Nadia Peak with Jonathan Ward, who- who for me started this idea of how do we use the tools in my lab to make the tools in the lab.
Lex Fridman 48:25 Yes.
Neil Gershenfeld 48:26 Uh, in a very clear sense, they are making self-reproducing machines. So one of the really cool things that's happened is there's a whole network of machine builders around the world. So there's Danielle in- now in Germany and Jens in Norway and, um, um, each of these people is- has learned the skills to go into a Fab Lab and make a machine. And so we've started creating a network of super fab... So the Fab Lab can make a machine, but it can't make a number of the precision parts of the machine. So in places like Bhutan or Kerala in the south of India, we started creating super Fab Labs that have more advanced tools to make the parts of the machines so that the machines themselves become even cheaper.... um, that, that is self-reproducing machines, but you need to feed it things like bearings or microcontrollers.
Lex Fridman 49:20 Sure.
Neil Gershenfeld 49:20 They can't make those parts. But other than that, they're making their own things. And I should note as a footnote, the stack I described of computers controlling machines, to machine making machines, to assemblers, to self-assemblers, view that as Fab 1, 2, 3, 4.
Lex Fridman 49:35 Hmm.
Neil Gershenfeld 49:35 So we're transitioning from Fab 1 to Fab 2, and the research in the lab is 3 and 4. At this Fab 2 stage, a big component of this is, uh, sustainability in the material feedstocks. So Alicia, a colleague in Chile, is leading a great effort looking at how you take, um, forest products and coffee grounds and seashells and a range of locally available materials and produce the high-tech materials that go into the lab. So all of that is machine building today. Then back in the lab, what we can do today is we have robots that can build structures and can assemble more robots that build structures. We have finer resolution robots that can build micromechanical systems, so robots that can build robots that can walk and manipulate.
Lex Fridman 50:26 Mm-hmm.
Neil Gershenfeld 50:27 And we're just now, we have a project at the layer below that, where there's endless attention today to billion-dollar chip fab investments.
Lex Fridman 50:36 Mm-hmm.
Neil Gershenfeld 50:37 Uh, but a- (laughs) a really interesting thing we passed through is, today, the smallest transistors you can buy is a single transistor, just commercially for electronics, is actually the size of an early transistor in an integrated circuit. So we're, we're using these machines-making-machines-making-assemblers to place those parts to not use a billion-dollar chip fab to make integrated circuits, but actually assemble little electronic components.
Lex Fridman 51:03 So have, uh, fine enough, precise enough actuators and manipulators-
Neil Gershenfeld 51:08 So-
Lex Fridman 51:08 ... that allow you to place these transistors.
Neil Gershenfeld 51:10 Right. We're, that's a research project in my lab on D- called DICE, on Discrete Assembly of Integrated Electronics. And we're just at the point to really start to take seriously this notion of not having a chip fab make integrated electronics, but having, not a 3D printer, but a thing that's a cross between, a pick-and-place makes circuit boards in 2D.
Lex Fridman 51:31 Yeah.
Neil Gershenfeld 51:32 Um, the 3D printer extrudes in 3D.
Lex Fridman 51:34 Mm-hmm.
Neil Gershenfeld 51:34 We're making sort of a micro-manipulator that acts like a printer, but it's placing to build electronics in 3D. A-
Lex Fridman 51:41 But this micro-manipulator is distributed? So there's a bunch of them or is this one centralized thing?
Neil Gershenfeld 51:45 Oh, so, that's why that's a great question. So, um, I have a prize that's almost but not been claimed for the students whose thesis can walk out of the printer.
Lex Fridman 51:54 Oh, nice.
Neil Gershenfeld 51:55 So you have to print the thesis with the means to, to exit the printer, and it has to contain its description of the thesis that says how to do that.
Lex Fridman 52:08 It's a really good, uh, I mean, it's a, it's a, (laughs) it's a fun example of exactly the thing we're talking about.
Neil Gershenfeld 52:13 A- and I've had a few students almost, uh, get to that. Um, and so, um, in, in what I'm describing, there's this stack where we're getting closer, but it's still quite a few years to really go from a s- So, there's a layer below the transistors where we assemble the base materials that become the transistor. We're now just at the edge of assembling the transistors to make the circuits. W- w- we can assemble the microparts to make the microrobots. We can assemble the bigger robots. And in the coming years, we'll be patching together all of those, uh, scales.
Lex Fridman 52:47 Do you, so do you see a vision of just endless billions of robots s- at the different scales self-assembling, um, s- self-replicating and building m- complicated structures?
Neil Gershenfeld 52:59 Yes. Uh, uh, a- and the but to the yes but is, let me clarify two things. One is, that immediately raises King Charles' fear of gray goo, of runaway mutant self-reproducing-
Lex Fridman 53:14 Sure.
Neil Gershenfeld 53:15 ... things. The reason why, there are many things I can tell you to worry about, but that's not one of them, is if you want things to autonomously self-reproduce and take over the world, that means they need to compete with nature on using the resources of nature, of water and sunlight.
Lex Fridman 53:32 Mm-hmm.
Neil Gershenfeld 53:32 And in light of everything I'm describing, biology knows everything I told you. Every single thing I explained, biology already knows how to do. Um, uh, what I'm describing isn't new for biology, it's new for non-biological systems. So in the digital era, the economic win ended up being centralized, the big platforms. In this world of machines that can make machines, I'm, I, I'm asked, for example, um, you know, what, what's the killer opportunity, you know, who's gonna make all the money, um, who to invest in?
Lex Fridman 54:06 Mm-hmm.
Neil Gershenfeld 54:07 But if the machine can make the machine, it's not a great business to invest in the machine. (laughs) Um, in the same way that if you can produ- if you can think globally but produce locally, then the way the technology goes out into society isn't a function of central control, um, but is fundamentally distributed. Now that, that raises an obvious kind of concern, which is, well, doesn't this mean you could make bombs and guns and all of that? The reason that's much less of a problem than you would think is making bombs and guns and all of that is a very well met market need. (laughs) Anywhere we go, there, there's a fine supply chain for weapons. You know, hobbyists have been making guns for ages, and guns are available just about anywhere. So you could go into the lab and make a gun. Today, it's not a very good gun. And guns are easily available. And so generally what, you know, we run these lab in war zones. Um, what we find is, uh, people don't go to them to make weapons, which you can already do anyway. It's an alternative to making weapons. It, coming back to your question, I'd say the single most important thing I've learned is-... y- the greatest natural resource of the planet is this amazing density of bright, inventive people whose brains are underused. And, um, you could view th- the social engineering of this lab work as creating the capacity for them. And so, i- you know, i- in the end, the way this is gonna impact society isn't going to be command and control. It's how the world uses it. And it's been really gratifying for me to see just how
Trash and fabrication
Neil Gershenfeld 55:45 it does.
Lex Fridman 55:45 Yeah, but what are the different ways, uh, the evolution of the exponential scaling of digital fabrication can evolve? So you said, um, yeah, self-replicating nanobots, right? This is the- the gray goo fear. It's a caricature of a fear, but nevertheless there's interesting, just like you said, spam and all these kinds of things that came with the scaling of c- communication and computation. What are the different ways that malevolent actors will use this technology?
Neil Gershenfeld 56:15 Yeah, well first let me start with a benevolent story.
Lex Fridman 56:17 Yes.
Neil Gershenfeld 56:17 Which is, uh, trash is an analog concept.
Lex Fridman 56:23 Yeah.
Neil Gershenfeld 56:24 There's no trash in a forest. All the parts get disassembled and reused. Trash means something doesn't have enough information to tell you how to reuse it.
Lex Fridman 56:33 Yeah.
Neil Gershenfeld 56:34 It's as simple as th- there's no trash in a Lego room.
Lex Fridman 56:38 Mm-hmm.
Neil Gershenfeld 56:38 Wh- when you assemble Lego, the Lego bricks have enough information to dis- disassemble them. So one of the... So as you go through this fab one, two, three, four story, one of the implications of this transition to, from printing to assembling... So the real breakthrough technologically isn't additive versus subtractive, which is a subject of a lot of attention and hype. Um, yep, 3D printers are useful, um, you know, we spun off companies like Formlabs, led by Max, for 3D printing, but in a fab lab it's one of maybe 10 machines. It's- it's used but it's only part of the machines. The real technological change is when we go from printing and cutting to assembling, uh, and disassembling.
Lex Fridman 57:22 Mm-hmm.
Neil Gershenfeld 57:22 But that reduces inventories of hundreds of thousands of parts to just having a few parts to make almost anything.
Lex Fridman 57:29 Mm-hmm.
Neil Gershenfeld 57:29 It reduces global supply chains to locally sourcing these building blocks. But one of the key implications is it gets rid of technological trash, because you can disassemble and reuse the parts, not throw them away. And so initially, that's of interest for things at the end of long supply chains, like satellites on orbit, but one of the things coming is eliminating technical trash through reuse of the building blocks.
Lex Fridman 57:54 So, like, when you think about 3D printers, you're thinking about-
Neil Gershenfeld 57:57 So-
Lex Fridman 57:57 ... addition and subtraction. When you think about the other options available to you in that parameter space, as you call it-
Neil Gershenfeld 58:05 Yeah.
Lex Fridman 58:05 ... that's going to be assembly, disassembly, cutting, you said?
Neil Gershenfeld 58:09 So the 1952 NC mill was, uh, subtractive. You remove material.
Lex Fridman 58:15 Mm-hmm.
Neil Gershenfeld 58:15 And, um, 3D printing, a- additive, and there's a couple claims to the invention of 3D printing. That's closer to what's called net shape, which is you don't have to cut away the material you don't need. You just put material where you do need it.
Lex Fridman 58:27 Mm-hmm.
Neil Gershenfeld 58:27 And so that's the 3D printing revolution. But there are all sorts of limitations on 3D printing, to, um, the kinds of materials you can print, um, the kind of functionality you can print. We're- we're- we're just not gonna get to making a, um, everything in a cellphone on a single printer. But I do expect to make everything in a cellphone with an assembler. And so instead of printing and cutting technologically, it's this transition to assembling and disassembling, y- going back to Shannon and von Neumann going back to the ribosome four billion years ago. Now, you- you come to malevolent. Um, let me tell you a story about... I was doing a briefing for, uh, th- the National Academy of Sciences group that advises the intelligence communities. And I talked about the kind of research we do, and at the very end, I showed a little video clip of Valentina in Ghana, um, making, uh, a local girl making surface mount electronics in the fab lab. And I showed that to this room full of people. Uh, one of the in- members of the intelligence community got up, livid, and said, "How dare you waste our time showing us a young girl in an African village making surface mount electronics? We're looking e- we need to know about disruptive threats to the future of the United States."
Lex Fridman 59:52 (laughs) Yeah.
Neil Gershenfeld 59:53 And somebody else got up in the room and yelled at him. "You idiot, I can't think of anything more important than this."
Lex Fridman 1:00:00 Yeah.
Neil Gershenfeld 1:00:00 But for two reasons. One reason was, um, because if we rely on, like, informational superiority in the battlefield, it means other people could get access to it. But this intelligence person's point, bless him, wasn't that, it was getting at the root causes of conflict, is if this young girl in an African village could actually master surface mount electronics, it changes some of the most fundamental things about recruitment for terrorism, um, uh, impact of economic migration, basic assumptions about an economy. It's ju- just existential for the future of the planet.
Lex Fridman 1:00:40 But,
Lab-made bioweapons
Lex Fridman 1:00:41 you know, we've just lived through a pandemic. I would love to linger on this, 'cause the possibilities that are positive are endless.
Neil Gershenfeld 1:00:50 Yeah.
Lex Fridman 1:00:50 But the possibilities that are negative are still nevertheless extremely important. What's both positive and negative? What do you do with a large number of general assemblers?
Neil Gershenfeld 1:01:01 Yeah. With the fab lab, you could roughly make a bio lab then learn biotechnology. Now, that's terrifying because making self-reproducing gray goo that out-competes biology I consider doom because biology knows everything I'm describing and is really good at what it does.
Lex Fridman 1:01:19 Mm-hmm.
Neil Gershenfeld 1:01:20 Um, in...... how to grow almost anything. You learn skills in biotechnology that would let, that let you make serious biological threats.
Lex Fridman 1:01:32 And when you combine, uh, some of the innovations you see with large language models, some of the innovations you see with AlphaFold, so applications of AI for designing biological systems, for, uh, writing programs which you can with l- large language models increasingly. So there seems to be an interesting dance here of automating the design stage of complex systems using AI, and then that's the, th- that's the bits.
Neil Gershenfeld 1:02:02 Mm-hmm.
Lex Fridman 1:02:02 And you can leap now the innovations you're talking about. You can leap from the complex systems in the digital space to th- the printing to the creation to the assembly, uh, at scale i- i- of, uh, complex systems in the physical space.
Neil Gershenfeld 1:02:18 Yeah. So something to be scared about is a fab lab can make a bio lab, a bio lab can make biotechnology, somebody could learn to make a virus.
Lex Fridman 1:02:28 True.
Neil Gershenfeld 1:02:28 Uh, that's scary. That, that's, uh, unlike some of the things I said I don't worry about, that's something I really worry about that is scary.
Lex Fridman 1:02:36 Okay.
Neil Gershenfeld 1:02:37 Now how do you deal with that? Uh, prior threats we dealt with command and control.
Lex Fridman 1:02:45 Mm-hmm.
Neil Gershenfeld 1:02:46 So like, uh, e- early color copiers had unique codes and you could tell which copier made them. Eventually you couldn't keep up with that. Uh, there, there was a famous meeting at Asilomar in the early days of recombinant DNA-
Lex Fridman 1:03:02 Mm-hmm.
Neil Gershenfeld 1:03:02 ... where that community recognized the dangers of what it was doing and put in place a regime to help manage it, and so that led to the kind of research management. So, you know, MIT has an office t- that supervises research and it works with the national office. That works if you can identify who's doing it and where.
Lex Fridman 1:03:22 Mm-hmm.
Neil Gershenfeld 1:03:23 It doesn't work in this world we're describing.
Lex Fridman 1:03:25 Yeah.
Neil Gershenfeld 1:03:26 So anybody could do this anywhere. And so what we've found is you can't contain this. It's already out. You can't forbid because there isn't command and control. The most useful thing you can do is provide incentives for transparency.
Lex Fridman 1:03:44 Yes.
Neil Gershenfeld 1:03:44 So but really, the heart of what we do is you could do this by yourself in a basement for nefarious reasons or you could come into a place in the light where you get help and you get community and you get resources, and there's an incentive to do it in the open, not in the dark. And that might sound naïve, but in the sort of places we're working, oh, you know, um, again, bad people do bad things in these places already, but, uh, providing openness and providing transparency is a key part of managing these. And so it, it, it transitions from regulating risks as regulation to, to soft power to manage them.
Lex Fridman 1:04:30 So there's so much potential for good, so much capacity for good, that, uh, fab labs and the, uh, the, the ability, um, and the tools of creation really unlock that potential.
Neil Gershenfeld 1:04:44 Yeah. And I, I don't say that as sort of dewy-eyed naive. I, I say that empirically from just-
Lex Fridman 1:04:50 Yeah.
Neil Gershenfeld 1:04:50 ... y- years of seeing how this plays out in communities.
Lex Fridman 1:04:52 I wonder if it's the early days of personal computers, though, before we get spam,
Genome
Lex Fridman 1:04:56 right?
Neil Gershenfeld 1:04:57 In the end, most fundamentally, literally the mother of all problems is who designed us. So w- so assume success in that we're gonna transition to the machines making machines and all of these new sort of social systems we're describing will help manage them and curate them and democratize them. I- i- if we close the gap I just led off with of 10 to the 10 to 10 to the 18 between chip fab and you, um, we're ultimately, in marrying communication, computation, and fabrication, gonna be able to create unimaginable complexity.
Lex Fridman 1:05:42 Mm-hmm.
Neil Gershenfeld 1:05:43 Um, and how do you design that? And so I'd say the deepest of all questions that I've been working on is, goes back to the oldest part of our genome. So, uh, i- in our genome, what are called Hox genes, and these are morphogenes, and nowhere in your genome is the number five. It doesn't store the fact that you have five fingers.
Lex Fridman 1:06:18 Mm-hmm.
Neil Gershenfeld 1:06:19 What it stores is what's called a developmental program. It's a series of steps and the steps have the character of like grow up a gradient or break symmetry.
Lex Fridman 1:06:29 Mm-hmm.
Neil Gershenfeld 1:06:30 And at the end of that developmental program, you have five fingers.
Lex Fridman 1:06:33 Mm-hmm.
Neil Gershenfeld 1:06:34 So you are stored not as a body plan but as a growth plan.
Lex Fridman 1:06:43 Mm-hmm.
Neil Gershenfeld 1:06:44 And there's two reasons for that. One reason is just compression. Billions of genes can place trillions of cells. Um, but the much deeper one is evolution doesn't randomly perturb. Almost anything you did randomly in the genome would be fatal or inconsequential but not interesting.
Lex Fridman 1:07:06 Mm-hmm.
Neil Gershenfeld 1:07:07 But when you modify things in these developmental programs, you go from like webs for swimming to fingers, or you go from walking to wings for flying. It's a space in which search is interesting. So this is the heart of the success of AI. In part, it was the scaling we talked about a while ago, and in part, it was the representations......for which search is effective. A- a- AI has found good representations. It's- does- hasn't found new ways to search, but it's go- found good representations of search.
Lex Fridman 1:07:45 And that's- you're saying that's what biology, that's what evolution has done is created representations, structures, biological structures through which search...
Neil Gershenfeld 1:07:55 Correct.
Lex Fridman 1:07:55 ...is effective.
Neil Gershenfeld 1:07:56 And so the- the developmental programs in the genome beautifully encapsulate the lessons of AI. And this is- it's embodied- it's- it's molecular intelligence. It's AI embodied in our genome. It- it- it- it's every bit as profound as the cognition in our brain, but now this is sort of thinking in molecular thinking in how you design. And so, um, I'd say the most fundamental problem we're working on is it's kind of tautological that when you design a phone, you design the phone, you represent the design of the phone. But that actually fails when you get to the sort of complexity that we're talking about. And so there's this profound transition to come, you know, once I can have self-reproducing assemblers placing 10 to the 18 parts, um, y- you need to not sort of metaphorically but create life in that you need to learn how to evolve. But evolutionary design has a really misleading trivial meaning. It's not as simple as you randomly mutate things. It's this much more deep embodiment of- of AI and morphogenesis.
Lex Fridman 1:09:13 Uh, is there a way for us to continue the kind of evolutionary design that led us to this place from the early days of bacteria, single cell organism, to ribosomes, and the 20 amino acids?
Neil Gershenfeld 1:09:24 Y- you mean for human augmentation or...
Lex Fridman 1:09:26 For life augment- I mean, what would you call assemblers that are self-replicating and placing parts, what is that? The co- the- the dynamic complex things built with digital fabrication, what is that? That's life.
Neil Gershenfeld 1:09:41 So yeah, so ultimately, absolutely, w- if you add up everything I'm talking about, it's building up to creating life in non-living materials.
Lex Fridman 1:09:51 Yes.
Neil Gershenfeld 1:09:51 And I- I don't view this as copying life. I view it as deriving life. I- I didn't start from how does biology work and then I'm gonna copy it.
Lex Fridman 1:10:02 Mm-hmm.
Neil Gershenfeld 1:10:02 I- I start from how to solve problems and then it- it- it leads me to, in a sense, rediscover biology. So if we go back to Valentina in Ghana making her circuit board-
Lex Fridman 1:10:14 Mm-hmm.
Neil Gershenfeld 1:10:14 ...um, she still needs a chip fab very far away to make the processor in her circuit board. For her to make the processor locally, for all the reasons we described, you actually need the deep things we were just t- talking about. And so it- it really does lead you... So let's see, there- there's a wonderful series of books by Gingery.
Lex Fridman 1:10:38 Mm-hmm.
Neil Gershenfeld 1:10:38 Book one is How to Make a Charcoal Furnace, and at the end of book seven, you have a machine shop.
Lex Fridman 1:10:44 (laughs) Okay. Nice.
Neil Gershenfeld 1:10:44 So it- it- it- it's sort of how- how- how you do your own personal industrial revolution.
Lex Fridman 1:10:49 Mm-hmm.
Neil Gershenfeld 1:10:50 ISRU is what NASA calls in situ resource utilization, and that's how do you go to a planet and create a civilization. Uh, ISRU has essentially assumed Gingery. You go through the industrial revolution and you create the inventory of 100,000 resistors. What we're finding is the way you... the minimum building blocks for a civilization is roughly 20 parts. So what's interesting about the amino acids is they're not interesting. They're hydrophobic or hydrophilic, basic or acidic. They have typical but not extremal properties, but they're good enough you can combine them to make you.
Lex Fridman 1:11:28 Mm-hmm.
Neil Gershenfeld 1:11:29 So what this is leading towards is technology doesn't need enormous global supply chains. It just needs about 20 properties you can compose to create all technology as the minimum building blocks for a technological civilization.
Lex Fridman 1:11:45 So there's going to be 20 basic building blocks based on which the self-replicating assemblers can work?
Neil Gershenfeld 1:11:52 Right. And I say that not philosophically, just empirically sort of that- that- that's where it's heading. And, uh, I like thinking about how you bootstrap a civilization on Mars, that problem. There's a fun video on bonus material for the movie where- where- where a- a neat group of people we talk about it, because it has really profound implications back here on Earth about how we live sustainably.
Lex Fridman 1:12:16 W- what does that civilization on Mars looks like that's using, uh, uh, ISRU, that's using these 20 building blocks and d- does self-assembly?
Neil Gershenfeld 1:12:24 Yeah. Go- go through primary, secondary, tertiary, quaternary.
Lex Fridman 1:12:26 Yeah.
Neil Gershenfeld 1:12:27 Um, you know, y- you- you extract properties like, uh, conducting, insulating, semiconducting, uh, magnetic, uh, dielectric, um, flexural, these are the kind of, you know, roughly 20 properties.
Lex Fridman 1:12:42 Mm-hmm.
Neil Gershenfeld 1:12:43 Um, with those, those are enough for us to assemble logic and they're enough for us to assemble actuation. Um, with logic and actuation, we can make micro-bots.
Lex Fridman 1:12:58 Mm-hmm.
Neil Gershenfeld 1:12:59 Um, the micro-bots can build bigger robots. Um, the bigger robots can then take the building block materials and make the structural elements that you then do to make construction and then you boot up through the stages of a technological civilization.
Lex Fridman 1:13:16 By the way, where in the span of logic and ac- actuation did the sensing come in?
Neil Gershenfeld 1:13:22 Oh, I- I skipped over that, but my favorite sensor i- is a, um, step response. So if you just make a step and measure the response to the electric field-... um, that ranges from user interfaces to positioning, to material properties, and if you do it at higher frequencies, you get, um, chemistry.
Lex Fridman 1:13:42 Mm-hmm.
Neil Gershenfeld 1:13:43 And you can get all of that just from a step in an electric field. So, for example, o- once you have time resolution in logic, something as simple as two electrodes let you do amazingly, um, capable sensing. So we've been talking about all the work I do. There's a story about h- how it happens, w- you know, where do ideas come from, and...
Lex Fridman 1:14:06 That's an interesting story.
Neil Gershenfeld 1:14:07 Yeah.
Lex Fridman 1:14:07 Where do ideas come from?
Neil Gershenfeld 1:14:08 So, uh, I had mentioned Vannevar Bush, and, uh, he wrote a really influential thing called The Endless Frontier. So, uh, science won World War II. The- the- the- the more known story is nuclear bombs. The less well-known story is the Rad Lab. So at- at MIT, an amazing group of people invented radar, which is really credited as winning the war.
Lex Fridman 1:14:35 Mm-hmm.
Neil Gershenfeld 1:14:35 So after the war, uh, a grand old man from MIT, and at the, um... Uh, was charged with science won the war, how do we m- maintain that edge?
Lex Fridman 1:14:48 Mm-hmm.
Neil Gershenfeld 1:14:48 And the report he wrote led to the National Science Foundation. And the modern notion we take for granted but didn't really exist before then of public funding of research, of research agencies.
Lex Fridman 1:15:01 Mm-hmm.
Neil Gershenfeld 1:15:02 Um, in it, he made a- again what I consider an important mistake, which is he described basic research leads to applied research, leads to applications, leads to commercialization, leads to impact.
Lex Fridman 1:15:18 Mm-hmm.
Neil Gershenfeld 1:15:18 And so we need to invest in that pipeline. Um, the reason I consider it a mistake is almost all of the examples we've been talking about in my lab went backwards, that the basic research came from applications.
Lex Fridman 1:15:36 Mm-hmm.
Neil Gershenfeld 1:15:37 And further, almost all of the examples we've been talking about came fundamentally from mistakes. So...
Lex Fridman 1:15:46 (laughs) Yeah.
Neil Gershenfeld 1:15:49 E- e- essentially, everything I've ever worked on has failed.
Lex Fridman 1:15:51 Mm-hmm.
Neil Gershenfeld 1:15:53 But in failing, something better happened. So, uh, the way I like to describe it is, you know, ready, aim, fire is you do your homework.
Lex Fridman 1:16:01 Mm-hmm.
Neil Gershenfeld 1:16:02 Um, you aim carefully at something, a target you wanna accomplish, and if everything goes right, you then hit the target and succeed.
Lex Fridman 1:16:10 Mm-hmm.
Neil Gershenfeld 1:16:10 Um, what I do you can think of as ready, fire, aim. So you- you do a lot of work to get ready, um, then you close your eyes, and you don't really think about where you're aiming. But you look very carefully at where you did aim, where y- w- um, you aim after you fire.
Lex Fridman 1:16:28 (laughs)
Neil Gershenfeld 1:16:29 And the- the reason that's so important is, it... If you do ready, aim, fire, there's... The best you can hope is hit what you aim at. So let me give you some examples.
Lex Fridman 1:16:40 (laughs)
Neil Gershenfeld 1:16:41 Uh, uh, because th- this is a source of great-
Lex Fridman 1:16:43 You're full of good lines today, yeah.
Neil Gershenfeld 1:16:45 (laughs)
Lex Fridman 1:16:45 (laughs)
Neil Gershenfeld 1:16:45 Source of great frustration. So
Quantum computing
Neil Gershenfeld 1:16:48 I mentioned the early quantum computing. So quantum computing is this power of using quantum mechanics to make computers that for some problems are dramatically more powerful than classical computers. Before it started, there was a really interesting group of people who knew a lot about, um, physics and computing that were inventing what became quantum computing before it was clear anything... there was an opportunity there. It was just studying how those relate. Here's how it fits to the ready, fire, aim, in that I was doing really short-term work in my lab on shoplifting tags.
Lex Fridman 1:17:25 Mm-hmm.
Neil Gershenfeld 1:17:26 On... Y- this was b- really before there was modern RFID, and so how you put tags in objects to sense them.
Lex Fridman 1:17:35 Mm-hmm.
Neil Gershenfeld 1:17:35 Something we just take for granted commercially. And there was a problem of how you can sense multiple objects at the same time. And so I was studying how you can remotely sense materials to make low-cost tags that could let you distinguish multiple objects simultaneously.
Lex Fridman 1:17:53 Mm-hmm.
Neil Gershenfeld 1:17:53 To do that, you need non-linearity so that the signal is modulated, and so I was looking for material sources of non-linearity, and that led me to s- look at how, um, nuclear spins interact.
Lex Fridman 1:18:08 Mm-hmm.
Neil Gershenfeld 1:18:09 Just- just, uh, for- for, um, spin resonance. This is the sort of things you use when you, like, go in an MRI machine. And so I was studying how to use that, and it turns out that it was a bad idea. You couldn't remotely use it for, um, shoplifting tags. But I realized you could compute. And so, um, with a group a- of colleagues thinking about early quantum computing, like David DiVincenzo and Charlie Bennett, was articulating what are the properties you need to compute, and then looking at how to make the tags.
Lex Fridman 1:18:45 Mm-hmm.
Neil Gershenfeld 1:18:45 It turns out the tags were a terrible idea for, um, sensing objects in a supermarket checkout, but I realized they were computing. So with Ike Chuang and a few other people, we realized we could program nuclear spins to compute. And so that's what we used to do Grover's search algorithm and then it was used for a Shor's factoring algorithm, and it worked out. Um, the systems we did it in, nuclear magnetic resonance, don't scale beyond a few qubits.
Lex Fridman 1:19:15 Mm-hmm.
Neil Gershenfeld 1:19:15 But the techniques have lived on, and so, uh, you know, all the current quantum computing techniques grew out of the ways we would talk to these spins. But I- I'm telling this whole story because it- it came from a bad way to make a shoplifting tag.
Lex Fridman 1:19:32 Starting with an application, mistakes led to breakthrough-
Neil Gershenfeld 1:19:35 The fundamental science.
Lex Fridman 1:19:36 ... fundamental science.
Neil Gershenfeld 1:19:37 Yeah.
Lex Fridman 1:19:37 I mean, can you, can you just linger on that? I mean, ju- just t- just the using nuclear spins to do com- computation that, like...What gave you the guts to try to think through this? The, from, from a fabrica- from a digital fabrication perspective actually. How to leap from one to the other?
Neil Gershenfeld 1:19:54 I wouldn't call it guts. I would call it collaboration. So, I-
Lex Fridman 1:19:57 Ah.
Neil Gershenfeld 1:19:57 So at IBM, there was this a- a- amazing group of, like I mentioned, Charlie Bennett and David DiVincenzo, and Rolf Landauer and Nabil Amir, and these were all gods of thinking about physics and computing. So-
Lex Fridman 1:20:13 Ah.
Neil Gershenfeld 1:20:14 ... I- I- I- I yelled at the whole computer industry being based on, uh, a fiction, Metropolis, you know, programmers frolicking in the garden while somebody moves levers in the basement.
Lex Fridman 1:20:25 Mm-hmm.
Neil Gershenfeld 1:20:26 There's a complete parallel history of, um, uh, Maxwell to Boltzmann to Szilard to, um, Landauer to Bennett, m- most people won't know most of these names, but this whole parallel history, thinking deeply about how computation and physics relate. So, um, I was collaborating with that whole group of people. And then, y- at, at MIT I was in this high traffic environment. I wasn't deeply inspired to think about better ways to detect shoplifting tags, but, you know, stumbled across companies that needed help with that and was thinking about it, and then I realized those two worlds intersected and we could use the failed approach for the shoplifting tags to make, um, early, um, quantum computing algorithms.
Lex Fridman 1:21:14 And this kind of stumbling is fundamental to the Fab Lab idea, right?
Neil Gershenfeld 1:21:18 Right. Here's
Microfluidic bubble computation
Neil Gershenfeld 1:21:19 one more example. With a student, Manu, we talked about ribosomes, and I was trying to build a ribosome, um, that worked on fluids so that I could place the little parts we're talking about, and we, it kept failing because bubbles would come into our system and the bubbles would make the whole thing stop working.
Lex Fridman 1:21:38 Mm-hmm.
Neil Gershenfeld 1:21:39 And we spent about half a year trying to get rid of the bubbles, um, then Manu said, "Wait a minute. The bubbles are actually better than what we're doing. We should just use the bubbles." And so w- we invented how to do universal object with little bu- logic with little bubbles and fluid.
Lex Fridman 1:21:55 Okay. You have to, you have to explain this microfluidic bubble logic, please.
Neil Gershenfeld 1:22:00 Please.
Lex Fridman 1:22:00 How does this work?
Neil Gershenfeld 1:22:01 So-
Lex Fridman 1:22:01 This is really- (laughs)
Neil Gershenfeld 1:22:02 Yeah.
Lex Fridman 1:22:02 That's super interesting.
Neil Gershenfeld 1:22:03 Yeah. And so wh- so I'll come back and explain it, but what it led to was, um, we showed fluids could do, um... it had been known fluid could do logic, like your old automobile transition- transmissions do logic, but that's macroscopic. It didn't work at little scales. We showed with these bubbles we could do it at little scales. Th- then I'm gonna come back and explain it, but what came out of that is Manu then showed you could make a 50-cent microscope using little bubbles.
Lex Fridman 1:22:30 Mm-hmm.
Neil Gershenfeld 1:22:31 And then, um, the techniques we developed are what we used to transplant genomes to make synthetic life, all came out of the failure of trying to make, uh, the genome, the- the- the ribosome. Now, so the way the bubble logic works is, um, in a little cha- channel, uh, fluid at small scales is fairly viscous. It's sort of like pushing jello, think of it as. Um, i- i- if a bubble gets stuck-
Lex Fridman 1:23:04 Mm-hmm.
Neil Gershenfeld 1:23:04 ... the fluid has to detour around it.
Lex Fridman 1:23:06 Mm-hmm.
Neil Gershenfeld 1:23:08 So now imagine a, a channel that has two wells and one bubble. If the bubble is in one well, the fluid has to go in the other channel. If the fluid is in the other well, it has to go in the first channel.
Lex Fridman 1:23:22 Mm-hmm.
Neil Gershenfeld 1:23:23 So the, the bu- the position of the bubble can switch. It's a switch, it can switch the fluid between two channels. So now we have one element of switch, and it's also a memory because you can detect whether or not a bu- bubble is stored there. Then if two bubbles meet, um, i- i- if you have two channels crossing, a bubble can go through one way or a bubble can go through the other way, but if two bubbles come together, then they push on each other and one goes one way and one goes the other way.
Lex Fridman 1:23:55 Mm-hmm.
Neil Gershenfeld 1:23:56 That's a logic operation.
Lex Fridman 1:23:57 Mm-hmm.
Neil Gershenfeld 1:23:57 That's a logic gate. So we now have a switch, we have a memory, and we have a logic gate, and that's everything you need to make a universal computer.
Lex Fridman 1:24:05 I mean, the fact that you did that with bubbles and microfluidics just kind of brilliant, you know?
Neil Gershenfeld 1:24:12 Well, so to, I mean, to stay with that example, uh, it- it- what we proposed to do was to make a fluidic ribosome and the project crashed and burned. It was a disaster. Um, this is what came out of it. And so it was precisely ready, fire, aim, in that we had to do a lot of homework to be able to make these microfluidic systems. The- the fire part was we didn't think too hard about making the ribosome. We just tried to do it.
Lex Fridman 1:24:41 Mm-hmm.
Neil Gershenfeld 1:24:41 The aim part was we realized the ribosome failed but something better had happened. And if you look all across research funding, research management, it doesn't anticipate this. So fail fast is familiar-
Lex Fridman 1:24:56 Mm-hmm.
Neil Gershenfeld 1:24:56 ... but fail fast tends to miss ready and aim. You, you can't just fail. You have to do your homework before the fail part and you have to do the aim part after the fail part. And so the whole language of research is about, like, milestones and deliverables. That works when you're going down a straight line, but it doesn't work for this kind of discovery. And to leap to something you said that's really important is I view part of what the Fab Lab Network is doing is giving more people the opportunity to fail.
Lex Fridman 1:25:29 You've, uh, said that geometry is really important in biology. Um, what does fabrication biology look like? Why is geometry important?
Neil Gershenfeld 1:25:41 So molecular biology is dominated by geometry. That's why the protein folding is so important that, that, that the geometry gives the function.And, uh, there's this hierarchical construction of, as you go through primary, secondary, tertiary, quaternary, the shapes of the molecules make the shape of the molecular machines.
Lex Fridman 1:26:05 Mm-hmm.
Neil Gershenfeld 1:26:05 And they really are exquisite machines. If you look at how, um... If you look at how your muscles move-
Lex Fridman 1:26:13 Mm-hmm.
Neil Gershenfeld 1:26:13 ... if you were to see a simulation of it, it would look like a improbable science fiction cyborg world of these little walking robots that walk on a discrete lattice, that they're really exquisite machines. And- and then from there, there's this whole hierarchical stack of, once you get to the top of that, you then start making organelles that make, um, cells that make organs, um, through the stack of that hierarchy.
Maxwell's demon
Lex Fridman 1:26:41 Just stepping back, does it amaze you that from small building blocks where, um, amino acids you mentioned, molecules, let's go to the very beginning of hydrogen and helium at the start of this universe, that we're able to build up such, um, complex and beautiful things like our human brain?
Neil Gershenfeld 1:27:00 So studying thermodynamics, which is exactly the question of, you know... Bat- batteries run out and need recharging.
Lex Fridman 1:27:13 Mm-hmm.
Neil Gershenfeld 1:27:15 You know, e- equipment, you know, cars get old and fail-
Lex Fridman 1:27:19 Mm-hmm.
Neil Gershenfeld 1:27:20 ... yet life doesn't and that's why there's a- a sense in which life seems to violate thermodynamics, although of course it doesn't.
Lex Fridman 1:27:30 It seems to resist the march towards entropy somehow.
Neil Gershenfeld 1:27:33 Right. And so Maxwell, who helped give rise to the science of thermodynamics, uh, posited a- a- a- a problem that was so infuriating, it led to a series of suicides. There was a series of a- a- a- um, advisors and advisees, um, three in a row that all ended up committing suicide, that happened to work on this problem, and Maxwell's demon is- is this simple but infamous problem where, right now in this room, we're surrounded by molecules and they run at different velocities. Um, imagine a container that has a wall and it's got gas on both sides and a little door, and if the door is a molecular sized creature and it could watch the molecules coming, and when a fast molecule is coming, it opens the door, when a slow molecule is coming, it closes the door.
Lex Fridman 1:28:33 Mm-hmm.
Neil Gershenfeld 1:28:34 After it does that for a while, one side is hot, one is cold. Once something is hot and is cold, you can make an engine, and so you close that and you make an engine and you make energy.
Lex Fridman 1:28:45 Mm-hmm.
Neil Gershenfeld 1:28:47 So the demon is violating thermodynamics because it's- it's not, it's never touching the molecule, yet by just opening and closing the door, it can make arbitrary amounts of energy and power a machine-
Lex Fridman 1:29:03 Mm-hmm.
Neil Gershenfeld 1:29:03 ... and in thermodynamics, you can't do that. So that's Maxwell's demon. Uh, that problem is connected to everything we just spoke about for the last few hours.
Lex Fridman 1:29:14 Mm-hmm.
Neil Gershenfeld 1:29:15 So, uh, Leo Szilard, uh, around, um, early 1900s, was a deep physicist who then had a lot to do with, um, also, uh, po- sort of post-war anti-nuclear things. But he reduced Maxwell's demon to a single molecule. So the molecule, one, there's only one molecule, and the question is, which side of the partition is it on?
Lex Fridman 1:29:44 Mm-hmm.
Neil Gershenfeld 1:29:45 That led to the idea of one bit of information. So Shannon credited Szilard's analysis of Maxwell's demon for the invention of the bit.
Lex Fridman 1:29:55 Mm-hmm.
Neil Gershenfeld 1:29:56 Um, for many years, people tried to explain Maxwell's demon by, like, the energy in the demon looking at the molecule or the energy to open and close the door and nothing ever made sense. Um, finally, Rolf Landauer, one of the colleagues I mentioned at IBM, finally solved the problem. He showed that you can explain Maxwell's demon by, you need the mind of the demon.
Lex Fridman 1:30:28 Mm-hmm.
Neil Gershenfeld 1:30:29 Um, when the demon open and closes the door, as long as it remembers what it did, you can run the whole thing backwards-
Lex Fridman 1:30:39 Mm-hmm.
Neil Gershenfeld 1:30:39 ... but when the demon forgets, then you can't run it backwards, and that's where you get dissipation and that's where you get the vi- uh, violation of thermodynamics.
Lex Fridman 1:30:51 Mm-hmm.
Neil Gershenfeld 1:30:51 And so the explanation of Maxwell's demon is that it's- it's in the demon's brain.
Lex Fridman 1:30:57 Mm-hmm.
Neil Gershenfeld 1:30:57 So then Rolf's collea- colleague Charlie at IBM, uh, then shocked Rolf by showing you can compute with arbitrarily low energy. So one of the things that's not well covered is that the big computers used for big machine learning, the data centers use tens of megawatts of power. They use as much power as a city. Um, Charlie showed you can actually compute with arbitrarily low amounts of energy by making computers that can go backwards as well as forwards. And what limits the speed of the computer is how fast you want an answer and how certain you want the answer to be. But we're orders of magnitude away from that. So I have a student, Cameron, working with Lincoln Labs on making superconducting computers that operate near this Landauer limi- limit that are orders of magnitude more efficient.Um, so stepping back to all of that, that whole tour was driven by your question about life. And, uh, you know, right at the heart of it is Maxwell's demon.L- life exists because it can locally violate thermodynamics. It can locally violate thermodynamics because of intelligence and its, its molecular intelligence that, you know... I would even go out on a limb to say we can already see we're beginning to come to the end of this, eh, current AI phase. So depending on how you count, this is, I'd say the fifth AI boom bust cycle.
Lex Fridman 1:32:36 Mm-hmm.
Neil Gershenfeld 1:32:37 And you can already... You know, it, it's exploding but you can already see where it's heading, you know, how it's going to saturate, wh- what happens on the far side. Um, th- the big thing that's not yet on horizons is,
The published transcript ends here. Continue watching on YouTube
Episode duration: 2:07:04
In the uListen app, the transcript lights up word by word as you listen. Get uListen
Transcript of episode YDjOS0VHEr4