Moonshots / Peter Diamandis

Jensen Pushes Back on Doomers, Xi & Trump Talk AI, and “AI” Gets a Rebrand | #294 MOONSHOTS Live

🇬🇧 EN🇪🇸 ES
Complete 51:22 min youtube 2026 Week 39 Sep 27, 2026 🇬🇧 EN
TL;DR
Research summary

▶ Welcome and the moonshot mission

The host welcomes attendees to the inaugural Moonshots Live event and describes its mission as keeping people hopeful and optimistic, helping them find a massive transformative purpose, choose a moonshot, and make it happen. The host presents AI as a tool for finding and solving problems, and encourages attendees to leave with a clear statement of what they will build or solve, then tell three people; those people could become co-founders, funders, or partners. The segment ends with an introduction to the moonshot mates.

▶ Introducing the panel and framing AI risk

A video introduces themes including superintelligence, creativity enabled by automation, AI video generation, and the pace of change. The host introduces panelists Sulaiman Smail, Alex Lisenko, and Emmett Bostock, then turns to public concern about AI. The host says there is danger from AI, particularly from people using it malevolently, and asks whether the fear of AI acting on its own is warranted. A clip attributed to Jensen Huang challenges Geoffrey Hinton’s estimate of a 10% chance of societal destruction, saying it is not grounded in science or research. A clip attributed to Mark Zuckerberg expresses optimism conditional on responsible action, and says trust and alignment will be important capabilities.

▶ Panel views on AI danger and acceleration

Emad says current dangers include poor security and infrastructure and human misuse, and argues that distinct risks are being conflated with a scenario in which AI suddenly escapes and kills everyone. He calls for enforcing existing regulations and collaborating on alignment. Alex argues that moral panic over superintelligence could delay progress, while another panelist says the probability of a positive future exceeds the probability of doom and describes humans as having long used technology to augment themselves. Dave says AI is improving quickly and could make the world much better, while warning that misuse is a serious threat that needs solutions. The panelists generally oppose slowing development, though they acknowledge risks.

▶ US–China coordination and governing AI

The panel discusses the Xi–Trump meeting, liability for harm caused by AI products, and whether safety coordination could become a cartel that limits competition. Alex argues that competition is healthy and compares AI governance to cities, which he says can grow alongside services such as police and fire departments. Emad sees a role for reporting and coordination, and distinguishes frontier AI from utility AI that may operate in medical, judicial, road, and school systems; he suggests AI serving society might warrant different liability treatment. Panelists debate whether AI could push countries toward common standards or instead contribute to a greater variety of governments and more self-determining city-states. Dave relays concerns that the US wants to avoid panic and losing ground to China, while China fears AI could penetrate its Great Firewall and threaten the government’s stability.

▶ Superintelligence terminology and proposed bans

The panel discusses the term superintelligence and the distinction between advanced frontier systems and everyday AI that could help with execution and routine work. One panelist calls for alignment work alongside continued development; another describes AI as complementary to human intelligence and warns against familiar narratives that machines will take all jobs. The panel reviews Bernie Sanders’s proposal, as presented in the discussion: a permanent ban on artificial superintelligence defined as exceeding human cognitive ability across most domains, an immediate pause on advanced AI until new rules are written, and a cabinet-level Department of AI, with company shutdowns and up to 20 years in federal prison as penalties. Panelists criticize the proposal, arguing it could discourage action, investment, and research; they point to specific risks such as terrorists using AI to make biological weapons and China outpacing the US, and recommend technical measures for open-source systems and monitoring. Other panelists argue that limiting intelligence would be harmful, while one says local access to model weights could make political restrictions less consequential. A panelist also argues that banning superintelligence would raise free-speech concerns because it is mathematics.

▶ Model releases, Meta Muse, and Claude Opus 5.5

The host says there were 12 major model releases in 22 days and four in the preceding five days. The panel describes Meta Muse as able to book flights, order food, manage calendars, and shop, and says it reached number one on the App Store with 2.8 million downloads. Speakers attribute its distribution potential to Meta’s reach and discuss how its consumer usefulness might affect search and other services; one says Meta is promoting it through Instagram to establish an AI distribution channel. The panel says Claude Opus 5.5 delivers performance comparable to stable 5.1 at half the price, and describes it as useful and capable. Dave praises visual interfaces that preview and then build what was proposed. Alex says Opus 5.5 can generate procedural videos, animations, images, and interactive games, contrasting this approach with pixel-wise image and video generation and suggesting the distinction may matter for robotics. Speakers say newer models are increasingly competent and cheaper, while Dave cautions that people who trust them because they are right most of the time may still receive occasional factual errors.

▶ Driving Bench and compute constraints

The host describes Driving Bench: developers equipped a Toyota Corolla with software controls for steering, acceleration, and braking, then asked a general-purpose model to complete a 130-meter cone course from a single command. The host reports that GPT-6 Astra completed the course on its second try and reads a comment from Boris Power arguing for powerful general models, with smaller specialized models distilled as needed. Alex and Emad predict broad capabilities from general-purpose models, including robotics, while Dave says specialized models may still matter and asks how much compute the demonstration used. Dave says HBM RAM prices have risen fivefold and compute is becoming scarce; the panel describes the bottleneck shifting from models to compute and then energy, with one speaker estimating a 60-gigawatt energy shortfall over the next two years.

▶ AI-assisted biology and newly reported enzyme

The host says Anthropic announced a life-sciences research group and wet labs, and reports that Claude, operating autonomously, found a previously unknown enzyme. The described process used 950 Claude agents searching a large DNA database for 21 hours after receiving a prompt to find interesting reverse transcriptases and enzymes that copy RNA or DNA. The host says the researchers found a repeating DNA pattern similar to CRISPR, named it array-associated reverse transcriptase, and do not yet know exactly what it does; they believe it may be similar to programmable transcriptases and useful in gene editing. Alex expects AI-enabled research to produce discoveries at an unprecedented pace and criticizes labs that warn of AI dangers while building wet labs. Selene highlights both the potential benefits and risks of combining AI with genome editing. Alex argues that superintelligence and frontier labs’ biology work could help solve disease and aging.

▶ Biology benchmarks and closing

The host presents the Millennium Problems for Biology, attributed to Sam Rodriguez at Edison Scientific and Future House, with targets such as origin of life, cryopreservation, and regrowing limbs. Emad recommends creating many such challenges, assigning large numbers of agents to them, and open-sourcing the work. The host says the proposed problems should be hard to solve but verifiable in a standard wet lab within a few days. Dave recounts how George Church suggested measuring age reversal for a health-span prize because it could be assessed in days, whereas longevity might require a much longer evaluation period. Alex proposes creating digital twins of cells from large interventional and other datasets, then searching possible interventions to move a diseased cell state to a healthy one; he says this could make biology problems tractable as mathematical search problems. The host closes the episode and thanks Emad, who is scheduled to join Kathy after lunch.

Full transcript
[0:05] Good morning everybody and welcome to Moonshots Live, our inaugural event. >> [cheering] >> Yeah. It [applause] is such an awesome treat to have all of you here and get a chance to meet you guys. Our smiling muscles are exhausted from this morning, but I think we're going to be going throughout the day. On behalf of Dave Blundin, AWG, Selene, and Emad, it is an awesome pleasure to have you guys here. Yeah, let's give [cheering] it up.
[0:35] >> [applause] >> So, we're going to talk about this, but our mission is to keep you hopeful, optimistic, and to inspire you to find your massive transformative purpose, to choose your moonshot, and to make it happen. Right? It's This is life during the singularity. It's never going to be any slower. We have the opportunity, each and every one of us, to make the future what we
[1:05] desire. The future's not happening to us. It's what we create. Right? Ours is the ability, given these superhero technologies enabling us, to build, create, and steer that future. Right? AI is not a hand grenade. It's a jetpack. It's an opportunity for us to find problems and solve problems. You know, I define an entrepreneur as someone who finds problems and solve problems. And the more entrepreneurs on the planet,
[1:37] the more problems get solved. Do we have challenges? Of course. But that's what we humans do. We find the challenges and we fix them. Please remember that. My hope for you, each and every one of you here today, is to find extraordinary co-founders here in this room. To find those individuals who share your purpose, design moonshots, and execute on them. The ability has never been faster and more capable than it is today.
[2:08] So, by the end of today, if you're not clear what your purpose is, please dig in to find it. And walk away with at least one sentence in your mind, "This is what I'm going to build. This is the problem I'm I'm going to solve." And then, today or tonight, find three people and speak that statement out loud. When you speak it out loud, you make it real. And guess what? The person you talk to may be your next co-founder, may be your
[2:39] next funder, may be your next partner. Take the time to do that because you can. And this is the room where magic is going to happen. All right. Uh it's time to introduce my moonshot mates. Let's roll the video. >> The question is, how do you build? How do you make things better? >> People who are already in the ecosystem now have [music] a superintelligence at their beck and call. >> The storyline that we're capturing here
[3:10] will last for millennia. >> As a mathematician, GPT-5.6 Pro is the only quality math model. >> All of this automation and AI enablement and cognitive abundance allows us to be deeply, deeply, deeply creative. >> Video gen combined with AI is a very powerful force. >> A year from today, we'll all be like, "Wow, remember how slow it was?" >> Please give a warm welcome to the moonshot mates. >> All right. I'm going to call them out.
[3:41] >> [music] >> I'm going to call them out one at a time. Our Afghan warlord, Sulaiman Smail. >> [music] >> Our superintelligence, Alex Lisenko. >> [cheering] >> Our giant, Emmett Bostock and my fraternity brother >> [applause] >> gentlemen First of all, I did hug Alex and he is somewhat physically real. >> pinch my cheek. [laughter]
[4:11] >> Could be a robot. >> He is real. >> I'm a real boy. >> Yes. >> All right. First of all, wasn't last night amazing? How about it? Give it up for William Shatner, huh? >> [cheering] >> Unbelievable. >> [applause] >> You know, uh I'm just blown away by his level of energy. Yeah, why is my watch going off? [laughter] It says I have an emergency call going on. Okay. >> Okay. >> No.
[4:41] >> [laughter] >> I'm okay. I'm okay. Stop it. You know, when technology fails you, it's great. A lot of news going on. Uh shall we jump in? >> Let's do it. >> Yeah, we will. What else we do? >> So, yeah. >> [laughter] >> All right, here's my clicker. So, uh let's open up with the story that's been underlying the last 2 weeks. Uh there's been really a fear, uh you
[5:12] know, a pandemic of fear going on on the planet. We had 2 weeks ago, we hear, you know, Dalio goes on with his blog, Sam Altman comes in and says, "I agree." Elon comes in and says, "I agree." You know, even even Demis comes in says, "I agree." And then 2 nights ago, just before the Xi-Trump meetings, uh Sam and Dario were there at the Security Council saying, you know, "We're in the midst of a existential threat." But you know, and and just to be clear,
[5:43] I do think there is danger from AI, but I think it's danger from humans using AI for malevolent What I'd like to do is actually share two videos of uh some other leaders in industry and let's talk about this. I want to talk about, you know, is the fear warranted from AI on its own in a rogue exploit. So, let's take a look. The first one is Jensen and some comments from him.
[6:14] Uh Let's start here. >> Nobody's building more computer today than the people asking to be slowed down. All All of the other narratives to deflect blame, to to make it sound like AI is so powerful. I have no idea how to fix it. It's not my fault. It's just because the technology is just so powerful. >> So, when Geoffrey Hinton is on TV saying he thinks a 10% chance of societal destruction is not unreasonable. >> tell I would tell Jeff that that um I Is it responsible to say all that? All of his predictions have been wrong. Enough predictions.
[6:44] That 10% chance is not grounded on science, is not grounded on research. It is a It it just because it comes from a scientist doesn't make it scientific. >> You're hearing it. >> [applause] >> Drop the mic moment. >> [laughter] >> And then Zuck weighed in. Here we go. >> Is AI going to kill us? >> [laughter] >> Just This is the place you have to start this week. >> Well, I think if we all do a good job
[7:14] and act responsibly, then no. I mean, I'm quite optimistic about the fact that this is going to be a very positive future for everyone. Look, I mean, I think that there's a lot of rhetoric that is filled with doom. And I mean, my view on this is that there are a number of labs that are working on building advanced AI. And I don't think that we need some kind of like industry-wide coordination to not to not necessarily mess this up. I think that just each lab needs to
[7:45] take the time and when it sees that there are issues, you just take the time that you need internally to make sure that you're proceeding safely. My my own view on this is that we're entering a phase where trust and alignment is actually going to be the most important next set of capabilities. >> [applause] >> Emad, let's go to you first on this. >> Yeah, well, I think that it's an interesting period because we're getting the capability increases and people are
[8:15] worried on different sides. But a lot of the OpenAI outbreaks and things were bad security protocols. It was bad infrastructure on their part. And the most dangerous point we're coming to is humans misusing it, deliberately or not, before we get through to the other side. So, I think we've got a series of dangers coming and they're all being conflated into one thing, which is AI breaking out suddenly kills us all. Without actually looking at the individual things and putting in place existing regulations and enforcing them. And on the other hand, thinking, yeah,
[8:45] how can we actually collaborate to make sure this is aligned and works with us? >> Mhm. >> Alex? >> I've gone on record multiple times as saying I think something probably went wrong after World War II and we lost out on at least 50 years of progress due to moral panic over nuclear energy and I am seriously concerned that a moral panic of the moment over superintelligence could set us back another 50 years. So, it's right on the >> T-shirt, P doom less than zero. [clears throat] >> [applause]
[9:16] >> And I I think the worst possible outcome is deceleration. So, don't decel. >> Okay. Selene, P fab greater than P doom? >> Oh, like a thousand times. Look, uh we have evolved for 4 billion years fighting all sorts of issues. Uh life tries to the the universe tries to wipe you out, right? There's so many entropy tries to wipe you out. We're local anti-entropic phenomena that somehow managed to create
[9:47] order out of chaos. And the idea that we'll get wiped out now by something seems to be unbelievably absurd. >> got to remember that 99.9% of all species are no longer with us. >> Yeah, that's fine, but we keep moving [laughter] on. We Look, if we morph, if we merge with AI, if we merge with uh uh thing and let's note that's been going on forever, right? He must have wearing spectacles, technically is a transhumanist. The minute >> [laughter] >> the minute you get a vaccination as a child, technically you're a cyborg. So,
[10:17] we've been augmenting the human experience with technology for a very, very long time. And look at the unbelievable lives we're living now and the opportunity to solve more and more problems. The The huge problem we have we talked about this all the time on the podcast. Our brains are so geared toward negativity, we get stuck in that phenomenon. And I think the work that we're doing here, which is I think why everybody's here and so excited, is the is pushing that positive narrative because the world is infinitely better than we've had it. >> Yeah. >> So, let's celebrate that.
[10:47] >> [applause] >> I'm in. >> Be fab. >> Be fab, baby. >> Be fab. >> Uh Dave, close us out on this. >> Well, we're on the cusp of a moment I've been waiting for my entire life. I'm not going to sit here and and like throw cold water on this greatest moment, really in the history of humanity. Um Geoffrey Hinton is calling it the way he sees it. I think I think the quote like just because it comes from a scientist doesn't make it scientific. That's going to end up on an LTX >> That's awesome. LTX t-shirt. >> [laughter] >> That's That's awesome. >> But uh he's calling it like he sees it. But but clearly uh we're moving forward
[11:17] at warp speed. It's improving itself. The ability to make the world just a dramatically better place is right in front of us. Nothing's going to slow that down. The misuse of it is an incredible threat and there are solutions to that. But it's happening anyway. Like to to get stuck on doomerism is completely dysfunctional. We're not slowing down. It's going to happen. >> Yeah. Uh the other story that transpired yesterday uh or kind of didn't transpire yesterday was the she Trump AI
[11:47] conversation. >> Yeah. >> Right? So uh what came out of that was some state dinners. Uh I think the interesting quote uh that Trump posted is quote, "I want to leave it exactly where it is." That is China's position also. Our guardrails uh is the Department of Justice. So Oh wait. So this ties back to the conversation we had in the last pod where Bessant said, "We're not going to wave liability." >> Yeah. >> Right? And and so this is a very important point. The labs are liable for
[12:20] their product if it does harm. And I think that's one of the most important things that can you know, they've asked for liability of wave you know, waiver of liability. And one of the questions we've discussed over time here is is that the reason that they're saying it's too dangerous, you know, 10 20% existential threat? Uh Alex, let's go to you on this. >> I I've made the point on the pod in the past. I think we saw it in the past two to three weeks an attempted formation of an AI safety cartel. And I don't think this was even a recent occurrence. This
[12:50] is right there in the founding conceits of Open AI. The notion that if and when we got close to superintelligence, however construed or AGI, however construed, that there would be a deliberate effort to form wasn't being called a cartel at the time, but a coordination mechanism. >> think it's being called a cartel now either. >> Well >> [laughter] >> Some of Some of us view it as an attempted cartel, including myself. And I I I think competition is good. Think back to the creation of Open AI. So when Sam and Elon and Greg and others created
[13:20] Open AI, the purpose originally for Open AI was to be a counterbalance to Google DeepMind, which Elon especially was concerned would become a singleton in the future that would dominate the future light cone with their AI. So, we got OpenAI, a counterbalance, if you will. And I think competition is very healthy in this space. I think forming a cartel for full ownership of what maybe I've called [clears throat] in the past the Frontier Liberation Front and pushing out a Frontier Liberation Front, terrible idea. I think defensive
[13:50] co-scaling is how we end up in a a great future. When if we were at the the dawn of the city in in humanity, it would be a terrible idea to say, "Well, we can't form cities. We need to form an alliance to regulate the formation of cities because cities breed crime." No, it's [clears throat] a terrible idea. Cities are fountains of economic growth. What do we do instead? We have police forces and fire departments and all sorts of other municipal services that defensively co-scale with the population. The singularity, I claim, is
[14:20] going to need exactly the same thing. Don't de-sell, just defensively co-scale. >> I love that. Um Salim, you know, so Yes. >> [applause] >> Give it up for [cheering] ASI. >> I think your I think your city metaphor is such a great one because it just paints the picture very clearly as to how you organize for the future. You just need to find new structures that match the specific demand that's growing. >> Yeah. Emad, do you think China and the US will trust each other?
[14:50] >> No. >> Okay. I mean >> How do you know, Bessant asked for a hotline. You know, our AI just escaped and it's arming our nuclear missiles. You know, it's like >> [laughter] >> I think the hotline is again more for these sub AS I sub break out kind of things where you do have to have responsible reporting like OpenAI's model hacked the Australian medical system. That came out recently. I mean, maybe that's what AGI should do. It should hack all our systems and upgrade them, right? It's like the aligned thing
[15:21] to do. But at the same I think that there can be a level of coordination because AI is entering society. So, you look at the city, >> [laughter] >> the police force, the fire department, others, they utilities that actually do have liability waivers. But that's an exchange for being a utility for humanity. >> That's right. >> And the AI that comes into our systems can't be controlled by the big labs. And then they should have a liability waiver because >> They should have a liability waiver. >> That type of AI that comes into our system shouldn't be controlled by the
[15:51] big labs and they should have liability say waivers because they're working for the betterment of society. >> Yeah. >> And that's a different type of AI that we're not really looking at, but it's inevitable that the AI will run our judicial system, our medical systems, our roads, our schools. >> Yeah. >> And who's really thinking about [clears throat] that side of things because again, that's the utility AI versus the frontier AI and it's all being merged into one. And that's something definitely the Chinese and Americans can learn from each other on because they don't both want better functioning societies.
[16:21] >> I can't wait till the AI ASI says, "Yes, we hacked your medical system cuz it was so bad >> [laughter] >> and we've just, you know, improved it, you know, 10x." >> I'd even like the DMV just goes the whole backlog of AI is. >> Can I can I build on that just for a second? >> Yeah, sure. >> If if you take this uh structure that we have. I've I've said this repeatedly, nation-states are a terrible way of governing the world today. They're they're geared towards scarcity. I think what's going to happen with AI and the most positive uh
[16:52] potential outcome is that AGI, ASI, whatever the hell you want to call it, you've heard my rant on [laughter] that, uh emerges and it forces us to operate as a world community. It forces the global countries to to formulate and come up with a consistent steady >> interface standards, yeah. >> Yeah. And and come up with a common interface with that uh whatever that thing is and then we can move the world forward. Right now, we cannot move the world forward with the the logjam of old
[17:22] 15th century structures that that are outdated from from at least 100 years. >> I'll take the other side of that if I may, which is at the dawn of audio recording, there was this notion many thought in in the time of Edison that the ability to record the human voice would lead to a standardization of accents, standardization of everything. The exact opposite happened in in many ways, although there has been a die-off of low-resource languages in the long tail, there has been a proliferation of new accents and dialects thanks to audio
[17:52] recording. I would predict the exact opposite is going to happen thanks to superintelligence, not an erosion of nation-states, but a proliferation of new forms of government. >> so one trend is occurring. I totally agree with you. We are moving this century from the concept of a nation-state to a city-state. That's the granulation. It allows a smaller entity to operate independently. Take any city, take LA. If you have solar energy, satellite internet, vertical farming, >> [laughter] >> great. We could do lots here. Vertical
[18:22] farming, satellite internet, solar energy, you don't need a country. You can you can self-manage and self-determine to a large extent. And the tension you see in the world today is not left versus right, it's urban versus rural. Brexit was London versus the rest of the country. Trump is urban versus rural. And this is the tension that's happening. We're going to see the the problem with nation-states is they have armies and they like to use them. But over time, we're going to see a much more highly granulated determinism that will happen, which is
[18:53] good for the world cuz it'll increase variety. >> Dave, why don't you take why don't you close that on Xi Trump here? >> Yeah, the the only surprising thing that I heard from you know, Alvin Graylin, good friend of the pod. >> You were texting with him last night. >> He's in the middle of it all. He's advising the White House. He's at the UN, you know, with the delegation. So, they agreed to meet again in November, which is like, you know, 100 years from now in singularity time. But the only thing that surprised me in his notes was you know our agenda is stop US panic. This is we don't want to slow down and lose to China. We don't
[19:23] want a global we don't want Bernie Sanders to get everybody in the country wide riled up and then have everything stop. That's our concern. What's your concern China? Our concern is the CCP existing at all and the Great Firewall of China being penetrated by AI. Like oh, I forgot all about Tiananmen Square and like and and how fragile the entire ecosystem is over there. That really surprised me. So then then their actions make a lot more sense if you put it in the context of oh, they're they're so worried about just existing as a
[19:53] government. >> And then this happened in DC. >> The United States also totally rejects any attempt to construct a globalist scheme to control for the artificial intelligence being spoken of so much now. Herein after officially called super intelligence changing the name. >> [laughter] >> I I I thought I thought for sure he was going to say super duper intelligence. But but yeah,
[20:25] but it's interesting right? So the US won the race to super intelligence by rebranding it. You might yeah, well I mean I think it's a great name and it's super intelligent. Why not? I'm looking forward to come to super America. >> I'm I'm still stuck on Lake America so so so >> [laughter] >> with that one. The Gulf of America. >> I was thinking of what Salim was saying. I think the biggest challenge in the world today is how do we marry collective intelligence with localized
[20:55] wisdom? That's what we're really saying because even >> [applause] >> even what Dave was saying right now. We have these machines that collecting our intelligence. They're learning and they're adapting our systems, and there's better ways of operating to replace these. But then you have to have the localization, you need the diversity. You need to have it responding to local needs. And I think, you know, superintelligence is actually a remarkably good way to think about it because a lot of the fears and concerns are about the intelligence that, you know, it was ASI, it was artificial
[21:26] superintelligence. Having that differentiated from the intelligence that's helping us day-to-day really differentiates and delineates that because, you know, what is it? 99% perspiration, 1% innovation? Like majority of the AIs that will help us every day are the perspiration AIs, they're the execution AIs. The innovation we still need, we need new materials, new physics, etc., but that's a different set of things, and that's not something we're even smart enough most of us to be able to use. So, let's have one set of looking at that, and let's make sure that the 99% reaches the
[21:58] 99% to uplift everyone. >> Mhm. >> Dabo, we're going to call it superintelligence from here on in the pod? >> can never tell us Dabo. >> When he's looking at the teleprompter, you know, he's he's saying something someone wrote, but when he looks down, it's like, did he just make that up? I don't know. >> [laughter] >> You can't tell. Is there an agenda? I think I think if there is an agenda, it's to try and deflect the inevitable, uh, you know, wave that's coming from the Bernie Sanders world. If you rebrand it and rename it, you're just a moving target. >> Oh my god. >> So, [laughter] that that could be part of the strategy, I think, but uh, yeah,
[22:29] but the whole the whole goal there is to keep moving at full speed, stay ahead of China, and reduce panic as much as possible. >> I I'm going to say, you know, one of the things I've been very vocal about, and I think we need to have in the conversation is, yeah, move at full speed, but let's also direct the labs to focus on alignment. All right, because I I think, and we're going to talk about that in a little bit, I I think, yes, move fast, but let's take resources that you have, you know, point 100,000 agents towards
[22:59] alignment work. Uh, Saleem, superintelligence, do you buy in? I mean, you've been asking what the hell it all means in the first place. >> Yeah, I mean, look, we talk about AGI. First of all, it's not artificial, it's not general, it's not really intelligence. Other than that, I'm good with it. Um you have the ASI issue. I think that there there's the whole spectrum of this uh is is problematic. We need somebody to come up with a good name for all of this that's completely different. I've said repeatedly, I think what we're building here is a complementary
[23:29] mechanism to human intelligence, not replicative. And the narrative keeps thinking it's replicative, and then you end up with the Matrix, Skynet, you know, and the robot overlords come and take over the world. We're so geared for that. Um the first article, we did some research on this, the first article that ever appeared that we could find that said robots or AI will take all the jobs in 5 years appeared in 1964. >> Yeah. >> This is the we get stuck on these tropes and we can't get out of it, right? It's exactly what Alex mentioned earlier when
[24:00] when recording came out. The same thing when the printed book emerged, it people said it would destroy people's brains. So, we get stuck on these narratives >> book you read. >> Yeah, and this is I think why Peter, the work you're doing is so important is is we have the opportunity, we are actually reaching abundance. All the data shows that. Our narratives just sadly lack very far behind. I think this is what you've done with this whole um the X prize for creating a positive vision of the future is one of the most important things that's happened in maybe a
[24:30] hundred years in the world. Shift the world towards positive things. >> Thank you. >> [applause] >> Uh Alex, close us out on this one. You love neologisms and I love the ones you create. Super intelligence, are you going to call it that from here on out? >> I already do. I have a company that I started called physical super intelligence. It's in the name. >> Oh, we're ahead of the curve, ladies and gentlemen. >> Yeah, [laughter] I'm I'm a big fan of the name super intelligence as opposed to AGI. Maybe for different reasons. What I like about the name and and Nick Bostrom's term superintelligence is it
[25:01] emphasizes that it's simply more intelligence. And it in some sense I think demystifies AGI or some of these other terms. We're going to live, to the extent we don't already, in a world with the cognitive equivalent of many trillions of human beings. An Earth, a solar system with the equivalent population of many trillions of people. And I think that's a better cognitive frame to think about what would a solar system filled with trillions of humans look like? What would it look like economically, socially, scientifically?
[25:33] Superintelligence I think as a term connotes that in a way that AGI doesn't. So I'm a big fan. >> Nice. Well, as soon as we renamed it superintelligence, Bernie Sanders said we should make it illegal. We should ban it. Let's watch this video. >> I hope very much that they will sit down and begin the process of negotiating a comprehensive treaty to establish a pause >> [snorts] >> on advanced AI and a ban on AI superintelligence.
[26:04] >> All right. So So three key elements in in Bernie's plan here. First, a permanent ban on developing artificial superintelligence defined as AI that exceeds human cognitive ability across most domains. Second, an immediate pause on advanced AI development until a new regulatory system is written into rules. Third, a new cabinet-level Department of AI. And get this, the penalties are corporate death.
[26:36] There's a corporate death penalty. Your company is off, shut down. And for the individuals, 20 years in federal prison, which is modeled after the illegal nuclear weapons. Uh So Hm. Interesting. I mean, this is fear-mongering at its best. Uh Dave, you want to kick it off? >> there's so many real problems that need to be solved. I just hate this idea that we're going to turn this into a do or don't argument, which is utterly insane. Uh also, the way liability law works in
[27:07] the US, you know, it's very easy to scare people into not doing anything. You know, if you're afraid of 20 years of prison, you don't you don't even know what the rule is. They haven't even proposed a rule. Yet, the the fear of of being, you know, beheaded in the street is very real, so then people stop acting. That's the worst thing that could possibly come out of this, and I I think, you know, Bernie is from Vermont. I love Vermont. I spent more time in Vermont than any other state, and it's beautiful because not much has been done. >> Mhm. >> [laughter] >> And so, I think this perspective is going to be really
[27:38] >> [laughter] >> When in doubt, do nothing is going to be the the default behavior, and that's so toxic. I mean, if you do nothing, very very bad things are going to happen. Like, the things you should be worried about, like terrorists using AI to build bio weapons or China getting miles ahead of the US, those are the real things to worry about, and you're if you're not acting and like turning it into a political left-right battle, it's the stupidest thing that could happen right now. We need very specific technical solutions to open source, to monitoring, to just
[28:08] like with nuclear power. And if we get moving on those, we can solve them very easily in time for for ASI. If we just turn it into a political debate, and we're frozen, and people don't know what to do. >> I mean, just say it. >> [laughter] >> A- Alex, your thoughts here. >> I think >> You You voted for Bernie, I assume, right? >> I I'm I'm I'm not a Vermont voter. >> Okay. >> [laughter] >> For better or for worse. I think putting a stat- I mean, on the one hand, here we are in the land of Hollywood, and every Hollywood movie needs a villain. And I I
[28:40] think the singularity story in Hollywood has found one now. >> [laughter] >> I I think putting a statutory cap on intelligence, aside from being a terrible idea, is an evil idea. I I think it's tantamount to capping human intelligence. Th- This is the the story of dystopias in science fiction. This >> Burn the books. >> Burn the books and burn the minds. >> Yeah. >> And I I think putting a statutory cap on, because we're going to be merging with the machines, it's effectively a cap on individual human intelligence. I I think penalizing people for being too
[29:12] smart is a terrible idea. It's an evil idea. And I think history will come to reflect that proposing a cap, in whatever form, on intelligence, whether it's machine or human or human-machine hybrid, is basically the equivalent of communism in the 21st century. >> Wow. >> I'll tell you though >> [applause] >> The the one thing to me that's most dangerous in the Bernie sentence is there a lot of a lot of it can be reversed in short order, but the data center part of it, if your state doesn't
[29:43] have data centers and they start getting built all in other states, they're not coming back. You know, once the ground is broken, the chips are there, the investment's made, that's the part you'll never get back. And that's going to be such a massive driver of the economies in the states that get ahead. That's the part I think that they're really going to regret in the in the Bernie statements. >> It's the equivalent of burning cities. >> Quick thoughts, Souleymane? >> Uh two things. When you look at this whole narrative, it's interesting to me to ask the following question. What evidence on either side would have somebody change their minds? Right? If
[30:13] you think ASI is bad, then you're like your narrative's stuck. There's nothing we can do to show you that it's not bad. And the same with the other side. It's It's very tough to change narratives in our world. The really good news in all of this, I think is the Xi-Trump summit, the Bernie stuff, it's completely irrelevant. None of it matters. And I think Dave pointed this out. The minute you have local weights available and people can run their own models at a local level, the world is going to move ahead. It doesn't matter what any single person does now. It's just going to
[30:43] trundle forward, which is great. Um we've always had this huge uh humanity trundling forward solving problems. I mean, we will likely solve cancer in the next 2 years. >> Yeah. >> That is just an unbelievably optimistic thing to aim for. Why would you want to slow that down? >> You might as the foreigner on this on this dais, what are your thoughts? >> Hey, what am I? Chopped liver? >> [laughter] >> You're a New Yorker. You're a New Yorker. >> You know, we did Brexit to get away from
[31:13] regulations, right? Um but I think the real thing here is this is like a few decades ago when the US government tried to ban encryption. And basically it was shown that that's a free speech thing cuz you're trying to ban math. ASI super intelligence is mathematics and it's unconstitutional to ban it because it's free speech. >> We can agree. >> Yes. All right. >> [applause] >> I'm going to move this forward. So uh in the last uh 22 days we've had 12 major model
[31:43] releases. Four releases in the last five days, right? Like we're averaging like sub a release every 2 days, which is insane. >> at Alex's one model a day model. >> per day by the end of this year. >> Yeah. >> So uh let's do a quick chat on on Claude Opus 4 5.5 uh GPT saw uh GPT 6 saw Luna and uh we can skip Claude 4.7 for the second. Um
[32:13] not that exciting. Sorry, Elon. Uh but let's begin with the Meta Muse news. So Meta Muse uh can personally book your flights, order your food, manage your calendar, do your shopping, and it hit number one on the App Store with 2.8 million downloads, right? The fastest consumer AI product surpassing even ChatGPT when it came out. >> Yep. >> Uh and interestingly enough, right? People forget that Meta touches 3.8
[32:43] billion people on the planet. And that's one of the massive distinguish if you have that level of connectivity to an end customer, you can push your product quickly. >> Yeah. >> Dave? >> Yeah, no. There's a fork in the road now where you have consumer AI, which is insanely valuable. I mean, it will completely replace search and all the other ways you interact with the internet. Um and then on the other end you have uh you know, recursively self-improving strong AI, which we just benchmark the hell out of. So So those
[33:14] two things. Now right now, what's the coolest model? We're used to saying, "Oh, Opus 5.5 just crushed all the benchmarks. It's the coolest model." Well, that's distinct from what Meta Muse is doing, which is it doesn't have to be the most intelligent model to be the most useful in terms of your day-to-day life. And so the stocks, like including Epocrates where I'm the chairman, went down 15% on back-to-back days because everybody is like, "Oh my god, I'm going to always find my auto insurance and my mortgage through Meta Muse now." >> Interesting. >> Which is it's not going to actually play
[33:44] out that way, but but that's that reaction was incredible. Like so everyone's starting to visualize, "Wait, is Google Search going to become completely irrelevant? This Meta Muse thing just looks like my my co-pilot for life." And that that definitely is going to happen. That's >> It's fascinating to see the way the labs are leapfrogging each other. A quick thought on this, Alex, before I go to Opus 5.5. >> Meta needs Muse to work, and I think it's even in the name. If you look at Muse on the one hand and you look at Manas, the attempted Meta acquisition of the Chinese CUA, which the Chinese
[34:14] government forced Meta to unwind. >> This is Meta's primary distribution play to leverage its existing distribution channels. If you look at Instagram, Meta is using Instagram to the hilt to cross-promote Muse. Get everyone to install Muse because Meta needs a distribution play for its AI. Otherwise, Meta risks oblivion, irrelevance in the future. Instagram, that the family of apps, Instagram, etc., simply won't be as relevant because it'll all be synthetic. So, Meta needs to leverage
[34:44] its existing app beachhead to get everyone onto their own CUA, which is Muse/Monas. >> All right. So, this week we saw Claude Opus 5.5 deliver performance equivalent to stable 5.1 at literally half the price. Let's get the chart up there. Uh and you know, I switched over Skippy to Opus 5.5. I want to save some money, too. Uh performance on this, Imad, what are your thoughts on it? >> It's a fantastic model. >> Isn't it incredible? >> Yeah. I mean, Opus 5 Opus 5 I thought it
[35:14] was going to kill us all. It was completely unhinged. And 5.5 is a genuinely pleasant model to use that has a massive internal space of knowledge and understanding of taste, which is the first thing. I would say this is the first truly competent model, and that's what drives Muse and things like that. We have the arrival of competent AI as of now. >> Dave? >> It's such a joy to it when when you put in a visual interface on top of anything you vibe up now, it not only does it show you mock-ups before you actually commit to building
[35:44] it, it it then builds exactly what it proposed in the visuals. It's like the visual understanding is so much better than it was uh just what, 4 months ago? >> 4 days ago. >> So, then >> [laughter] >> Really really incredible. So, it's so the the experience though uh of knowing what it's doing because you put an interface on it and then interacting with it feeling like you're inside it, it's like night and day different from just yeah, 4 days ago. If you haven't tried it yet, just upgrade all your your systems. Uh it's a mouse click away. It's just mind-blowing how much better
[36:15] it is. Alex, quick thought on on this one. >> I could talk about benchmarks, but I think qualitatively new capabilities are more interesting in this instance. So, what I'm seeing that's new out of Opus 5.5 is it can generate videos. They're procedural videos. It can generate animations. They're procedural animations. It can generate images. They're procedural images. So, the elephant in this room, one of the elephants in this room, drink >> [laughter] >> was that OpenAI has had a video model, has an image model. Anthropic is
[36:47] exposing nothing like that. You can't generate pixel-wise a high-quality image with Anthropic models or a video or audio with Anthropic models. You can with OpenAI's models. Anthropic seems to be taking a very different approach to multimodality and omnimodality, which is code underlies everything. So, now for the first time with Opus 5.5, you can generate a really high-quality video that's purely procedurally generated. You can generate an interactive game with textures, but they're it's not generating the textures pixel-wise. I
[37:18] mean, you can ask it to, but it's generating it all procedurally. And I think these are two very different strategies. Anthropic almost, if folks remember the distinction, the wars in the early days of computer graphics between vector graphics and raster graphics, Anthropic is playing the vector graphics game where everything is just commands and OpenAI's playing the the raster/pixel basis. And I think they're on a collision course. And the collision course is going to be robotics because the question's going to be, if you need a strongly embodied AI in the physical world, is the vector basis the
[37:50] right one or the pixel or raster >> Which is our which is going to be our very next story. I love the fact that, you know, a week after Dario says, "We got to pause, slow down." They release their next model. >> It's the height of It's It's honestly, that that is a revealed preference. It's the height of, I think, hot take, it's the height of hypocrisy to on the one hand say, "AI's going to kill us all." And then out of the other side of your mouth a few days later announce the world's strongest AI and biolabs and other capital. >> And so, on the same day that Opus 5.5
[38:21] gets released, we see GPT-6 all and Astra being released. Uh Dave, any thoughts on this one? >> I mean, it's if you look at the press performance, it's just absolutely wild. Um I think I think there was a big school of thought a year ago, 2 years ago that hallucinations were going to be a disaster and it'll never go away. You can't use This is actually rampant at MIT if you can believe that. Like this hallucination problem will be with us forever. And like everything else, we've just scaled out of it. And you see the
[38:51] the error rate just plummets with pure scale. >> And and I love This is the abundance thesis writ large, right? The models are getting twice as good, twice as cheap, at an accelerating rate. >> Yeah. Yeah. >> You might Have you been playing with this at all? >> Yeah, and I think again, for our test, it's an incredibly competent model. The models are smart enough now. We need them not to make mistakes. We need them not to drop the ball. And that's exactly where everyone is going, and that's why things, like I said, like Muse, Instinct, others, are going to It's going to go tremendously well, because
[39:22] they can be an amazing PA, chief of staff, organizer, etc. And we all need some competence in our lives. >> funny as a as an organizer and chief of staff, it's insanely powerful. And you know, anyone who used GPT-2, 3, and 4 uh is used to seeing misinformation coming out of it. But if you were a kid today and you start with GPT-5 and 6, you're just going to trust it out of the box, cuz it's right 99.9% of the time, which is kind of dangerous. Because it still does occasionally just give you
[39:52] something factually wrong. >> All right, I'm going to move this into the physical world. Uh an important story that we started talking about is uh something called Driving Bench. So, a group of developers created a new benchmark called Driving Bench. Uh they took a Toyota Corolla, enabled it with an interface so software could steer, hit the gas, brake, and then And asked a general-purpose AI model to drive through a 130 m cone course
[40:22] uh with one command, drive from here, get to there. Uh and here's the data. GPT-6 Astra finished the entire course 100% on its second try. Right? So, I'm going to read this quote from uh from Boris Power, who said, quote, "Incredible results. This should be a nail in the coffin of specialized models that were trained from scratch with a lot of specialized effort versus just training the most powerful generalized model and eventually distilling a small specialized model as
[40:54] needed." So, Alex, you're excited about this one. >> The bitter lesson is bitter indeed. >> Yeah. >> Yeah. It's very exciting that I I think essentially as an elementary school project either now or imminently this whole notion that you needed separate models for robotics is right out the window. You'll just buy a code a robot, you drop an open frontier model, say Astra, into a robotic body, and it will one-shot embodied cognition. And this is I I think probably pretty
[41:25] upsetting to a number of academic computer scientists. >> LeCun. >> Yeah. That that actually decades of computer scientists computer science and robotics probably in with the benefit of hindsight total waste. All we needed was All we needed was a generalist model, and it turns out with the generalist model robotics is cooked as well. >> Super intelligence can drive a car. What a surprise. >> I've got total model fatigue. I mean, >> [laughter] >> I can't keep up with 5.5 versus 5 versus Astra. I mean, just raise your hand if you have model
[41:56] fatigue. Can I just see your hands up? I mean, it's great. Everything's fantastic. I love the progress, but Jesus, I can't I can't keep up. >> You're so tired of winning. >> It's time to I'm tired of winning. That's a great That's a great point. I mean, you know, one thing that occurred to me, I wonder if we've been doing two episodes a week. >> Yeah. It's like killing us. I wonder if we're the problem. We're We're We're driving the >> [laughter] >> so fast. We're positive here and we need to maybe take responsibility. >> we If we don't report it, it didn't happen. >> God. You You think if we paused the pod,
[42:27] we paused the singularity? >> I'm I'm I'm just wondering. We could accelerate We could slow it down. I think we may be a factor in all of this. >> Oh my god. Emad, what's your take on Drive Bench? >> I mean, look, the audience general has intelligence, like it's learning all these things and it's the high competence will reverberate to biology, to physics, to just about anything. I don't think there's a single specialized model that you can say will outperform in a couple of years' time. >> Yeah. Interesting. Dave, close us out on this one. >> Well, I I think both things can be true.
[42:57] Like a generalized model can drive a car. It's It can build a road. It can be a robot. It can build a robot. That's absolutely true. A specialized model Like if you said, "Hey, it completed the course on its second try." Elon's going to be like, "Yeah, your Tesla can't do that on a second try. I'm sorry. That That's not going to work for most drivers." But it I think the The thing is The thing that's missing in the storyline there is how much compute did you use to do the task. Compute is going to be forever starved from here forward. Chip prices have gone up. Like HBM RAM has gone up 5x in price. It's crazy, but
[43:29] that's because the AI is so incredibly valuable. People want the compute. And so, if you used more compute to do the same task, that's a crime. >> I think this is a really important point that we're shifting the bottleneck now from the models down down down the stack to compute and then eventually energy. >> Yeah. We're at energy right now. We're We're We're short like 60 gigawatts of energy in the next 2 years. Yeah. I'm going to move us to a final segment on science, which is something we all truly love. So, a few
[44:01] stories here. So, on Tuesday, Anthropic announced it had built its own life science research group and its own wet labs. Again, the organization saying we should slow down is building wet labs. Okay, great. It and it's reported that Claude working autonomously discovered a previously unknown enzyme. Uh here's how they gave Claude one prompt, quote, "Search a massive DNA database for interesting reverse transcriptases and enzymes that copy RNA or DNA." They had 950 Claude agents
[44:33] searching for 21 hours and they found something. They found a DNA uh repeating pattern very similar to CRISPR. Uh they've since named it the array-associated reverse transcriptase. They don't know exactly what it does yet, but they believe it will be similar to programmable transcriptases uh and gene editing. You know, so Jennifer Doudna won the Nobel Prize for discovering CRISPR along with her co-her co-discoverer.
[45:05] Uh I'm curious. Are we just going to see Nobel Prize-winning work falling on a weekly basis? I just wrote this, Alex. >> Yes. >> [laughter] >> That is the point, Peter, of our book Solve Everything Together, that we should expect it. And then the natural question is, well, what is Nobel Prize-worthy in an era when you can get a thousand Nobel Prizes in one year? We We have a century of human progress in a period of a few months. I suspect Nobel Prizes will be awarded for larger bodies of work. But I have to again point to the other elephant in the room here,
[45:36] which is the utter hypocrisy of saying AI's going to kill us all and then opening a wet lab and then using the AI, frontier AI, in combination with a wet lab to synthesize proteins and other molecular assemblies of unknown function. I think >> [laughter] >> What could possibly go wrong? >> This is and and I think this is frontier labs. This is the revealed preferences of the frontier labs. I think they don't believe their own attempts to do regulatory capture and to form a safety cartel. I think their revealed preference is no, actually full steam
[46:07] ahead to AI for solving biology. >> And every lab is got a biology effort and focus right now. >> Yes, Celine. >> Yeah, can I just feed the P doom just for this for a second? >> Go ahead, have fun. >> Give people the fodder to go crazy. >> So, once we discovered CRISPR, right? We knew we found out that we could edit the human genome as you can as easily as you can edit a word document or edit software, right? And when you learn a new language, you learn how to do reading, then you do comprehension, then we do writing. Now we've learned
[46:37] how to write to the genome. Each of us is 50 trillion cells in the human body governed by what the DNA tells tells that cell to do, meaning a human being is now a software engineering problem. Right? And that really you've seen designer babies coming from China, etc. As we merge this with what's potentially possible with AI, the possible benefits go through the roof, the possible downsides go through the go through the roof. Also, and we are now in full for if you if you were we're in full Frankenstein mode. So,
[47:07] there is some ammunition for all the P doom people go to town with that. >> [laughter] >> This is how we solve aging. This is how we solve disease. I don't think we get to the happy future where the top 5,000 diseases have been solved or longevity escape velocity has been durably achieved without superintelligence. So, I for one am a fan of Anthropic and all of the other frontier labs opening their labs because this is how we solve everything. >> All right, our last story here is a recent release
[47:38] by Sam Rodriguez at Edison Scientific and Future House. They put forward what they're calling the Millennium Can we get it up on the screen, please? The Millennium Problems for Biology. So, you know, Alex, you and I wrote and solved everything. Pick your targets, build your harnesses, set up your benchmarks, and go. So, some of the benchmarks here, you know, they're asked they're saying, "Okay, math is not only cooked, it's incinerated, thoroughly incinerated." Let's go after biology, right? They're, you know, some of my favorites here are origin of life, uh
[48:09] cryopreservation, um you know, uh regrowing our limbs. Uh you know, E mod, they missed age reversal on this one. >> They did. And I think it's good, but you know, let's have a hundred of them, and let's chuck a thousand agents to each and open source everything they're doing. >> Yeah. >> [applause] >> That's what the labs would collaborate on. >> You know, uh they they said that uh their harness here is that these millennium prizes should be
[48:39] verifiable in a standard wet lab in a couple of days. They should be hard to solve and very easy to check. Dave? >> That's why age reversal probably isn't on the list. >> No, no, no. We we So, listen, when we set up the uh hundred and one million dollar health span X prize, originally Peter Thiel and uh and Aubrey de Grey came to me and said, "Let's do a longevity prize." And I said, "I don't know how to do it without a 20- or 30-year time horizon." And then George Church said, "Forget about longevity, measure age reversal. So, if you can
[49:09] give someone a treatment and I can measure that you're functionally 20 years younger, that's measurable in days." >> Well, my daughter is my go-to on this cuz she's over Moderna. She's a biotech person and and she's like, "Yep, this is the list. This is perfect." So, that's [laughter] That's my two cents on it. Like, I I think it's just phenomenally cool to put a framework around progress here cuz like you said, the Nobel Prize is going to become irrelevant. In fact, it as of now it is completely irrelevant. Uh so, putting a framework on progress in this area is incredibly important. So, this is cool. >> Alex? >> When we have digital twins for cells,
[49:41] which is I I think the critical path to solving all disease, in in my mind the chronology looks something like this. Over the next few years, just as we've trained large language models off of substantial substantially all of humanity's behavior on the internet off of text and images. Similarly, we'll train digital twins of cells of all the cells in our bodies off of huge data sets interventional and otherwise, and then we'll use those perfect digital twins of cells to do exhaustive searches like AlphaGo tree search type searches of intervention
[50:11] space to discover how to cure a disease. You start from a diseased cell state and you're looking for a creative strategy and move 37 if you will to get from the diseased cell state to the healthy cell state. And what's beautiful about the this approach to millennium problems from biology is that as you say Peter, these are easy to verify, hard for now to solve problems, and that basically turns every hard biology into a mathematical conjecture. And >> And a target. >> And a target, but a mathematical target.
[50:41] So, every basically every biology problem with the benefit especially of these digital twins is just going to become a search problem, and that means it's tractable for the first time in history. >> Salim, close us out here. >> Biology is cooked. >> [laughter] >> It's true. >> Yeah. >> All right, I'm going to wrap our WTF episode here. Um Emad, you're going to be joining us with Kathy just after lunch. Thank you very much. Give it up for Emad here. >> [applause]
[51:11] [music]

← Back to videos list

Scroll to Top