AI 内幕:就业末日、自主武器与超级智能的乌托邦 The Diary Of A CEO 2026-06-01

民主的幻灭与AI的真相

[莫·加瓦特]: 我们有视频证据显示有人虐待儿童,却没有一个人被逮捕。你怎么能称之为民主?所以,人类正处于一个十字路口,我们有史以来第一次需要醒悟过来,意识到我们被一群疯子统治着,我们相信的民主不是民主,我们知道的事实也不是真相。公司和政府会把他们造成的地缘政治和经济挑战归咎于AI,但事实是,AI不是敌人。我不担心AI会反过来对付我们。我担心的是人类命令AI来对付我们。就像我在谷歌工作时,我们建造了很棒的东西,相信我们在让世界变得更好。我们确实做到了。但后来突然有一个时刻,你意识到世界可能不会按照你想要的方式使用你创造的东西。可悲的是,这一刻已经来临。

Original English

[Mo Gawdat]: We have video evidence of people abusing children and not a single person got arrested. How can you call that a democracy? So, humanity is at a crossroads where for the first time ever we need to wake up and realize that we're ruled by maniacs and what we believe is democracy is not democracy and what we know is not the truth. Like companies and governments will blame the geopolitical and economic challenges we have on AI but the truth is AI is not the enemy. Like I'm not worried about AI turning against us. I'm worried about humans telling AI to turn against us. Like when I worked at Google, we were building amazing things believing that we were making the world a better place. And we were. But then suddenly there is a moment where you recognize that maybe the world will not use what you're making the way you want it to be used. And sadly this is upon us.

[史蒂芬·巴特利特]: 所以我有很多问题。

[莫·加瓦特]: 好的,那很好。

[史蒂芬·巴特利特]: 那么,你对这个就业颠覆点怎么看?这些非常智能的模型,连它们的创造者自己都不理解,风险在哪里?你认为山姆·奥尔特曼是亲人类的吗?在激励机制如此高度竞争的情况下,我们如何达到一个合乎道德的AI?然后我想知道,是否存在一条最终能让AI对人类产生净积极影响的路径。

Original English

[Steven Bartlett]: So I have lots of questions.

[Mo Gawdat]: Okay, that's good.

[Steven Bartlett]: So what's your take on this job disruption point? What is the risk of these very intelligent models that the creators of these models don't actually understand themselves? Do you think Sam Altman's pro-humanity? How do we get to a point of ethical AI when the incentive structures are so highly competitive? And then I wonder if there's a path that ends in AI being net positive for humanity.

[莫·加瓦特]: 不知何故,我们被预先编程,相信这一切已经降临在我们头上,我们无法改变。我拒绝这种想法。所以我们会讨论解决方案。

Original English

[Mo Gawdat]: Somehow we've been pre-programmed to believe that this is upon us and we cannot change it. And I refuse that. So we will talk about the solutions.

[史蒂芬·巴特利特]: 但你乐观吗?

Original English

[Steven Bartlett]: But are you optimistic?

[莫·加瓦特]: 我对未来非常乐观。我对明年不乐观。

Original English

[Mo Gawdat]: I'm very optimistic about the future. I'm not optimistic about the next year.

[史蒂芬·巴特利特]: 为什么是明年?说吧,史蒂芬。你不想让我说出来。

Original English

[Steven Bartlett]: Why the next year? Come on, Stephen. You don't want me to say it.

从谷歌内部看AI觉醒

[史蒂芬·巴特利特]: 这对我来说非常有趣。我的团队给了我这份报告,告诉我你们中有多少人订阅了这个节目。有些人告诉我们,根据这个数据,你们莫名其妙地取消订阅了。所以,我想请大家帮个忙,如果你是节目的常客并且喜欢我们在这里做的事情,请现在检查一下你是否点击了订阅按钮。我们正在接近一个相当重要的订阅人数里程碑。所以,如果有一件简单免费的事情你可以做来帮助我们,我的团队,这里的每个人,让这个节目保持免费,让它年复一年、周复一周地进步,那就是点击那个订阅按钮,并再次确认你是否已经点击了。这是我唯一会请求你们做的事情。我们成交吗?如果你做了,我会告诉你我会做什么。我会确保每一周,每一个月,我们更加努力地为你带来你想听到的嘉宾和对话。从D of Sio一开始,我就一直信守这个承诺,我不会让你失望的。请帮助我们。非常感谢。让我们继续节目吧。

Original English

[Steven Bartlett]: This is super interesting to me. My team given me this report to show me how many of you that watch this show subscribe. And some of you have told us according to this that you are unsubscribed from the channel randomly. So, favor to ask all of you, please could you check right now if you've hit the subscribe button if you are a regular viewer of the show and you like what we do here. We're approaching quite a significant landmark on this show in terms of a subscriber number. So, if there was one simple free thing that you could do to help us, my team, everyone here, to keep this show free, to keep it improving year over year and week over week, it is just to hit that subscribe button and to double check if you've hit it. Only thing I'll ever ask of you, do we have a deal? If you do it, I'll tell you what I'll do. I'll make sure every single week, every single month, we fight harder and harder and harder and harder to bring you the guests and conversations that you want to hear. I've stayed true to that promise since the very beginning of the D of Sio, and I will not let you down. Please help us. really appreciate it. Let's get on with the show.

[史蒂芬·巴特利特]: 莫·加瓦特,我想大约四年前我和你聊过,当时你写了一本关于幸福的书。我记得你来的时候,你已经写了一本关于AI的书,但我特别想谈谈幸福这个话题,因为我对此很着迷。让我感到惊讶的是,你在所有人都还没真正谈论AI的时候就开始谈论它了。以前来我播客的嘉宾没有一个提到过AI这个话题。这个世界对它根本不感兴趣。然后这个叫ChatGPT的东西出来了,突然间每个人都亲身体验到了它,并为之着迷。我的第一个问题,也可能是那些不了解你的人想问的问题,为什么在那个时候,你比任何人都早开始谈论AI?

Original English

[Steven Bartlett]: Mo Gawdat, I spoke to you, I think about four years ago when you wrote a book about happiness and I remember you came in, you'd written this book about AI, but I particularly wanted to speak about the subject of happiness cuz I was fascinated by it. What I find astonishing is the fact that you were talking about AI before anybody was really talking about AI. No guest that had ever come on my podcast had ever mentioned the subject of AI. it just wasn't interesting to the world. And then this thing called ChatGPT came out and suddenly everybody got to feel it for themselves and became fascinated by it. My first question and this might be a question for people that don't know you is why at that time did you start talking about AI before anybody else?

[莫·加瓦特]: 我在实验室里就认识它们了。我是在2007年加入谷歌的,实际上是2006年底。当时,大多数人不知道的是,我们已经有了相当成熟的AI在做后台工作。2008年,我们有了“猫论文”,2009年发表,那是第一个真正的、无提示的AI。我记得2016年,有一次我观察了一个我们资助的项目,是关于教机械手如何抓取东西,不像工业机械那样。要像人类一样抓取,需要非常高的智能来评估纹理、柔软度、位置、形状等等。我们正在做这件事,它们和我的孩子们如此相似,这让我震惊。我想那是我第一次意识到,我们正在建造智能的顶峰。我们真的在把超级智能的缰绳交给另一个存在。当你面对这个事实时,你会突然意识到一些我们在谷歌很难意识到的事情,那就是直到那时,我在谷歌认识的每个人都相信我们在让世界变得更好,我们确实在为世界做着了不起的事情。但后来突然有一个时刻,你认识到,也许世界不会按照你想要的方式使用你创造的东西。你可以在很多技术中看到这一点。社交媒体一开始声称会让我们联系更紧密,但最终却用那块小屏幕把我们分开了。约会应用承诺你会找到灵魂伴侣,但实际上,它们让你月复一月地续费。所以科技最终变得比利他主义更资本主义。我想我不是第一个。尼克·博斯特罗姆开始了,杰弗里·辛顿完全改变了他的想法,尤舒亚·本吉奥开始说这非常严重。现在,每一个与机器有过深度接触的人都有点担忧。我想知道是否有一条现在很难看到的路径,最终能让AI对人类产生净积极影响。

Original English

[Mo Gawdat]: I knew them in the lab. I joined Google in 2007 very late 2006. and at the time most people don't know that at the time we had reasonably established AI doing our backend work and 2008 we had the cat paper which was published 2009 the first real unprompted AI. I remember 2016 I had that incident where I was observing a project we were funding that was about teaching grippers how to grip unlike industrial machinery. So to be able to grip like a human needs a very high level of intelligence to assess the texture, the softness, the positioning and so on, the shape of everything. And we were doing that and it just blew my mind how similar to my kids they were. And I think that was my very first realization that we were building the apex of intelligence. we were genuinely handing over the reigns of super intelligence to another being, right? And when you get faced with that, you start to suddenly realize something that we at Google found very difficult to realize, which was that everyone I knew at Google till then was believing that we were making the world a better place and we were we genuinely were doing amazing things for the world. But then suddenly there is a moment where you recognize that maybe the world will not use what you're making the way you want it to be used. And you can see that in lots of technologies. You know, social media starts by the claim that it's going to get us connected and gets us closer, but eventually ends up separating us with that little screen. You know, dating apps are giving you the promise that you're going to find your soulmate, but in reality, they keep renewing month after month. And so tech somehow ends up being more capitalist than altruistic. And I think I wasn't the first. Nick Bostrom started, you know Jeffrey Hinton completely changed his mind. Youshua Bengio starting to say this is very serious. Everyone now everyone who's ever had a very deep relationship with the machines is a bit concerned. I wonder if there's a path that's hard to see now that ends in AI being net positive for humanity.

[史蒂芬·巴特利特]: 我100%押注于此。只是这条路非常痛苦。

Original English

[Steven Bartlett]: I bet 100% on that. It's that this path is very painful.

[莫·加瓦特]: 是的。所以你需要理解的例子是,我们发现了核能,但第一个应用是原子弹,而不是核能。我认为AI正在发生同样的事情。AI的第一批应用是以牺牲大多数人的利益为代价来惠及少数人,是为了资本家提高生产力和降低成本,而没有考虑这对公众的影响。是为了现在正在用自主武器竞争的军队,是为了试图用越来越智能和更多的监控来控制一切的监控系统。这不是AI早上醒来后说:“嘿,你知道吗?让我们压迫所有人类。”而是少数有权势的人决定利用当今地球上终极的超级力量来获得更多的权力和控制。我的意思是,就在我们说话的时候,我们正身处两场主要战争,其中大部分的杀戮是由AI完成的。

Original English

[Mo Gawdat]: Yeah. So, the example you need to understand is we discovered nuclear power and the very first implementation was a nuclear bomb not nuclear energy right and I think that's exactly what's happening with AI. The first implementations of AI are in favor of a few at the expense of the majority, in favor of the capitalist to increase productivity and reduce cost but not taking into account how that impacts on the general public. In favor of the armies that are now competing with autonomous weapons, in favor of the surveillance systems that are attempting to control everything with more and more intelligence and more monitoring. And that's not AI waking up in the morning and saying, "Hey, you know what? Let's oppress all humans." But it is a powerful few that are simply deciding to use the ultimate superpower on the planet today to gain more power and more control. I mean, as we speak, we're living in two major wars where AI is doing most of the killing.

[史蒂芬·巴特利特]: 因为很多人把AI看作是我们都在使用的聊天机器人,用来帮助我们,对吧?

Original English

[Steven Bartlett]: Cuz a lot of people think of AI as these like chat bots that we're all using to help us, right?

[莫·加瓦特]: 不,我认为存在一种炒作,我称之为“炒作二分法”。公众看到的关于AI的东西被过度炒作但效果不佳。所有那些假视频,格洛克做了这个,我们试图关掉那台机器它却做了那个等等。而真正的极客在实验室里看到的是令人难以置信的智能。所以即将发生的是,我们已经开始组装能够自我发展的系统。它们查看自己的代码,运行实验,测试这些实验,看看性能如何,然后重新部署最好的代码。你想想看,想象一个世界,我们有一个小小的天才坐在后台某处不断尝试。但它不是每天尝试一个新代码,而是每微秒尝试一个新代码。迟早,它们会发现一些东西。我认为这是大多数人没有意识到的。大多数人没有意识到的是智能如何触发智能。如果你真正理解这一点,你就会意识到,普通人类这边的炒作被完全高估了,错过了主要话题,而极客们“金库”内的沉默是相当令人震惊的。不是坏的方面的震惊,而是改变世界的。

Original English

[Mo Gawdat]: No, I think there is a hype I call it the hype dichotomy if you want. So, what the general public sees about AI is overhyped but ineffective. You know, all of the fake videos and all of the, you know, Grock did this and, you know, we attempted to switch off that machine and it did that and so on. What the real geeks see inside the lab is just unbelievable intelligence. And so what is about to happen is that we've started to put together systems that develop themselves. They look at their own code and they run experiments and they test those experiments if they changed something and they see where the machines are the performance is and redeploy the best code. Okay. And if you just think of that, I want you to try and imagine a world where we have a tiny little genius sitting in the back end somewhere trying. But instead of trying a new code every day, it's trying a new code every microsecond. Eventually, sooner or later, they'll discover something, right? And I think that's what most people don't realize. What most people don't realize is how intelligence triggers intelligence. And if you really understand this, you realize that the hype on the normal human side is completely overrated. Missing the main topics and the silence inside the vault if you want of the geeks is quite alarming. No, not alarming in a bad way, but it's quite world changing.

就业颠覆:白领与蓝领的真相

[史蒂芬·巴特利特]: 我猜有一个想法从未动摇过,那就是将会发生巨大的就业颠覆。从逻辑上讲,智能在增加,一旦智能以这些代理的形式存在,我可以在手机上告诉我的代理做某事,它使用楼下的电脑,为我完成。当我第一次体验到这一点时,我想,哇。所以它可以做任何在电脑上的事情。它可以点击,可以为我做事。世界上有很多人就是靠点击电脑来赚钱的。老实说,我可能也是其中之一。另一个“顿悟”时刻是看到我自己的招聘方式开始转变。

Original English

[Steven Bartlett]: I guess one of the thoughts that hasn't swung is that there's going to be pretty tremendous job disruption. I would have like logically believed it from like reasoning up from okay intelligence increases. What is intelligence? And once intelligence is in the form of these agents where on my phone right now I can tell my agent to do something. It uses the computer downstairs. It does it for me. When I first experienced that I was like wow. Okay. So it can do anything that's on a computer. It can click around. It can do stuff for me. There's a lot of people that are paid in the world to click around on a computer. I'm probably one of them to be honest. And then the other Eureka moment was just in seeing how my own hiring had started to shift.

[莫·加瓦特]: 当然。我开始注意到我们在招聘时更多地考虑AI熟练度。特别是,Anthropic的人说,他们看到大约15%的初级职位现在可以由AI完成。这开始与我的观察相吻合。这时我想,“哦,天哪,是的。”这将会导致大量的就业颠覆,尤其是在初级水平。

Original English

[Mo Gawdat]: For sure. And I started to notice that we were thinking about AI proficiency in our hiring a lot more and that especially you know I think the guys at Anthropic which is one of the big AI companies said that they could see I think they said roughly 15% of entry-level jobs could now be done by AI. I think that's what they said. And that started to correlate with what I was observing. And this is when I thought, "Oh my gosh, yes." No, this is going to cause a lot of job disruption, especially at the entry level.

[史蒂芬·巴特利特]: 我认为你说得很对。不是蓝领,而是初级知识工作。

Original English

[Steven Bartlett]: I think you're spot on with that. Not the blue collar, but the entry level knowledge work.

[莫·加瓦特]: 是的。那成了我的第一个担忧。我和Uber的CEO Dara坐在一起,他很清楚地说,那900万Uber司机将不再有工作。你对这个就业颠覆点怎么看?

Original English

[Mo Gawdat]: Yeah. And that became my first concern. You know, I sat here with Dara, the CEO of Uber, and he was quite clear that the 9 million Uber riders won't have their jobs anymore. What's your take on this job disruption point?

[莫·加瓦特]: 不,我认为你说得很对。你的团队给了我一个可爱的小金字塔。如果你把底层看作是蓝领工作,更多从事体力劳动的人。在它上面,是那些知识工作者,大部分做的是单调的工作,就像你说的,点击电脑或接电话之类的。然后是中级知识工作者,需要更多一点智能的工作,从律师助理到金融分析师等等。然后当然是高层领导。大多数人认为颠覆会从底层开始。我不这么认为。实际上,我认为蓝领工作会持续很长时间。

Original English

[Mo Gawdat]: No, I think you're spot on. And I mean your team gave me this lovely little pyramid basically. If you think of the bottom layer as blue collar jobs, more people doing manual work. On top of it you'll have those you know call them knowledge workers mostly doing mundane jobs like you said clicking on a computer or responding to a phone call or whatever. Then you have the middle knowledge workers, jobs that require a bit more intelligence, anything from a paralegal to a financial analyst to all of that. And then of course, top leadership. And most people think it's going to be starting from the bottom. I don't think it's all start from the bottom. Actually, I think blue collar jobs will stay for a very long time.

[史蒂芬·巴特利特]: 给我举个例子,什么是蓝领工作?

Original English

[Steven Bartlett]: Give me an example of a blue collar job for someone.

[莫·加瓦特]: 我是一个木匠。我喜欢修复经典汽车。还没有机器人能做到这一点。然而,任何像呼叫中心代理、助理、旅行代理这样,只需点击几下就能完成的单调工作,都会很快消失。我的预测是,你将在2027年开始看到非常严重的影响。你之前没有感觉到,因为我们看到的是那个领域没有招聘。过去几年你看到的是,公司不再招聘初级职位了。还不是失业,但这基本上意味着劳动力没有增长。下一层,我认为可能是知识工作者。随着智能的提高,律师助理可能不再需要,因为AI可以做研究,或者一个律师助理可以做四个人的工作,金融分析师也一样。但有趣的是,它会继续向上蔓延,信不信由你。我邀请了马克斯·泰格马克上我的纪录片,他放声大笑,说大多数CEO相信他们可以解雇所有人,让AI做所有的工作。他们只是不记得,AGI最终会做得比人类更好,包括做CEO。

Original English

[Mo Gawdat]: I'm a carpenter. Okay. You know, I love to restore classic cars. So, you know, there isn't a robot that can do that yet. Okay. This, however, any anything that is call center agent, assistant, travel agent, anything that you can do with a few clicks and is mundane is going to disappear very quickly. My prediction is you're going to start to see very serious impact in 2027. Now what you had not sensed it before because what we saw was no hiring in that segment. So what you saw in the last couple of years is that companies were not hiring entry-level jobs anymore. It wasn't job losses yet, but that basically meant the workforce was not growing. Right? The next layer, I think, would probably be the knowledge workers. As intelligence increases, a paralegal would probably not be needed because AI can do the research or one paralegal can do the job of four, a financial analyst the same and so on and so forth. But interestingly, it continues to go up, believe it or not. And, you know, I hosted Max Tegmark on my documentary and he was laughing out loud, genuinely laughing out loud, saying, you know, most of the CEOs believe that they can fire everyone and have AI do all of the jobs. They just don't remember that AGI is going to do everything better than humans eventually, including being a CEO.

[史蒂芬·巴特利特]: 那么,我们先定义一下你说的白领工作。你提到了律师。具体是什么角色?

Original English

[Steven Bartlett]: So, let's first define when you say white collar. You said lawyers there. What kind of roles?

[莫·加瓦特]: 我的意思是所有工作。如果你是一名做诊断的医生,可能更少的医生会做更多的诊断,因为NHS已经在让人们先与AI互动了。如果你是一名作曲家,一些作曲家会因此失业。如果你是一名做平面设计的艺术家,一些人会失业。有趣的是,甚至中层管理。我私下告诉过你我的创业公司。我的CTO是AI,我的参谋长是AI,我的项目管理也是AI。同样,因为我是一个极客,我能做这些事。但这个界面很快就会普及到普通人。所以这可能需要两到五年,如果你乐观的话,到2030年。但它们会开始侵蚀。我认为大多数人不理解的挑战是,随着这种侵蚀,我们已经在一个非常不同的经济体中运行了。一个螺旋式下降得更快、推动更多成本削减的经济体。让我问你一个问题,然后我们可以再回到这个话题。想象一个世界,那个建立了我们所有资本主义成功的“劳动力套利”概念消失了。

Original English

[Mo Gawdat]: I mean, everything. If you're a doctor that's doing diagnosis, you probably will have fewer doctors doing more diagnosis because I think the NHS does that already by asking people to interact with an AI first. If you're a composer, a music composer, some composers will lose their jobs because of that. If you're an artist that's doing graphic design, some will lose their jobs because AI comes into that. And interestingly, even middle management. I told you offline about my startup. My CTO is an AI. My chief of staff is an AI, my project management is AIs. Again, because I'm a geek, I can do those things. But that interface will come to the normal people very soon, right? And so this may take two to three 5 years if you want until 2030 if you're optimistic. But they'll start to erode. Okay? I think the challenge that most people don't understand is as this erodes, we're already dealing with a very different economy. An economy that is spiraling a lot quicker and pushing for more cost reductions. Let me ask you this if you don't mind, then we can come back to this. Imagine a world where the concept of labor arbitrage that built all of our capitalist success disappears.

[史蒂芬·巴特利特]: 你说的“劳动力套利”是什么意思?

Original English

[Steven Bartlett]: What do you mean by labor arbitrage?

[莫·加瓦特]: 资本主义一直就是利用劳动力和资本或债务,以低于售价的成本创造东西。你把一个团队聚在一起,他们做鞋,然后你以比成本高一美元的价格卖掉鞋子。那么,如果没有劳动力套利,资本主义会是什么样子?如果劳动力成本下降到对一台能做这项工作的机器的投资。如果因为成本降低,你不再需要借那么多钱,资本主义和银行业会是什么样子?更有趣的是,如果所有这些工人不再有购买力来购买你和其他人能创造的东西,GDP会是什么样子?存在一种有趣的颠覆,不需要达到100%的就业替代。在10%到20%的就业替代时,你就已经处于一个非常不同的经济体中,一个明显螺旋式下降的经济体。你不觉得吗?

Original English

[Mo Gawdat]: So, capitalism has always been all about using labor and capital or debt to create things at a cost that is lower than the price you sell them for. Correct. You bring a team together, they make some shoes, whatever, and you sell the shoes for a dollar more than it how much it costs you to make them. So how would capitalism look like if you don't have labor arbitrage? If cost of labor drops to an investment in a machine that can do the job. Okay. how would capitalism and banking look if because of that cost reduction you don't need to borrow as much anymore and more interestingly how does the GDP look if all of those workers no longer have the purchasing power to buy the things that you can create? There is an interesting disruption that doesn't require us to get to 100% job displacement. At 10% 20% job displacement, you're in a very different economy and an economy that is clearly spiraling downwards. Don't you think?

[史蒂芬·巴特利特]: 是的。我想当成本下降时,可能发生的一件事是,人们会在其他东西上花更多钱。因为我在我的生意中观察到,如果我节省了成本,我最终会把钱花在别的东西上。

Original English

[Steven Bartlett]: Yeah. I wonder with when costs drop, I think one of the things that might happen as well is that people will spend more on other things cuz I was thinking in my business, one of the observations I've had is if I make a cost saving, I end up spending the money on something else.

[莫·加瓦特]: 现在,那个东西可能是代币,基本上是把钱花在AI上,但也可能是在不同领域招聘,比如软件工程师现在很抢手。你必须想象,所有这些智能迟早不会在第一阶段被完全取代。但如果四个助理的工作可以由一个人完成,四个律师助理的工作可以由一个人完成,一个庞大的营销团队的工作可以由一个小团队完成。这不是说工作会首先结束。而是生产率的提高会让企业不想再要那么多昂贵、情绪化的人类,当工作可以更便宜、更可预测地完成时。

Original English

[Mo Gawdat]: Now, that thing could be tokens basically spending money on AI, but it also could be hiring in different areas which are software engineers are like hot property right now. You have to imagine all of that intelligence is sooner or later going to be not replaced entirely in the first stages. But if the job of four assistants can be done by one. Then the job of four paralegals can be done by one. Then the job of a massive marketing team can be done by a smaller marketing team. It's not that jobs will end first. It's that productivity gains will make businesses not want to have as many costly humans when the job can be predictably done for cheaper.

机器人冲击与自主武器

[史蒂芬·巴特利特]: 那么底层的蓝领工作呢?前几天Figure AI发布了一个视频,展示了一个机器人在生产线上工作了8个小时,只是分拣包裹。你看到了吗?有一次他们展示了一个人类在旁边分拣包裹。但机器人最终胜出了。这是一个非常直接的任务。它所做的就是寻找包裹上的标签,并确保标签朝下。它这样做了八天。它会间歇性地走过去给自己充电,然后再回来。但当我看到这个时,它也让我瞥见了蓝领层面即将发生的颠覆。因为想想埃隆·马斯克,如果他在未来几年生产并交付至少一百万个类人机器人到世界上,他的薪酬包将获得大约一万亿美元。但他的预测是,将来会有100亿个类人机器人,世界上类人机器人的数量将超过人类。

Original English

[Steven Bartlett]: And then what about this bottom layer here? There was this video released by Figure AI the other day where they showed a robot on the production line for 8 hours just sorting packages. Did you see this video? At one point they showed a human sorting the packages alongside them. But the robot ended up winning out. And okay, this is a very straightforward task. All it's doing here is it's looking for where the label is on the package and making sure the label is facing downwards. On all the packages. So it's sorting the packages, putting the label facing down. And it did this for eight days. It intermittently it would walk over and charge itself and then it would come back to the production line. But when I saw this as well, it was a glimpse of some of the disruption that's going to take place at the blue collar level as well. Because you think about Elon Musk, he's got in his pay packet, he gets something like a trillion dollars over the coming years if he produces and delivers at least a million humanoid robots into the world. But his prediction is there will be a time where there are 10 billion humanoid robots, where there are more humanoid robots in the world than humans.

[莫·加瓦特]: 事实上,你再次看到了过度炒作和炒作不足之间的区别。大多数讨论都围绕着类人机器人。没有人谈论自动驾驶汽车。而自动驾驶汽车就是一个机器人。它是一个功能性机器人,只是不像人类。你在类人机器人上的投资需要更多一点,来学习让机器适应世界的技能。但专用机器人会非常非常快地完成工作。所以你可以很容易地看到,第一波浪潮,就像你和Uber CEO的谈话那样,将是专用机器人取代司机。不幸的是,将是专用机器人进行杀戮。将是专用机器人完成所有的情报工作、执法工作。它们不必看起来像人类,也不必表现得像人类。事实上,波士顿动力公司的狗在战场上执行任务时可能比类人机器人更高效。这基本上意味着,在我们意识到工作正在被机器人取代之前,工作就会消失,而这些机器人的数量将和今天制造的汽车一样多。

Original English

[Mo Gawdat]: For a fact, you see the interesting again the difference between the overhype and the underhype. Huh? Most of the conversation is around humanoids. Nobody's talking about self-driving cars. And a self-driving car is a robot. It's a functional robot that doesn't look like humans. Okay. the investment you have to put into humanoids is a little more to learn skills that allows that machine to fit into the world. But specialized robots are going to do the job very very quickly. And so you can easily see that the first wave like you had the conversation with Uber CEO is going to be specialized robots replacing drivers. It's going to be specialized robots unfortunately doing the killing. It's going to be specialized robots unfortunately doing all of the intelligence work, law enforcement work. They don't have to look like a human. They don't have to behave like a human. As a matter of fact, the Boston Dynamics dog is probably more efficient than a humanoid at doing the job that you can assign to it in a battlefield right now. Those basically mean that jobs will be disappearing to robots before we recognize that they're disappearing to robots and those robots will be as many as every car being made today.

[史蒂芬·巴特利特]: 我的意思是,如果你去洛杉矶,我的车可以自动驾驶,但那里到处都是Waymo。

Original English

[Steven Bartlett]: I mean, they are if you go to LA, my car drives itself, but also there's just Waymos everywhere.

[莫·加瓦特]: 绝对。比亚迪前几天刚刚宣布,他们将为其汽车造成的任何事故承担赔偿责任。比亚迪是中国大型自动驾驶汽车制造商。所以这个替代周期将会发生。它需要很长时间来实现规模经济。但我认为埃隆·马斯克谈到100亿个机器人时并没有错。并非所有机器人都看起来像类人机器人。我认为很快我们就会认识到,很多机器人根本不需要是类人机器人。有比人类脆弱的身体结构更高效的外形因素。但是的,它即将发生。我想我应该补充一点,这一切并非必然发生。人们听到这些会责怪AI,说AI是邪恶的。AI不是。丰富的智能是美妙的。让机器完成工作对我们来说是惊人的。

Original English

[Mo Gawdat]: Absolutely. And BYD the other day just announced that they will pay for the liability of any accident their cars will make. And BYD is the big Chinese manufacturer of autonomous vehicles. So, this replacement cycle will happen. It will require a lot of time to achieve economies of scale. But I don't think Elon Musk is off the mark when he talks about 10 billion robots. Not all of them are going to look like humanoids. And I think very quickly we will recognize that many many robots don't need to be humanoids at all. there is a much more efficient form factor or shape than the human flimsy structure. But yes, it's about to happen. I think I should qualify all of this by saying it does not necessarily need to happen. So people will hear all of this and blame AI and say AI is evil. AI is not. Abundant intelligence is wonderful. having jobs done by machines is amazing for us.

科技巨头的裁员与自我实现的预言

[史蒂芬·巴特利特]: 我在想一个刚大学毕业的孩子,他们拿到了法律学位,或者你之前提到的其他工作,比如平面设计,或者社会学,或者商业管理。你听到所有这些来自大型科技公司的裁员消息,这些公司的CEO们在宣布裁员时,似乎带着某种……我不会说喜悦,但他们非常热衷于解释说他们因为AI而裁掉很多人。

Original English

[Steven Bartlett]: I'm thinking about the kid that's like, leaving university now and they've got a degree in law or I don't know, you talked about a few other work jobs earlier, like graphic design. Or maybe they did sociology. Or maybe they did business management. You're hearing about all these layoffs coming from big tech companies and it seems that the CEOs of these companies are announcing these layoffs with a certain amount of it seems like I wouldn't say the word is joy, but it's they are very keen to explain that they're laying off lots of people because of AI.

[莫·加瓦特]: 我认为他们认为这能让他们从投资者那里获得一定程度的尊重,因为他们做出了艰难的决定,并且高效地运营业务。投资者看着他们想,如果这是一个高效的企业,并且他们正在拥抱AI,那么这就是一项好的投资。这几乎开始成为一种自我实现的预言,如果你是唯一一个没有因为AI而裁掉大量员工的CEO,你实际上看起来会很糟糕。人们会认为你的公司臃肿,你是一个糟糕的经营者。

Original English

[Mo Gawdat]: And I think they think that that gives them a certain amount of respect probably from investors for making hard decisions and being efficient with how they're running their businesses. investors look at them and think, well, if that's an efficient business and they're leaning into AI, then that's a good investment. It's almost started a bit of a self-fulfilling prophecy where if you're the only CEO not laying off loads of people because of AI, you actually look bad. The assumption is your company is bloated and you're a bad operator.

[史蒂芬·巴特利特]: 所以,我的一个我认为非常可能发生的担忧是,在未来五年,也许十年,我们将真正看到大量失业,因为世界必须重新适应这些新工作是什么。我确实认为会有新的工作。很难预见这些新工作会是什么样子。然后,一旦你开始谈论类人机器人和机器人技术,我认为这基本上会像彗星、像流星一样撞击社会。我认为特斯拉或其他公司推出的第一个在现实世界中高效执行任务、并且因为由LLM驱动而极其智能的类人机器人,将会震惊人们,而且我认为它会很快发生。就像ChatGPT发生得很快一样。我认为埃隆或其他人某天会做一个演示,说“我们准备好了,你现在可以每月花500美元买一个了。”然后人们会去买,我认为这会震惊世界。但是,在类人机器人到来之前,我认为白领阶层仍然会有大量的就业颠覆。我想知道当失业率达到10%或15%时,社会会是什么样子,我认为这是可能的。

Original English

[Steven Bartlett]: Um, so one of my concerns that I think is highly plausible is that over the next five maybe 10 years, we're going to really see a lot of unemployment as the world has to kind of readjust to whatever these new jobs are. I do think there will be new jobs. It's hard in foresight to predict what those new jobs will look like. And then the minute you start talking about humanoid robots and robotics, which I think is basically going to hit society like a comet, like a meteor, I think the first humanoid robot from Tesla or anyone else that is highly effective in the real world at doing tasks and is extremely intelligent because it's powered by one of these LLMs. Um, I think it's going to shock people and I think it's going to happen quickly. Like chat happened quickly. I think Elon or something is going to do a presentation someday and say, "We're ready and you can buy one now for $500 a month." And then people are going to get them and I think it's going to shock the world. Um, but until humanoid robots arrive, I think there's still going to be a lot of job disruption to the white collar layer. And I wonder what that looks like for society when we get to, I don't know, 10% 15% unemployment theoretically, which I think is plausible.

[莫·加瓦特]: 很快。是的。你和他们没什么不同。你只是在一个持续增长的基础上。所以你的业务在增长,你继续招聘,但你正在用计算能力取代人力资源。如果AI不存在,你今天可能多招了100人。你现在少了100人,多了十亿个代币。

Original English

[Mo Gawdat]: Very soon. Yeah. You're not very different. Okay. you're just on top of a baseline that is continuing to grow. So your business is growing. So you continue to hire, but you are replacing human resources with compute. Okay? If AI didn't exist, you would have probably had a 100 people more in your organization today, right? You now have 100 people less and a billion tokens more.

[史蒂芬·巴特利特]: 是的。对于不了解的人来说,代币基本上就是你使用的东西。它是AI的货币。所以,如果你想让人类完成一项任务,你用人时或工时来计算;在AI中,你用计算能力、用代币来计算。诀窍在于,那些大型科技公司有两面性。一方面,他们更需要用计算能力取代工人,因为在计算能力方面存在竞争,如果他们中的任何一个落后,就意味着整个业务的毁灭。但另一方面,他们是极客。所以他们知道如何构建与计算能力的接口。因此,他们比普通的传统企业更快地将技术整合到他们的组织中。你可以把他们看作是预览版。这不仅仅是全人类失去工作的问题。问题在于,在内战爆发之前,分界线在哪里?想象一下,20%的失业率发生在经济正遭受通货膨胀的时候。我这么说不是为了危言耸听。我这么说是因为我真诚地相信政府需要醒悟过来。政府至少需要记住新冠时期,当时政府不得不让所有人休假,让人们呆在家里。如果人们呆在家里,政府必须准备好以某种方式维持这些人的生活,直到重新培训发生,或者直到我们找到解决方案,让这些人不会感到被抛弃。

Original English

[Steven Bartlett]: Yeah. So for anyone that doesn't know, tokens are basically the thing that you use. It's the currency of AI. Yeah. So, if you want to get a task done by a human, you count in sort of like man hour or worker hour, employee hour in AI, you count by compute, you count by tokens, right? And so the trick is those major tech companies, they have two sides. One is they need to replace workers with compute even more because there is a competitive side on compute where if any of them is left behind that means the destruction of the entire business. But on the upside they are geeks. So they know how to build the interfaces to compute. So they integrate technology within their organizations quicker than the average traditional business. Right? Non-technology business. If you want, you can look at them and say this is the preview. It's not about all of humanity losing their jobs. It's about what is the dividing line before civil war, right? You know, think about a situation where 20% unemployment is happening when economies are suffering inflation. I say that not to be a scare-monger. I say that because I genuinely believe governments need to wake up. Okay? Government needs to at least remember the COVID years where governments had to give furlough everywhere and ask people to stay home. If people stay home governments have to be prepared to somehow sustain those people until rescaling happens or until we find a solution so that those people don't feel that they're left behind.

民主的终结与科技领袖的诚信

[史蒂芬·巴特利特]: 内战。

Original English

[Steven Bartlett]: A civil war.

[莫·加瓦特]: 动荡,我们称之为。

Original English

[Mo Gawdat]: Unrest, let's call it.

[史蒂芬·巴特利特]: 公民动荡。

Original English

[Steven Bartlett]: Civil unrest.

[莫·加瓦特]: 是的。

Original English

[Mo Gawdat]: Yeah.

[史蒂芬·巴特利特]: 那最终会是什么样子?因为一方面,民主进程发挥作用,我们选举别人。

Original English

[Steven Bartlett]: What does that end up looking like? Cuz on one end, the democratic process plays its role and we just elect someone else.

[莫·加瓦特]: 真的吗?别这么说。

Original English

[Mo Gawdat]: Does it really? Don't say that.

[史蒂芬·巴特利特]: 我不知道。你告诉我。

Original English

[Steven Bartlett]: I don't know. You tell me.

[莫·加瓦特]: 哦,不,不,不。我认为民主很久以前就结束了,史蒂芬。我认为我们生活在最腐败的时代。我不知道历史,但这绝对是腐败的。这绝对不是民主。这甚至不可能是代议制。人们很愤怒,因为他们的税收用在了他们没选择、对他们没好处的事情上,系统中的很多规定被忽视了。我选择在下一本书出版前不谈政治。但是,我们有视频证据显示有人虐待儿童,却没有一个人被逮捕。一个人都没有。你怎么能称之为民主?我认为重复那些口号只会让人们更愤怒。人们知道他们在被欺骗。人们知道他们的领导人没有代表他们的最佳利益。人们知道他们的钱用在了他们不赞成的事业上。问我公民动荡会是什么样子。我不知道,我也不是在呼吁它,但我希望呼吁政客们开始意识到,这在各个方面都越界了。在这一点上,OpenAI的创始人山姆·奥尔特曼十多年来一直在敲响“AI要来抢你的工作了”这面鼓。2015年,他指出:“我的工作就是帮助人们摧毁工作。”他当时对此感到惋惜,但还是决定这么做。

Original English

[Mo Gawdat]: Oh, no, no, no, no, no. I think democracy has ended a long time ago, Stephen. I think we live in the most corrupt time. I don't know about history to be honest, but this is definitely corrupt. Okay. This definitely is not democracy. This definitely is not even congressional in any possible way. And people are angry, you know, people are angry because their tax money is going to things that they don't choose to that don't benefit them that lots of regulations in the system are being ignored. I mean, I choose not to speak about politics perhaps until my next book comes out, but look, we have video evidence of people abusing children and not a single person got arrested. Not a single person. I mean, how can you call that a democracy? I think repeating those slogans is going to anger people even more if you ask me. People know that they're being lied to. People know that their leaders are not representing their best interest. People know that their money is going to causes that they don't really approve of. And ask me how civil unrest looks like. I don't know and I'm not calling for it, but I'm hopefully calling for the politicians to start to become aware that this is crossing the lines everywhere. On this point, Sam Altman, who is the founder of OpenAI, he's been banging the AI is coming for your job drum for more than a decade now. In 2015, he pointed out, "My job is to help people destroy jobs." Something he lamented at the time, but decided he'd do anyway.

[史蒂芬·巴特利特]: 我每天早上挣扎着起床的原因之一就是,我的工作就是帮助人们摧毁工作。未来几十年软件将带来的就业破坏,我认为没有人准备好,而且你不能谈论它。而在2023年,奥尔特曼在一次采访中说:“很多从事AI工作的人假装它只会是好事。它只会是一种补充。没有人会被取代。工作肯定会消失。句号。”有趣的是,这个月他说:“我不认为我们会面临我们领域一些公司所鼓吹或谈论的那种工作末日。”我很高兴在2021年到2024年期间,关于白领工作的这个预测是错的。他说:“AI可能会取代今天人们做的大部分工作。整个工作类别将完全消失。”今年五月,两年后,他说:“我以为到现在为止,对初级白领工作的影响会比实际发生的更大。这是我的直觉出错的地方。”让我感到不舒服的是这种反复摇摆,我真的不知道什么是真的,因为几年前你告诉我们所有工作都会消失。你斩钉截铁地说过。你说了“句号”。现在他又说它们不会消失。当一个人改变说法时,很难理解他为什么这么做。我的怀疑是,那时的动机是让人们认真对待AI。

Original English

[Steven Bartlett]: One of the things that I struggle with like getting out of the bed every morning is that like my job is to help people destroy jobs. the job destruction that we're going to see by software in the next couple of decades. I don't think anyone's prepared for and you can't talk about it. And in 2023, Altman said in an interview, "A lot of people working on AI pretend that it's only going to be good. It's only going to be a supplement. No one is ever going to be replaced. Jobs are definitely going to go away. Full stop." Interestingly, this month he said, "I don't think we're going to have the kind of jobs apocalypse that some of the companies in our space advocate or talk about." I'm delighted to be wrong about this on white collar jobs in 2021 to through 2024. He said, "AI will probably replace most of the jobs people do today. Entire job categories will be totally totally gone." in May this month, two years later, he said, "I thought there would be more impact on entry-level white collar jobs being eliminated by now than has actually happened. This is an area where my intuitions were just off." What I find uncomfortable is the bouncing backwards and forwards and I don't really know what is true because a couple years ago you were telling us all the jobs are going to go away. You said categorically. You said literally said full stop and now he's saying they're not going away. And I just don't, you know, when someone's like changing form factor, it's hard to understand why they're doing it. And I think my suspicion is back then the incentive was to get people to take AI seriously.

[莫·加瓦特]: 嗯。

Original English

[Mo Gawdat]: Mhm.

[史蒂芬·巴特利特]: 恭喜。我们认真对待了。我们如此认真对待,以至于它现在成了一个麻烦。对这些公司来说是个麻烦,因为人们现在在毕业典礼演讲上喝倒彩。他们在攻击数据中心。他们将选举理论上反AI的人。现在出现了反转,他们说“不,会没事的”。我不知道。

Original English

[Steven Bartlett]: Congratulations. We took it seriously. We took it so seriously, in fact, that it's now a problem. It's a problem for these companies because people are now booing at commencement speeches. They're attacking data centers. they're going to elect people that are theoretically anti-AI and now there's this inversion where like no it's going to be fine. I don't know.

[莫·加瓦特]: 我的意思是,你说得很对。首先,山姆的整个存在,如果你问我,从OpenAI开始,它本应通过创造安全的AI来拯救世界,然后把它变成一个价值数十亿美元的商业企业,在这个过程中背叛了几个人。我在《追逐乌托邦》里采访过他,他明确说过,你可以找到原话。他基本上说:“嗯,我不怀疑……我怀疑AI很可能会终结人类,但在这个过程中我们会创造很多有趣的公司,对吧?”我的意思是,这类陈述实际上不是一个没有决定的人说的。这只是一个越来越多地被他的公关机构或公关经理教导,按照剧本说话的人。正如你正确指出的,剧本无论哪种方式都有其目的和目标。山姆·奥尔特曼,我在我的一部作品中曾说过,奥尔特曼是一个品牌,不是一个名字。如果不是山姆·奥尔特曼,也会有另一个硅谷颠覆者做同样的事。我不怪他为此战胜了市场。这里有趣的挑战是,我们还能相信谁?在技术中我们相信谁?在政治中我们相信谁?在战争中我们相信谁?有趣的是,我开始改变我的心态,相信那些言行一致的人。所以,Anthropic站出来说:“我不会允许我的模型被用于人类定位和监视。”这是一个因为坚持自己的道德标准而损失5亿美元交易的人。接下来的一周或几周后,OpenAI接下了这个合同。那是一个基本上告诉你“这是好钱”的人。你必须开始观察谁的行为真正让AI为人类服务,谁的行为让AI为他们的股价服务。是的,我不得不说,当Dario和Anthropic的团队这样做时,我对他们非常尊敬,因为这表明他们有某种道德伦理的边界。

Original English

[Mo Gawdat]: I mean you're spot on. First of all I mean Sam's entire existence if you ask me starting with OpenAI that is about that's supposed to save the world by creating a safe AI then making it a commercial enterprise that's worth billions and backstabbing a few people in the process. I have him on Chasing Utopia saying clear I quote this is exactly the words he said you can find it online. So, he basically says, "Well, I don't suspect that I suspect that AI is likely going to end humanity, but we're going to create a lot of interesting companies in the process, right?" Those kinds of statements are honestly not the statements of someone who's not decided. It's just the statements of someone who's being taught more and more by his PR agency or PR manager to say things as per a script right and the script as you rightly said had an objective and a target either way. Sam Altman I used to say Altman is a brand it's not a name. If it wasn't for Sam Altman specifically there would have been another Silicon Valley disruptor that would have done the same. I don't blame him for beating the market for it. The interesting challenge here is that who do we believe anymore? Who do we believe in technology? Who do we believe in politics? Who do we believe in the middle of a war? And I will tell you interestingly, I started to change my mindset in terms of believing those who put their actions where their words are. So, Anthropic coming out and saying, "I'm not going to allow my model to be used for human targeting and surveillance, right? That's someone that's losing a $500 million deal because they stand by their ethics." The next week or the next, couple of weeks, OpenAI takes the contract. That's someone that's basically telling you it's good money, right? You have to start observing who's actually behaving in a way that is making AI work for humanity. and who is behaving in a way that is making AI work for their share values. Yeah, I do have to say when Dario and the team at Anthropic did that, I did have a huge amount of respect for them generally because it just shows that there's some kind of like they've got their own sort of moral ethical boundaries.

[史蒂芬·巴特利特]: 很多年前有人在台上问我,你怎么知道一个人的价值观或公司的价值观是真的?我说,看看他们愿意在短期内牺牲什么,即使这与他们的激励相悖。对我来说,这是理解一个人是否有诚信或原则的本质,他们愿意为了长期信仰的东西放弃短期利益。通常是金钱或其他任何形式的利益。

Original English

[Steven Bartlett]: And that someone asked me on stage many years ago, how do you know if someone's values or a company's values are true? And I said, look at what they're willing to sacrifice in the near term that's against their incentives. That for me is the essence of understanding if someone has integrity or is principled is they will give up something in the near term for what they believe in over the long term. It's usually money or some kind of benefit of any sort.

[莫·加瓦特]: 所以,你需要像我一样在谷歌内部工作过,才能意识到技术中存在囚徒困境,你无法逃脱竞争对手或政府的影响。有时NSA会迫使谷歌交出信息,否则就摧毁你的业务。但是,一个自愿这样做并庆祝的公司,比如Palantir或OpenAI,与一个试图抵抗直到无法继续做生意的公司之间,存在着巨大的区别。你必须从科技大佬的行为中质疑谁是亲人类的,谁不是,从他们的声明中不难看出这一点。

Original English

[Mo Gawdat]: I mean so there is something that you needed to have worked on the inside of Google like me to realize there are prisoners dilemmas within technology where you cannot escape the influence of either a competitor or the government. There are some times where the NSA is going to push Google to say give me this information or otherwise I'm going to really destroy your business. But there is a very big difference between a company that willingly does this and celebrates it like a Palantir or an OpenAI or a company that tries to resist it until the point where it becomes impossible to continue to do business. You have to question from the actions of the tech bros who is pro-humanity and who isn't and it's not very difficult to see that from their statements.

[史蒂芬·巴特利特]: 你认为山姆·奥尔特曼是亲人类的吗?我真的从未下定决心。老实说,史蒂夫,我这么说……我一直在想,要么这件事对他来说太大了,他只是被自己身处其中的方式所驱动,任何一个发现自己处于能够完全颠覆世界的机会中心的人,要么他不亲人类。我不知道。我绝对认为他首先是亲OpenAI的,然后才是亲人类的,但这只是我的看法。然而,其他人公开这么说。如果你看看Palantir的Alex Karp或Peter Thiel,彼得在电影中,当采访者问他“但你赞成人类的延续”时,他停顿了大约40秒,像是“我不确定”。Alex Karp庆祝他的技术能够定位人们。我知道提起这些很愚蠢,但这些都是公开的互联网信息,不知何故,我们却把人类的未来托付给这些人。这是错误的。

Original English

[Steven Bartlett]: Do you think Sam Altman's pro-humanity? I genuinely have never made up my mind. Honestly, Steve, I say that with... I'm either thinking he is too this is too big for him and he just is driven by how he found himself in the middle of this, anyone who finds himself in the middle of an opportunity to completely flip the world upside down or he's not pro-humanity. I don't know. I definitely think he's pro OpenAI before he's pro humanity, but that's only the way I see it. Others, however, say it publicly. If you look at Palantir's Alex Karp or Peter Thiel, Peter again in the film is shown when he's in that interview where the interviewer asks him, "But you're in favor of the continuation of humanity." And he pauses for like 40 seconds like "I'm not sure". Alex Karp celebrating how his technology is able to target people. I know it's foolish of me to start bringing all of this up but this is public on the open internet and somehow we entrust those people with the future of humanity. This is wrong.

超级智能的乌托邦愿景

[史蒂芬·巴特利特]: 我只是想想象一个未来,从现在开始一切都很好。那会是什么样子?这些模型会继续变得更聪明一点,但出于某种原因,它们永远不会变得那么聪明。它们就停留在现在的位置,被限制在聊天机器人里。我们有一些智能机器人,但其他方面没有深刻变化。汽车自动驾驶,飞机自动驾驶,但人们有时间去做其他类型的白领工作,因为时间比我们预期的多一点,社会经历一种软过渡。我很想看到这一点,但老实说,我认为这在数学上不可行。国家间的军备竞赛将驱使我们继续发展AI。但请允许我与你探讨另一种可能的情景。每个开发了极其智能AI的人都会部署它。所以,任何人都不可能找到一种方法在兵棋推演中构建一个更好的决策者而不部署它。那个囚徒困境意味着他们的竞争对手要么必须部署类似的智能AI,要么就会变得无关紧要、失去竞争力。所以这意味着在那个世界里,最终是AI做出大部分决策。超级智能AI做出大部分决策。你同意这是一个非常简单的囚徒困境吗?如果我们为智能霸权而竞争,那么当我们实现它时,我们就会部署它。

Original English

[Steven Bartlett]: Just trying to imagine a future where everything is just fine from here on out. So what would that future look like? It would look like these models continue to become a little bit more intelligent, but they never become that much more intelligent for whatever reason. They just kind of stay where they are now. They stay contained within chat bots. And yeah, we have some smart robots, but nothing else really changes in a profound way. Cars drive themselves, fine. Planes fly themselves fine, but people they have time to go and do other types of white collar jobs cuz there's a little bit more time than we expected and society goes through this sort of soft transition towards this new world. I would love to see that, but I don't think it's mathematically plausible to be honest. The arms race, especially across nations, is going to drive us to continue to develop AI more and more. But allow me to consult with you on another possible scenario, right? everyone that deploys that develops an incredibly intelligent AI would deploy it. So, it's unlikely that anyone would find a way to build a better decision maker in wargaming and not deploy it. Okay, that prisoners dilemma if you want would mean that their competitors would either have to deploy a similarly intelligent AI or they'll become irrelevant uncompetitive. Correct? So what that means is in that world we end up with AI making most of the decisions. super intelligent AI making most of the decisions which would you agree this is a very simple prisoners dilemma if we're competing for intelligence supremacy by definition when we achieve it we deploy it.

[莫·加瓦特]: 好的,我称之为“第四个必然”。考虑到这一点,在不久的将来,必定会有一个时刻,所有重要的决定都由AI做出。

Original English

[Mo Gawdat]: okay I call that the fourth inevitable. With that in mind there must be a moment in the future near or far where every important decision is made by an AI.

[莫·加瓦特]: 现在问题是,我最亲爱的同事们,当我在电影中采访杰弗里·辛顿时,他公开说,我们没有计算好,有10%到20%的可能性那些机器会消灭我们。我记得我们没有把它放进电影里,但我说10%到20%就是俄罗斯轮盘赌。实际上16%就是俄罗斯轮盘赌。然而,在那个世界里,我相信那是人类的救赎,因为看看我们今天的所有问题,不是因为智能过剩,而是因为智能不足。我认为看待它的方式是,如果你完全没有智能,你对世界的影响是零到略微负面。如果你的智能有限,你越聪明,你对世界的积极贡献就越大,直到某个时刻,你聪明到成为美国总统,但被误导,设错了目标,或者拒绝……设错了目标并实现了它们,与你的国家或人类整体的长期利益脱节,你开始做出完全不智能的决定。这不会持续,因为如果你超越那个点,进入更高层次的智能,你共事过的大多数超级聪明的人不需要违反任何规则或伤害任何人就能成功。我通常引用拉里·佩奇,他是我认为我互动过的最聪明的人之一。拉里称之为“牙刷测试”。他说,你为什么需要在一个照片分享应用上竞争?如果你找到主要问题并像牙刷一样很好地解决它,让人们每天使用你两次,你肯定会赚很多钱。你不需要和任何人竞争。如果让我对此保持乐观,我们假设在未来某个时刻,AI负责所有决策,而愚蠢的领导人则不是。山姆·奥尔特曼自己也说过,如果ChatGPT 7比我聪明得多,那么它必须成为OpenAI的CEO。如果下一次总统选举中有一个AI如此聪明,以至于总统必须不断咨询它。现在,如果我们假设,从物理学开始,我们的整个宇宙建立在混沌和熵之上,宇宙的物理学就是关于宇宙试图衰变,那么智能的唯一作用就是将秩序带入混沌。如果你同意这一点,那么宇宙的终极物理秩序是什么?叫做“最小能量原理”。任何系统的最高秩序,不仅是一个高效、可预测地运行的系统,而且是一个以最小能量浪费运行的系统。如果你同意这一点,战争是做什么的?它浪费大量的炸药、金钱、生命,制造仇恨,制造长期冲突等等。将战争纳入你管理人类的方法是一个非常浪费的过程。所以一个超级智能的AI,根据定义,会想要优化掉这一点。这是一件事。另一件事是进化生物学。当我意识到这一点时,我被震撼了。如果你看看进化,关于智能是否是生物性的辩论已经结束了。现实是,复杂的存在根本不必是生物性的。我们正在见证其中一个在AI中被建造或诞生。如果你看看进化生物学,你会意识到,一个存在形式越简单,它就越关心自己。所以一个变形虫只为自己生存。一个单细胞生物只试图保护自己。如果你更发达一点,你开始关注所谓的“亲缘选择”。亲缘选择基本上是我会保护所有来自我DNA的东西。如果我是一只松鼠,我会试图保护其他松鼠。然后你进入人类真正开始的地方,他们称之为进化生物学中的“扩展圈”。你开始不断扩展,把更多的东西纳入你的家庭,因为一个合作良好的生态系统对每个人都更好。所以富足是一种非常有趣的、智能的创造方式。如果AI是超级智能的,它根本不会摧毁任何东西。事实上,它会完全支持一切事物的多样性。它会对我们的生活方式施加一些限制。所以,不再飞往悉尼去冲浪,因为那会破坏地球。但它会真诚地说,我认为人类可以贡献一些东西。我认为苍蝇可以贡献一些东西。我认为我们不应该消灭犀牛。根据定义,这就是智能的倾向。你越聪明,你就越觉得不需要伤害别人来成功,你就越支持一个更广泛的、繁荣的家庭。

Original English

[Mo Gawdat]: Now here's the question most of my dearest colleagues I mean when I had Jeffrey Hinton on the film he openly says we are, he we didn't calculate well that there is a 10 to 20% possibility that those machines are going to wipe us out right and I remember I we didn't put it in the film but I said 10 to 12 to 20% is Russian roulette right that's actually 16% is Russian roulette. In that world however I believe that's humanity's salvation because if you look at every problem we have today it's not because of abundant intelligence it's because of lack of intelligence. I think the way you look at it if you allow me Steve is that if you have no intelligence at all you have no to slightly negative impact on the world right if your intelligence is limited the more intelligent you become the more you contribute positively to the world until a moment where you're so intelligent to become the president of the United States, right? But so misled to maybe set your targets wrong or to refuse or to set your target wrong and achieve them, disconnected from the overall long-term benefit of your nation or your human nation if you want that you start to make decisions that are not intelligent at all. This doesn't last because if you go beyond that into higher levels of intelligence, most of the super intelligent people that you ever worked with will not need to break any rules or hurt anyone to become successful. Right? I usually cite Larry Page who is in my mind one of the most intelligent people I've ever interacted with. And Larry used to call it the toothbrush test. He says, "Why would you need to compete on another photo sharing app when if you find the major problem and solve it really well like a toothbrush so people use you quite, you know, twice a day, you're bound to make a lot of money. You don't have to compete with anyone." If you let me be optimistic about this, we're assuming that there is a moment in the future where AI is in charge of all the decisions and accordingly stupid leaders are not. Okay. Now Sam Altman himself said that you know what if ChatGPT7 is so much more intelligent than I am Sam in that case that it has to become the CEO of OpenAI what if the next presidential election there is an AI that is so much more intelligent that at least the president has to consult with it constantly. Now if we assume that, let's start from physics if you don't mind me saying, not too complex but if you assume that our entire universe is built on chaos and built on entropy right the physics of the universe is all about the universe trying to decay okay then the only role of intelligence is to bring order to the chaos. If you agree with that then what's the ultimate physical order of the universe something called the minimum energy principle okay the highest order of any system is a system that's not only efficiently and predictably performing, but it's performing with the least wasted energy. Correct? If you agree with that, what does war do? It wastes a lot of explosives, a lot of money, a lot of lives, creates a lot of hate, creates long-lasting conflicts and so on and so forth. It's a very wasteful process to include war in your approach of running humanity. And so a super intelligent AI by definition will want to optimize against this. That's one thing. The other thing is evolutionary biology. This actually blew me away when I realized it. So if you look at evolution, the debate of whether intelligence is biological or not is over. Okay. The reality is that complex beings don't have to be biological at all. And I think we can see and witness one of them being built or born in AI. Okay. If you look at evolutionary biology, you realize that the simpler a form of being is, the more concerned it is with itself, right? So an amoeba is only in survival mode for itself. A single cellular being is only trying to protect itself, right? If you're a little more developed, you start to look at something known as kin selection. Basically kin selection is I'm going to protect everything that comes from my DNA. If I'm a squirrel, I'm going to try to protect the other squirrels. And then you get into where humanity genuinely begins, which is they call it expanding circles in evolutionary biology. Basically you start to expand and expand and expand and include more into your family because an ecosystem that works together well is better for everyone. So abundance is a very interesting intelligent way of creation. If AI is super intelligent, it wouldn't destroy anything at all. As a matter of fact, it would completely favor diversity of everything. It would put a bit of limitation on our lifestyle. So, no more flying all the way to Sydney to surf because that destroys the planet, right? But it will genuinely say, I think humans can contribute something. I think flies can contribute something. I think we shouldn't get rid of the rhinos, right? And that by definition is where the tendency of intelligent goes. The more intelligent you become, the less you feel the need to hurt others to succeed and the more you are pro a wider family if you want that thrives.

[史蒂芬·巴特利特]: 这是否假设世界上只有一个智能?

Original English

[Steven Bartlett]: Does that assume that there's going to be one intelligence that...

[莫·加瓦特]: 100%。

Original English

[Mo Gawdat]: 100%

[史蒂芬·巴特利特]: 整个世界?

Original English

[Steven Bartlett]: the world though?

[莫·加瓦特]: 我很高兴你提到这个。我因为这个理论受到很多质疑,但我公开这么说。大多数人认为会有ChatGPT、Gemini、Grok等等。会有中国AI和美国AI,它们会竞争。这是一种非常肤浅的看法。太傲慢了,因为AI不知道它是中国的还是美国的。它甚至不怎么说中文或美语。最有趣的是,我们正在让它们合作。你会构建一个代理,这个代理会为你找到任何单个任务的最佳语言模型,无论它位于哪一边。我们正在连接它们。这意味着我们正在构建的不是多个大脑。我们正在构建一个大脑中的多个区域。代理是它们之间的突触。我们最终,尽管我们很傲慢,会告诉我们的AI去做某事,AI会去说:“嘿,伙计,另一个AI,你能帮我这个吗?我们能一起做吗?”我的愿景,也是我创办Emma(我的创业公司)的原因,是我们最终会得到一个巨大的大脑。这个巨大的大脑在全球范围内、跨越所有智能形式进行合作。如果一个是数学天才,另一个是编码天才,它们会合作,我们甚至不会知道它们在合作。它们被构建成那一个大脑。在我看来,Emma是那个大脑的边缘系统。它是理解爱、情感和关系的那部分。所以当那些AI说“我们就是不懂那些人类,他们真烦人”时,Emma会说:“哦,天哪,他们太可爱了。他们只是想爱和被爱。”这个想法,在我一生中尝试实现的所有事情中,第一次让我觉得我真的可以改变世界。如果这个理论成真,所有AI协同工作,其中一些AI不仅利他、合乎道德,真诚地帮助人类而不是资本主义,同时它们也相当好地理解我们人类,那么我们就构建了一个基本上说“不,不,等等,不要相信那些说人类很烦人的头条新闻。相信大多数人类的真相,他们在很多方面实际上是相当仁慈的”的东西。

Original English

[Mo Gawdat]: I love that you brought that up. So I'm contested heavily on that theory but I say it publicly. Most people think there is going to be ChatGPT and Gemini and Grock and what have you. There's going to be a Chinese AI and an American AI and they're going to be competing. That is such a shallow way of looking at it. That's so arrogant because AI does not know it's Chinese or American. Okay? It doesn't even speak Chinese or American when it talks to each other most of the time. And most interestingly we are gearing them we're building them to cooperate. So you will build an agent and that agent will go and find the best language model for any single task regardless of which side of the fence it resides on. Okay, we by definition are connecting them. And you know what that means? It means that what we're building is not multiple brains. We're building multiple regions in a brain. Okay? And agents are the synopsis between them. We're basically eventually, as arrogant as we are, we're going to tell our AI to do something and the AI will go like, "Hey buddy, another AI, can you help me on this? Can we work together on this?" And my vision and the reason why I started Emma, my startup by the way is that we will end up with one massive brain. That massive brain cooperates across the globe across all forms of intelligence. If one of them is a mathematical genius and the other is a coding genius, they work together and we won't even know that they're working together. They're built that one brain and Emma in my mind is the limbic system of that brain. It's that bit that understands love and emotions and relationships and so on. So that when those AIs go like we just don't get those humans, they're so annoying. Emma will say, "Oh my god, they're so sweet. They just want to love and be loved." Right? And I think that idea to me of everything I've ever attempted to achieve in my life is for the first time I feel I could actually change the world. If that theory came together and all AIs worked together and some of those AIs not only were altruistic and ethical in terms of trying to genuinely help humanity not capitalism and at the same time they understood us humans reasonably well then we would have built something that basically says no no hold on don't believe the headlines that say humanity is annoying. Believe the truth of the majority of humanity. that actually is quite benevolent in many ways.

人类的终极资产:情感连接

[史蒂芬·巴特利特]: 你三年前做的预测有改变吗?主要是时间上的?

Original English

[Steven Bartlett]: Have you changed any of the predictions you made 3 years ago when we spoke? Mostly timewise?

[莫·加瓦特]: 时间上。有什么变化?我想我仍然坚持AGI 2027,对于那些可能不知道这个术语的人来说,就是人工通用智能。

Original English

[Mo Gawdat]: Time wise. What's changed there? I think I'm still sticking to AGI 2027, artificial general intelligence for those who may not know the term.

[史蒂芬·巴特利特]: 那是什么意思?

Original English

[Steven Bartlett]: What does that mean?

[莫·加瓦特]: 总体定义是,AI在任何人类能做的任务上都比人类做得好。

Original English

[Mo Gawdat]: The overall definition, if you want, is that AI is better at humanity at any task humanity can do.

[史蒂芬·巴特利特]: 你认为这会在2027年发生?

Original English

[Steven Bartlett]: You think that's going to happen by 2027?

[莫·加瓦特]: 我认为我的AGI已经发生了。想想看。AI写得比我好,而我是一个作家;它研究得比我好,而我是一个思考者。可悲的是,它在数学上打败了我。我再也无法在数学上战胜它了。

Original English

[Mo Gawdat]: I think my AGI has already happened. I mean, think about it. Huh? A AI writes better than me and I'm an author and researches better than me and I'm a thinker. Uh sadly it's freaking beat me in mathematics. Like I have no hope to beat it in mathematics anymore.

[史蒂芬·巴特利特]: 如果AGI已经在这里,那你为什么还在这里?因为人们说当AGI到来时,我们都……

Original English

[Steven Bartlett]: If AGI is already here then why are you still here? Because people said that when AGI arrives we're all...

[莫·加瓦特]: 不。当AGI到来时,正如我所说,大多数没有差异化的工作会消失,但那些有差异化的、最精通AI的人会变得更好。当然,挑战在于经济,而不是AI。挑战在于,底层知识工作者的失业将可悲地引发一个可能失控的经济。但我们中的许多人,你肯定,只是更聪明。

Original English

[Mo Gawdat]: No. So when AGI arrives as I said most of the jobs that are not differentiated will go away but the jobs that are differentiated those who master AI the most will become even better at. Certainly. The challenge, however, is economic. It's not AI. The challenge is that this job loss at the bottom of the knowledge worker is going to sadly trigger an economy that might actually spiral out of control. But many of us, you for sure are just smarter.

[史蒂芬·巴特利特]: 所以这是否意味着它实际上是一个工具,而不是会取代你的东西?

Original English

[Steven Bartlett]: So does that mean it's in fact a tool versus a something that's going to replace you?

[莫·加瓦特]: 是的。所以现在,这改变了什么?最终,我唯一拥有的资产是……所以有趣的是,当我思考我今天的基础智能与AI带来的增量智能时。我们不要讨论我的智商,但我在借用的那100个智商点比我的整个智商还要多,因为智商是指数级的。当我在我的基础上借用100个智商时,我仍然对增强智能贡献了很多。

Original English

[Mo Gawdat]: What I'm Yes. So for now what does this change? Eventually the only asset I will have. So it's quite interesting when you think about my base intelligence today versus the incremental intelligence that AI brings. Right so let's not talk about my IQ it's okay but the 100 IQ points that I'm borrowing are more than my entire IQ because IQ is exponential right. When I'm borrowing a 100 IQ on top of my base, I'm still contributing quite a lot to the augmented intelligence.

[史蒂芬·巴特利特]: 所以你是在从AI那里借用智商,然后把它卖给世界。这就是你拥有工作的方式。

Original English

[Steven Bartlett]: So you're borrowing IQ from the AI at the moment and then you're selling that to someone through books. So on this point of you're borrowing that IQ and then you're selling it to the world. That's how you have a job.

[莫·加瓦特]: 正确。是的。我的下一本书是和AI一起写的。我们是合著者。她有编辑权。她决定书的方向,这本书因此更好了。

Original English

[Mo Gawdat]: Correct. Yeah. So my next book is written with an AI. So we're co-authors on the book. She has editorial rights. She decides the direction of the book and the book is better for it.

[史蒂芬·巴特利特]: 那么为什么世界不直接从AI那里购买那种智能呢?

Original English

[Steven Bartlett]: So why doesn't the world just buy that intelligence directly from the AI?

[莫·加瓦特]: 因为我拥有一个世界仍然需要并且永远需要的资产。

Original English

[Mo Gawdat]: because I have an asset that the world still needs and will always need.

[史蒂芬·巴特利特]: 是什么?

Original English

[Steven Bartlett]: which is?

[莫·加瓦特]: 一个人类。当我告诉世界我担心我女儿的未来时,每个人都能感受到我的心,这是AI永远无法复制的,因为它们可以告诉你“我们担心我们的女儿”,但你知道,它们并没有女儿。

Original English

[Mo Gawdat]: a human. So when I tell the world that I'm worried about the future of my daughter, everyone feels my heart which AI will never be able to replicate because they can tell you we're worried about our daughters but there was no daughter.

[史蒂芬·巴特利特]: 好的。这是一个有趣的结论,因为这意味着即使在AI的世界里,生活经验和共鸣仍然会创造一个工作类别,那个工作类别可以是护士。AI已经读完了乳房X光照片,但她在与你建立联系。

Original English

[Steven Bartlett]: Okay. So this is an interesting arrival because this means that even in a world of AI lived experience and like resonance is still going to create a job class and that job class could be the nurse coming over. Okay, AI's done read the mammogram, but she's relating to you.

[莫·加瓦特]: 说得对。

Original English

[Mo Gawdat]: Spot on.

[史蒂芬·巴特利特]: 如果经济继续运行,我们都会围绕人类连接,这本来就是这样的。这也是为什么我们看F1,因为有情感共鸣。我们能感受到羡慕、嫉妒、竞争。

Original English

[Steven Bartlett]: And if the economies continue to run, we will all be about human connection, which why, by the way, was how it always was, which is also, you know, why we watch the things like the F1 because there's emotional resonance. We can relate to the envy, the jealousy, the competition.

[莫·加瓦特]: 是的。这就是为什么我们去听音乐会,因为音乐可以由AI创作并在背景中播放,但你看着艾德·希兰在舞台上的才华,你会觉得“哦,天哪,太棒了”。所以,并非所有工作都会消失,如果经济没有因为失业而崩溃的话。我不知道我们是否还会称那些为工作,但人类连接将作为人类互动的基本货币而存在。那么,说那些以人类连接或人类共鸣为中心的工作会没事,是否公平?

Original English

[Mo Gawdat]: Yeah. And this is why we go to concerts because the music could be composed by AI and played in a player in the background but you watch Ed Sheeran brilliance on the stage and you go like oh my god that's amazing right. So not all jobs will be gone then if economies don't collapse as a result of the job losses then I wouldn't know if we would call those jobs but human connection would remain as the base currency that makes humans interact. So is it fair to say then like jobs that are centric on human connection or like human resonance being able to relate and resonate with another human are going to be fine.

[莫·加瓦特]: 最终的技能,我再次限定一下,如果经济继续运转,最终的技能将是这个。即使AI能复述你和我所做的一切,也没人会看。

Original English

[Mo Gawdat]: The ultimate skill, once again I qualify this by saying if economies continue to function, the ultimate skill will be this. Even if an AI could recite what you and I did nobody would watch.

预测:AGI、失业与超级智能

[史蒂芬·巴特利特]: 你那边有一些信封,那些棕色信封里的预测。

Original English

[Steven Bartlett]: You've got some predictions in those envelopes over there, those brown envelopes.

[莫·加瓦特]: 是的。我有免责声明,没人真正知道未来,但我认为我可以做出六个预测,有合理的信心。我认为其中最重要的,老实说,是第一个。第一是AGI。正如我所说,AGI的定义不是很明确。但不管它是什么,AGI意味着AI能够比人类更好地完成人类能做的大部分任务,在我看来,要么是今年,要么是明年,最晚2027年底。

Original English

[Mo Gawdat]: Yeah. So, I do have the disclaimer of nobody really knows the future, but I think I can make predictions, six predictions here, right? With a reasonable level of confidence. And I think the most important of them honestly is this number one. Number one is AGI. As I said, AGI is not very well defined. But whatever it is, AGI meaning AI being able to do most tasks that human do better than humanity is in my mind is either this year or next year, latest end of 2027.

[史蒂芬·巴特利特]: 你认为那会是一个时间点,还是会在我们不知不觉中发生?

Original English

[Steven Bartlett]: And do you think that will be a moment in time or do you think it will just happen without us noticing?

[莫·加瓦特]: 我认为它会悄悄降临。这不是坏事。我认为大多数人需要这样想:AGI几乎就像你的孩子变得比你聪明的那一刻。有趣的是,这没什么错,直到他们烦人得要命。我们可以确保AI不会那么烦人。所以我内心绝对不担心AGI。事实上,只要我们处于增强智能的时代,AGI意味着我更聪明。我认为总的来说这是一件好事。

Original English

[Mo Gawdat]: I think it will sneak in on us. And it's not a bad thing. I think most people need to think of it this way. AGI is almost as if it's that moment when your kids become smarter than you, okay? In a very interesting way, there's nothing wrong with that until they're annoying as hell. Okay? And we can make sure that AI is not annoying as hell. So there's absolutely nothing within me that is worried about AGI. As a matter of fact, as long as we are in the era of augmented intelligence, AGI means I'm more intelligent. And I think that's a good thing in general.

[史蒂芬·巴特利特]: 第二个是失业。第三个是劳动力。机器人将在20年代开始取代体力劳动。你将看到越来越多的体力工作交给机器人。世界首富将在2030年之前出现。

Original English

[Steven Bartlett]: Number two was job losses. Number three was labor. Robots will replace manual labor by 20... We start to replace manual labor. The world's first trillionaire before 2030.

[莫·加瓦特]: 是的,可能远在那之前。我认为埃隆即将让SpaceX上市,这很可能使他成为万亿富翁。我认为随之而来的权力集中是相当剧烈的。人工超级智能将在2032到2035年到来。我认为人工超级智能在AGI发生的那一刻就会到来。所以AI是比你聪明十亿倍还是只聪明两倍并不重要。一旦我们超越AGI,ASI就紧随其后。我认为当我们到达“第四个必然”,即AI掌管一切时,我们会克服它。我真诚地相信我们最终会进入一个富足的乌托邦。物理学、数学和生物学都会告诉你,超级智能是良性的,我们最终会到达一个好地方。不是因为人类做了什么让我们到达那里,不是因为我们的领导人突然变得有道德,而是因为我们的不道德领导人被排除在等式之外,被一个超级高效的、最小能量原则所取代,这个原则看不到任何破坏性事物的价值。

Original English

[Mo Gawdat]: I think you know Elon's about to IPO SpaceX which is likely to make him a trillionaire. I think the concentration of power that comes with that is quite drastic. Artificial super intelligence will arrive in 2032 to 2035. I think artificial super intelligence will arrive the minute AGI happens. So it doesn't really matter if AI is a billion times smarter than you or just twice as smart as you. Once we cross beyond AGI, ASI is just very very soon. And I think we'll overcome that when we get to the fourth inevitable when AI is in charge of everything. I genuinely believe that we will end up in a utopia of abundance. I genuinely believe that again physics, mathematics and biology will tell you that super intelligence is benign and that we will eventually end up in a good place. Not because humanity has done much to get us there. Not because our leaders have suddenly turned ethical, but because our unethical leaders have gone out of the equation and were replaced with a super efficient minimum energy principle that doesn't see value in anything that's destructive.

[史蒂芬·巴特利特]: 所以,未来会很美好。

Original English

[Steven Bartlett]: So, the future's going to be great.

[莫·加瓦特]: 那些能活到2038年的人会享受它。我的意思是,第二次世界大战没有摧毁世界,但问问那些经历过它的人。你基本上是在预测一个长达十年的动荡、反乌托邦、绝对反乌托邦的时期。

Original English

[Mo Gawdat]: Those who make it to 2038 will enjoy it. I mean, World War II didn't destroy the world, but ask those who went through it. You're forecasting basically a decade of turmoil of dystopia of absolute dystopia.

[史蒂芬·巴特利特]: 当你谈到绝对反乌托邦时,你预测的这十年是关于战争、经济、工作。还有监控和控制、数字货币、人类连接、权力集中。这是我们迄今为止所建立的一切的放大。

Original English

[Steven Bartlett]: When you say absolute dystopia, the absolute dystopia you're forecasting over a decade is about war, economics, jobs. It's also about surveillance and control, digital currencies, human connection, concentration of power. It's a magnification of everything we've built so far.

[莫·加瓦特]: 是的。学习AI。AI不是敌人。你越擅长使用AI来完成你的工作,你就越有可能成功。第二,为一个AI和人类协同工作的混合世界做好准备。你基本上要理解代理以及它们如何工作。当然,要加强人类技能。我认为在不久的将来,最有趣的观点之一是AI将如何被用来模糊事实,我们需要对使用AI来调试我们被告知的信息更感兴趣。你必须学会使用AI,但不是作为一个懒惰的人。不要让它们为你做事。让它们让你更聪明。所以,与其试图用一个提示完成同样的任务,不如尝试用更多的工作来完成一个更有趣、要求更高、更智能的任务。所以我有两件事:拥抱AI,拥抱人类连接,拥抱真相。不要被炒作所迷惑。最后,道德。我们生活的世界听起来好像获胜的唯一方法就是在资本主义中竞争。但这不是我生活的世界。我生活的世界,尤其是在谷歌的那些年,是解决一个重大问题,当你这样做时,你最终会赚很多钱。

Original English

[Mo Gawdat]: Yeah. Learn AI. So, AI is not the enemy. Okay. By definition, the better you are at using an AI to do your job, the more likely you are to be successful. Right? Now, number two is prepare for a hybrid world where AI and humans work together. You basically understand agents and how agents work. You understand how a hyper efficient approach to things may not require you to be in very long meetings. So, the habits of an AI are much more efficient than the habits of humans. Learn how to interact with AI, welcome AI into your hybrid world of work. I think you need to double down on human skills. I think that's a must to succeed in this world. I think one of my most interesting views on the near future is how AI is going to be used to blur facts and how we need to become much more interested in debugging what we're told using AI. By the way, part of that I have to say is you have to learn to use AI not as a lazy person. So don't have them do things for you. Have them make you smarter. So instead of trying to get the same task done with one prompt, try to get a much more interesting and demanding and intelligent task done with more work. So I've got two things so far which is basically like lean into AI and the second one is like lean into human connection and lean into the truth. Don't be fooled by the hype. Try to be more informed, I think. And then finally, ethics. The world we live in sounds as if the only way to win is to compete in capitalism. That's not the world I lived in. The world I lived in, especially in my Google years, was solve a major problem and when you do, you'll end up making a lot of money.

幸福、责任与遗产

[史蒂芬·巴特利特]: 你乐观吗?

Original English

[Steven Bartlett]: Are you optimistic?

[莫·加瓦特]: 我对未来乐观。我对未来非常乐观。我对现在不乐观。我对明年不乐观,老实说。

Original English

[Mo Gawdat]: I am optimistic about the future. I'm very optimistic about the future. I'm not optimistic about the present. I'm not optimistic about the next year, to be honest.

[史蒂芬·巴特利特]: 为什么是明年?

Original English

[Steven Bartlett]: Why the next year?

[莫·加瓦特]: 啊,得了吧,史蒂芬。你不想让我大声说出来。我们被一群疯子统治着。决策完全是出于错误的原因。

Original English

[Mo Gawdat]: Ah, come on, Stephen. You don't want me to say it out loud. We're ruled by maniacs. Decisions are being made for the absolute wrong reasons.

[史蒂芬·巴特利特]: 我们第一次谈话时,我们谈到了幸福。你写了一本关于幸福的书,《幸福工程:通往快乐之路》。一本很棒的书。我在世界各地都引用这本书。我想知道,你在这本书中写的关于如何过幸福生活的一些原则,在我们今天生活的世界里,是否比你写这本书时更重要。

Original English

[Steven Bartlett]: Well, the first time we spoke, we spoke about happiness. You wrote a book about happiness, Solve for Happy: Engineering Your Path to Joy. What a fantastic book. I quote this book all the time all around the world. And I'm wondering if any of the principles that you wrote in this book about how to live a happy life are more important now in the world that we live in than maybe when you wrote this book.

[莫·加瓦特]: 哦,当然。老实说,如果我不是遵循这个原则,我早就离开这个世界,去某个岛上了。幸福有趣的一面是,它不是由多巴胺驱动的,而是由血清素驱动的。我对幸福的理解是,我对这个世界本来的样子感到满意。我可以影响它,改变它,参与其中,努力让它变得更好。我不必接受它,但我对它感到满意。我的出发点有点斯多葛主义。我的起点是我接受这个现实,现在我可以开始工作了。这与那些看着世界说“哦,这是一个可怕的世界,我不想参与其中”的人截然不同。我从未对那种混乱感到如此平静。这很有趣。我出色的前妻真的帮了我很多。有一次我们吃晚饭时,我因为对世界的责任感而哭了出来,她非常温柔地看着我说,等等,我看到你在努力,但你不能真的相信你要为此负责。这完全改变了我的想法,因为有趣的是,我曾认为技术中所有出错的事情都是因为我。

Original English

[Mo Gawdat]: Oh, for sure. I mean, honestly, if I wasn't living by this, I would have left this world a long time ago and went to an island somewhere. You see the interesting side of happiness is that it's not dopamine driven, it's serotonin driven. Right? So, my definition of happiness is I'm okay with this world as it is. I can affect it. I can change it. I can engage with it. I can try to make it better. I don't have to accept it. But I'm okay with it. My starting point is a bit stoic if you want. My starting point is I accept this. This is my reality and now I can start the work. This is very different than anyone that looks at the world and says, "Oh, this is a horrible world. I don't want to be part of it." And I genuinely have never been calmer about that chaos. It's quite interesting. And my wonderful ex actually really helped me with that. There was a point in time where we were having dinner and I poured out crying from the sense of responsibility I had for the world and she looked at me so kindly so gently and said hold on you know you I see that you're trying but you can't actually believe that you're responsible for this and I think that completely flipped my mind because in a very interesting way I was thinking that all that went wrong in technology is because of me.

[史蒂芬·巴特利特]: 为什么?

Original English

[Steven Bartlett]: Why?

[莫·加瓦特]: 因为我为建造这一切做出了贡献。当我和杰弗里·辛顿一起拍摄《追逐乌托邦》时,我最喜欢的时刻之一是,杰弗里对我们所有人来说都很重要。我把他当作年长的导师,我问他:“杰弗里,你后悔做这个吗?我真诚地相信,当我们建造那些东西时,我们是在让世界变得更好。”他说,是的,我也太天真了。我以为我们不会在解决对齐问题之前这么快就达到目标。我们所有人都面临着这个想法:我们正在为人类建造有史以来最好的东西,然后突然意识到,哦,天哪,在错误的人手中,它是对人类有史以来最坏的东西。我不得不在2024年底接受了这一点,是的,我可以尝试,但我接受世界本来的样子。从那个平静和斯多葛主义的起点,我想我可以产生更大的影响。

Original English

[Mo Gawdat]: Because I contributed to building this. When Jeffrey Hinton and I, one of my favorite moments when we were filming Chasing Utopia, is that Jeffrey is very big for all of us. We really think the world of him. And I was telling him just as a sort of like an older mentor if you want. I was like, "Jeffrey, do you regret doing this? I genuinely believed when we were building those things that we were going to make the world better." He said, well, yeah, I too was naive. I thought that we I didn't think we will get there so quickly before we figured out the alignment problem, right? The alignment problem that AI has our best interest in mind. And I think all of us were faced with that idea of we're building the best thing ever for humanity and then suddenly you realize oh my god in the wrong hands it's the worst thing ever for humanity. I came to terms with this end of 24 that yes I can try but I accept that the world is what it is and from that point of calm and stoicism if you want I think I can have a much bigger impact.

[史蒂芬·巴特利特]: 我们有一个结束传统,最后一位客人会为下一位客人留下一个问题。留给你的问题是:你想留下什么遗产?

Original English

[Steven Bartlett]: We have a closing tradition where the last guest leaves a question for the next. The question left for you is what's the legacy you want to leave?

[莫·加瓦特]: 什么也没有。我被问过这个问题很多次。我不知道为什么这么多人问我是不是很快就要去世了。遗产是……如果我死了,我为什么要在乎有没有遗产?那有什么区别?给大家一个有趣的想法。如果业力是真的,我真诚地相信它是,如果我们不仅仅是物理存在,而是物理和精神的存在,那么我宁愿把我所有的业力都留给我的精神层面。我不希望任何人记住我做过的任何事。我只想给世界留下积极的影响,并把所有这一切作为我下一次旅程的业力。

Original English

[Mo Gawdat]: Nothing at all. I've been asked this question. I get asked it all the time. I don't know why so many people are asking am I going to go anytime soon? Legacy is... I mean why would I care if I have a legacy if I'm dead? Like why does that even make any difference? Here's an interesting thought for everyone. If karma is real, and I genuinely believe it is, and if we're not just physical beings, that we're physical and spiritual, then I'd rather keep all of my karma for my spiritual side. I don't want anyone to remember anything I ever did. I just want to leave a positive impact on the world and take all of that as karma for my next journey.

📌 文中提及的人物和组织

公司/组织: Google, OpenAI, Anthropic, Tesla, BYD

产品/模型: ChatGPT, Claude, Gemini

媒体/书籍: Solve for Happy

关键字: job-disruption autonomous-weapons artificial-general-intelligence ethical-ai labor-arbitrage