AI行业与数学突破:资本、市场与经济效用的探讨
Speaker A: 现在,如果我给20个人十亿美元的资金,他们实际上能够非常有效地将其利用起来。我们已经在某种程度上将这个行业从一个受限于工程的难题,转变为了一个受限于资本的难题。这在本质上是非常不同的两码事。
Original English
Speaker A: Right now, if I give 20 people a billion dollars, they can actually use it usefully. We've kind of moved the industry from like this engineering bound problem to a capital problem. That's fundamentally very different.
Speaker B: 数学在很大程度上是市场未来可能会感兴趣的一个前沿指标。为什么这么说呢?因为有些人会走过来说,通往通用人工智能(AGI)和高级推理能力的基础将会是数学,但那种说法其实并不能告诉你任何关于现实情况的有用信息。对我来说,它目前仍然属于那种“它非常擅长玩游戏”的领域。初创公司并没有直接将目标对准那些老牌企业,而老牌企业也根本没有予以关注。微软对亚马逊和谷歌正在做的事情的担忧,要远远大于对初创领域里任何人的担忧。在硅谷,每一个来自大公司的人都会一直觉得:“哦,天哪,我们肯定会轻而易举地压垮所有这些小公司。” 然后你就会意识到,他们永远不会被压垮。我认为这就是为什么我们现在看到诸如Cursor、Anthropic以及OpenAI等公司能够迎来如此流星般迅猛崛起的火热发展。尽管现在资本很稀缺,获取资本非常困难,而且一旦你获得了资本,还会面临所有其他的各种挑战。
Original English
Speaker B: Math is very much a leading edge indicator of what the market might be interested in. Why? Some people will walk in and say the foundations to AGI and to reasoning is going to be math, but like that doesn't tell you anything about reality. For me, it's still in the domain of like it's really good at playing a game. The startups don't aim straight at the incumbents and the incumbents just don't pay attention. Microsoft is worried way more about what Amazon and Google are doing than anyone in a startup space. Everybody who's from a big company in Silicon Valley, you always think, "Oh my god, we're just going to crush all of these little companies." And then you realize they never get crushed. And I think this is why we're seeing such meteoric roasts of the cursors, the anthropics, and the open AIs. Although capital is scarce and it's hard to get and all of these other things once you get it.
开场与关于黎曼猜想的讨论
Host: 首先,非常感谢你们两位能抽出宝贵的时间来到这里。这太棒了。几天前,Jared Ser 在推特上发了一些内容,大概是他如何让 Claude 尝试去解决黎曼猜想(Riemann hypothesis),并让它更加努力地去尝试。我不知道在这方面是否真的取得了任何实质性的进展,但这属于一个更大范围对话的一部分,那就是——嘿,似乎人工智能在数学方面正在取得一些成就。我们该如何从实际正在发生的事情的角度来理解这一切?这对数学又到底意味着什么呢?
Original English
Host: First off, thanks for both of you making time to be here. That's great. Um Jared Ser tweeted a few days ago something along lines of uh how he told Claude to try to solve the reman hypothesis and to try harder and uh I don't know if there was actually any progress made but it's part of the larger conversation around hey it seems like there's some uh accomplishments that are being made. H how do we make sense of this in terms of what is actually happening and what does it mean for for math?
Speaker A: 我打算让 Steve 先来说说这个话题。
Original English
Speaker A: I'm gonna let uh Steve go.
Steve: 哦,好吧,我根本不是什么数学家,但我认为,我的意思是,我认为这只是——这是一个非常重要的时刻,因为它在某种程度上把世界划分成了两个不同的群体。一个群体的人非常非常兴奋,就好像是“哦,天哪,这些难题居然正在被解决。” 至于你是否真的理解它们,这其实并不重要。实际上,没有多少人理解,世界上能够真正理解这些东西到底是什么的人数是非常非常少的。然后还有另一类人,他们只会觉得,“哦,这是假的,它会让人们失去工作,未来没人会知道这些领域将走向何方。” 而关于这件事最有趣的一点在于,最感到兴奋的那个群体主要是数学家们。他们才是真正感到兴奋的人,而这实际上让所有其他人都感到困惑。因为如果你属于那一派认为“它会让人们失业,我们都会变笨,这是蠢蛋进化论时代的曙光,因为计算机正在做我们所有的工作”的人,你就会感到非常困惑——为什么那些受这种水平的人工智能影响最大的人,反而是最兴奋的。
Original English
Steve: Oh, well, I'm no mathematician at all, but I am I mean I think it's just it's an important moment because it sort of divides the world into two groups like the groups that are just very very excited that like oh my god these things are being solved. It doesn't matter if you understand them. actually nobody unders the number the universe of people who understand what these things are is very small and then there are the people who are just like oh it's fake it's going to put people out of jobs that no one's going to know the future of where these fields go and the most interesting thing about it is the group that's most excited are mostly the mathematicians and and they're the ones and so that actually confuses everybody because if you're of this school of the people who are like it's going to put people out of work and it's going to we're going to all get dumber and it's, you know, the dawn of idiocracy because computers are doing all of our work. You're confused that the people who are impacted most by what this level of AI did are the most excited.
Speaker A: 是的。完全没错。
Original English
Speaker A: Yeah. Yeah.
Steve: 而且我认为那只是——我个人认为,这本身就照亮了我们当下所处的这个特殊的时代时刻。
Original English
Steve: And I think that's just I I I think that that is itself shining a light on this moment that we're in right now.
经济效用与解决数学问题的商业动机
Speaker A: 你知道的,你现在是在和两个做系统的人、两个做产品的人交谈。你会得到的回答大概是——我们通常都会有同样的免责声明。我觉得有些事情我们实际上都非常内行,但这件事(数学)显然不是其中之一。所以我打算从旁观者的角度来发表两点看法。
其中一点是,好吧,所以我认为当你在谈论人工智能时,经济效用(economic utility)是一个非常重要的衡量标准,对吧?所以我一直在试图思考,有很多时间被投入到试图解决某些数学难题上,对吧?但是,如果你把多年来一直致力于研究这些问题的所有博士后的薪水加起来,总额可能也并没有多少。因此,我内心有一部分在想,拥有这些强大的能力确实很棒,但我不太确定这些问题悬而未决那么久这一事实,是否真的能作为一个强烈的指示信号,因为之前并没有巨大的经济动机去解决它们。
当然,这并不意味着它不难或者别的什么。这只是说,我只是不认为我们已经得到了那种验证,证明这种突破能释放出洪水般巨大的经济价值。
第二点是,人工智能非常擅长解决一个几乎纯粹由公理构成的领域的问题,这对我来说并不令人意外。你知道,这需要了解一大堆不同的事物,并且把来自非常不同领域的解决方案拼凑在一起。因为通常真的,当我读到——因为我最近也一直在读这些,就像其他人一样痴迷,他们会说“哦,我想出了解决方案”,其实就像是:“是啊,这个解决方案非常直截了当。它只是借用了一点我以前不知道的数学知识而已。”
所以,我认为如果这里有什么元学习(meta-learning)的话,那就是存在一系列问题,这些问题可能对大多数人类或大多数教育体系来说过于宽泛,而人工智能将会去解决这些问题。它显然非常擅长解决公理化的系统问题,但我不认为这提供了一个强烈的指示信号,说明它是否正在解决市场迄今为止未能解决的问题,因为围绕这些问题其实根本就不存在一个成熟的市场。因此,我认为这些是我们最需要去回答的问题。总之非常令人兴奋。似乎有些合理且可以理解。但我不太确定更长远的深远影响会是什么。
Original English
Speaker A: You know, you're talking to two systems guys, two product guys. You're going to get like we're we're like to have the same caveat. I feel there's some things like we're actually both very expert on. This is not one of them. So I'm going to kind of from the peanut gallery I I've got a two comments.
So one of them is like okay so I I view like economic utility to be a very important measure when you're talking about AI right so I was trying to think like there's a lot of hours been trying to solve some math thing right but like if you sum up the entire posttock salaries of all the people that have been working over the years on these problems is probably not very much and so part of me is saying like it's great that there's these capabilities I'm not sure that the fact have been longstanding as that much of an indication because there hasn't been a huge economic incentive in order to solve.
Now that doesn't mean that it's not hard or whatever. It's just like I just don't think we have like that like that that validation of this unlock some deluge of like economic value.
And the second one is it's kind of not surprising to me that AI is very good at solving a almost purely axiomatic domain that you know requires knowing a whole bunch of different things and and putting you know putting the solutions together from very disperate spaces because often really when I read so I've I've been reading all these like everybody else has been obsessively they're like oh like I came up with the solution it's like Yeah, the solution was pretty straightforward. It just like it borrowed from a bit of math that I didn't know.
And so I I think if there's like a metalarning here, the metalarning is is there is a set of problems that probably, you know, require you being too broad for most humans or most education and it's going to solve those. It's clearly very good at solving aatic systems, but it's it I don't think it provides a strong indication of is this solving things that the market hasn't been able to solve because there really hasn't been a market around these. And so I think that's the best questions for us to answer. So very exciting. Seems kind of reasonable and understandable. Not sure what the longer term implications are.
Steve: 我确实认为,有趣的是,数学在很大程度上是市场可能感兴趣的一个前沿指标。为什么?我的意思是,如果你——就像我记得我在上学的时候,有一件大事,AT&T 的某个人发明了一种新的算法,一种进行线性代数计算的新程序,一种解决线性问题的新方法,这在现在的 AI 领域是超级重要的。但他当时最看重的是:“好吧,现在我们计算联合航空(United Airlines)的航线图的时间,可以比上周缩短3个小时了”,对吧?
但是,让我们深入探讨一下——所以,我并不清楚正在被解决的那些问题,是否就是阻碍现有具有经济价值的任务的那些绊脚石,对吧?如果它们是的话,我也不清楚它们是否就不会被解决。就像一个拿着3万美元年薪、苦苦思索某个问题长达5年的博士后,这与“市场决定这就是必须要解锁的唯一关键问题”是非常不同的。
也许它们确实在那里。也许这些正在被解决的问题,正是解锁某个能产生巨大经济效益的用例的关键问题。只是我目前还没有看到这一点。所以,对我来说,这就像是我下一步要去寻找和关注的事情。
Original English
Steve: I do think that there's something interesting that math is very much a leading edge indicator of what the market might be interested in. Why? I mean, if you like I remember when I was in school, like there was some big thing that someone at AT&T invented a new algorithmic, a new program for doing linear algebra, like a new way to solve linear, which is super important right now in the AI world. But his big thing was, well, now we can just calculate like the United Airlines flight map in like 3 hours less time than we could last week, right?
But but let's dig into So, it's just not clear to me that the problems being solved are those that are roadblocks to like existingly economically useful tasks, right? And if they were, it's not clear to me that they wouldn't have been solved. Like posttock that's been ruminating on a problem getting paid 30k a year for 5 years. Like it's very different than like the market has decided that this is like the one thing to unlock.
And and maybe they're there. maybe these problems that are being solved are like the key problems to unlocking some big economically productive use case. I just haven't seen that yet. So that for me is like the next thing I'm kind of looking for.
Speaker A: 我甚至都不知道12维空间是什么,或者那到底意味着什么。所以在这方面我完全同意你的看法,就像我根本不知道12维空间里的问题究竟是什么。比如,你是非常骨感吗?你是非常微小吗?我对那个真的感到很困惑。
Original English
Speaker A: I don't even know what 12dimensional spaces or what that means. And so like I I'm completely with you on like I don't even know what problems are in 12 dimensional space. Like are you very skinny? Are you very tiny? I'm really confused by that.
Speaker B: 而且,也许我在这里的看法是错的,但对我来说,它仍然处于“它非常擅长玩游戏”的范畴里。就像,它是史上最优秀的《星际争霸》(Starcraft)玩家,这很酷,它也非常强大,但我觉得很难将那与现实直接联系起来。比如也许我们以前没有这些能力,仅仅是因为缺乏经济上的需求;再比如,它在现实中到底该如何映射应用呢?所以,听着,存在一大堆各种各样诸如此类的东西。我们总是能听到各种推销说辞。
有些人会走过来说,你知道的,通向 AGI 和推理的基础将会是数学。一旦你做到了这一点,你就能够回答每一个问题,因为宇宙就是建立在某些基础的数学原理之上的。一旦你理解了那些数学原理,你就理解了一切。然后,你知道的,还有其他人,坦率地说,他们走进门后会直接说:“听着,那很棒。但是,那并不能告诉你任何关于现实的情况。”所以,你知道,我认为还有更多的工作要做,这不仅仅是关于在数学上变得更好那么简单。
Original English
Speaker B: And and maybe I'm wrong here, but for me it's still in the domain of like it's really good at playing a game. like this is the best Starcraft player ever, which is cool and it's very powerful, but like I have a hard time connecting that with a like maybe the reason we didn't have them before is because there just was an economic need and b like how does that actually map? And so listen, I there's a huge range of these things. We get pitches all the time.
Some people will walk in and say, you know, the foundations to AGI and to reasoning is going to be math. And once you do that, you'll be able to answer every question because the universe is based on some, you know, fundamental mathematical principles. And once you understand that, you understand everything. And then, you know, there's other people candidly that walk in the door and they're just like, listen, that's great. Um, but like that doesn't tell you anything about reality. And so, you know, I think that there's more work to do and this isn't just about like getting better at math.
数学家的思维方式与长期的历史弧线
Steve: 是的。我确实认为,有趣的一点是,数学家们之所以对它如此兴奋,部分原因在于他们的工作方式。比如,如果你研究历史,历史中基本上没有抽象化(abstraction)这回事。历史就只是一堆事实,然后人们在此基础上发展出类似于某些模型的理论,你几乎可以把它们看作是用来解释战争、饥荒或任何其他现象的受力分析图。然而,对于数学家以及数学这门学科来说,它有着一条极其漫长的、在历史长河中不断叠加抽象概念的弧线,紧随其后的是……
Original English
Steve: Yeah. I do think what's interesting is that the part of the reason that the mathematicians are very excited about it though is because they they work a certain way. Like if you work in in history, there's basically no abstraction in history. Like there's just a bunch of facts and then people develop like sort of these models that you can think of almost as force diagrams that explain war or famine or or whatever. Whereas mathematicians and mathematics has this super long historic arc of layering on abstractions after
AI与数学的新抽象层
Speaker A:不用担心,我们过一会儿就会讲到 OSI。但是,但是……你看,这种他们为什么如此兴奋的想法,就像是把一大堆数学突然之间变成了一个新的抽象层。
Original English
Speaker A: ...and we'll get don't worry we'll get to OSI in a minute. But but but but like this idea that that where what why they're so excited is like a bunch of math all of a sudden becomes a new level of of abstraction.
Speaker B:他们真的如此吗?我发现这是一个混合的状态。我发现有些人非常兴奋,而有些人则陷入了类似生存危机的状态。那些兴奋的人,他们基本上会说:“听着,它解决了我的工作中20%的事情,而这20%本来就是我无论如何都不喜欢做的。所以,这让我能去探索一个非常重要或者别的新领域。”而我一直好奇的是,这是否跟正在解决的问题类型有关?比如我根本无法想象,如果AI出现并治愈了癌症什么的,那些研究癌症的人会说:“哦,我感到了强烈的生存危机,我很沮丧。” [笑声] 这明明是很惊人的事情。但是另一方面,如果是“哦,我们看到了这个数学问题被解决了,我好沮丧”,因为可能,真的是字面意义上,那个问题唯一的价值就是雇佣某个人去解决它。
Original English
Speaker B: Is it true that they're so I I've found that it's a mixed. I found that some are very excited and some are in like an existential crisis. The ones who are excited they basically say listen it it it solves 20% of my job is the 20% I didn't like anyways. So like this allows me to explore a new frontier that's very important or whatever. And what I've always wondered is like is that a function of the type of problem being solved? Like I just can't imagine if AI came and solved cancer like whatever someone that works on cancer would be like oh I'm so existentially depressed. [laughter] This is amazing. But let me I where on the other hand of like oh we saw this math problem oh I'm so depressed I saw the math problem like maybe like literally the entire utility of that problem was keeping somebody employed to solve the problem
Speaker A:或者只是在后面写文章,就像“再尝试一次,这是我做错的地方。”那么,让我用这种方式来表达吧。
Original English
Speaker A: >> or or just writing articles in the back like another attempt at and here's where I went wrong. So let me offer it this way.
Speaker B:在这个解决方案的另一面什么都没有,所以我们很沮丧,因为现在,所有这些无用的活动都消失了。让、让、让我停下来。不,我的意思是我对这件事太愤世嫉俗了。我爱数学。
Original English
Speaker B: >> There's there's nothing on the other side of the solution and so like we're depressed because like now like whatever like this useless activity is gone. Let let let me let me stop. No, I mean too cynical on this thing. I love math.
Speaker A:我想我们抓到你的把柄了,不过这有点愤世嫉俗,但也不完全是,更多的是…… [笑声] 让我从这个角度来说,回顾一下计算机科学的历史,因为我不得不上这门课,我看了一堆学校的课程目录。你们现在不用再上了。那就像是离散数学基础。
Original English
Speaker A: >> I think I think we caught you but like being a little cynical but not really but more that it's just [laughter] it's it's let me take a side of it this way looking at the history of computer science >> because I had to take this class which I looked at all the course cataloges for a bunch of schools. You don't have to take it anymore. That was like discrete math bas.
Speaker B:是的。是的。
Original English
Speaker B: >> Yeah. Yeah.
Speaker A:或者,再或者像算法复杂性理论,这在很长一段时间里都是必修课,而现在……
Original English
Speaker A: and and like or and then or algorithmic complexity theory which was a required class for a very long time and now
Speaker B:你还记得唐纳德·克努斯 (Donald Knuth) 写的具体数学 (Concrete Mathematics) 吗,就像……
Original English
Speaker B: >> do you remember concrete mathematics from Donald can like
Speaker A:我不记得,我是说你是斯坦福大学的人,我不是,在我的州立大学里没有那个。对我们康奈尔人来说,这是个康奈尔的笑话。但你知道,我的那门课是由算法领域的一位杰出人物教的,讽刺的是,他是斯坦福大学的博士,当然,那就是约翰·霍普克罗夫特 (John Hopcroft)。
Original English
Speaker A: >> I didn't I mean you're a Stanford guy I'm not but like my state a school my state a school we didn't have that but uh that's a Cornell joke for us Cornellians but but um you know my class I got taught by one of the luminaries in the field of algorithms ironically a Stanford PhD uh um John Hopcraftoft of course
Speaker B:对于那些实用主义的人来说,他发明了2-3树以及一大堆东西,那是他在斯坦福的论文。那是个传奇。
Original English
Speaker B: >> who who invented for for the people who are pragmatic IC invented like two three trees and a bunch of stuff as his thesis at Stanford. That's a legend.
Speaker A:但是,但是约翰是我们在这些烂摊子里的教授,我们必须学习所有那些 P 等于 NP 之类的东西,我记得就像这是四色……这是四色问题。
Original English
Speaker A: >> But but John was our our professor in all this crap and we had to learn like all this P equals NP stuff and I remember like the this is the four color this is the four color
Speaker B:由计算机证明的。
Original English
Speaker B: >> proven by computers.
Speaker A:不,但是那正是我要说的。你把重点给藏起来了。
Original English
Speaker A: >> No ex but that's where I'm going. You just buried the lead.
Speaker B:是的,但是对那些不知道的人来说,我们在大学里不得不修整整一门关于那个的课程,基本上可以归结为这个问题。有趣的是为什么,那是因为理论家们曾假设:如果你能以多项式时间(而不是指数时间)在算法上解决这个问题,那么你就能以快得多的速度解决所有这些其他问题,比如旅行推销员问题及其他所有问题。这在当时很重要,因为我们所有的计算机都受到计算能力的极大约束。因此,如果你是 AT&T 的人,说,知道吗,这是我们拥有 6000 个交换机的节点,你该如何进行最佳路由?你会说,好吧,我们的算力不够。为了解决这个问题,运行模拟大概需要两年的时间。
Original English
Speaker B: >> Yeah, but but like so those of you that don't know we had to take a whole course in college on that basically boiled down to this problem. And the interesting thing is why and it was because the theoreticians had postulated that if you can solve this problem in in algorithmic in in exponential in non-exponential time in polomial time then you could solve all these other problems like the traveling salesperson problem and all these other problems much much faster which mattered because all of our computers were just so computebound. So, if you were the AT&T people that gave, you know, like here's our node of like 6,000 switches, like how do you route optimally? You'd be like, well, we don't have enough. That's like two years of running the the simulation to solve this.
Speaker A:是的。是的。
Original English
Speaker A: >> Yeah. Yeah.
Speaker B:所以结果表明,其中一件有趣的事情是他们证明了四色定理。
Original English
Speaker B: >> And and so it turns out that one of the interesting things was they proved the fourcolor theorem.
Speaker A:是的。
Original English
Speaker A: >> Yeah.
Speaker B:但是他们证明它的方式……顺便说一句,我的意思是,仅仅是四色定理说明:对于任何二维平面地图,你都可以给它着色。你可以只使用四种颜色。以至于没有两个相邻区域具有相同的颜色。对,完全正确。
Original English
Speaker B: >> But they did it which by the way, I mean just the four color theorem says for any 2D planer map, you can color it. You can use only four colors. So such that no two adjacent areas have the same color. Right. Exactly.
Speaker A:而且,嗯,而且你只需要四种颜色。你永远不需要第五种颜色。
Original English
Speaker A: >> And um uh and you only need four colors. You'll never need five colors.
Speaker B:而且我们学会了它,仅仅是为了让像你们这样的孩子们知道,我们字面意义上真的是那么学的。我们都能像那样把它背出来。它在这个问题上留下了非常奇怪的印记。
Original English
Speaker B: >> And and we learned it just so people like you kids know that's literally how we learned it. And we could all repeat it like that. It's this very weird imprint over this problem.
Speaker A:所以发生的情况是,没有人真正得出一个类似微积分那样的证明。相反,他们所做的是真正证明了潜在解的数量是有限的。
Original English
Speaker A: >> And so what what sort of happened was no one ever arrived at a at a basically what you could think of as like a proof that looked like calculus. Instead, what they did is they actually proved that the number of potential solutions was finite.
Speaker B:你真正看过那个证明吗?
Original English
Speaker B: >> Have you actually seen the proof?
Speaker A:是的。是的。200页的各种组合。
Original English
Speaker A: >> Yeah. Yeah. 200 pages of combinations,
Speaker B:但他们基本上证明了存在数量有限的组合,然后他们只是计算了所有组合,并说:“看,只需要四种颜色。”所以这是一种迂回的证明,但这仅仅是因为有了计算能力才变得可能。
Original English
Speaker B: >> but they basically proved that you there's a finite number of them and then they just computed all of them and said, "Look, it's only four colors." And so it's this sort of bankshot proof, but it was only possible because of compute.
Speaker A:就你的观点而言,这在实际应用中确实非常非常有帮助。
Original English
Speaker A: >> And to your point, that was actually very very useful in the the the the practical applications.
Speaker B:对。对。而且当然,作为一个研究拓扑学的人。
Original English
Speaker B: >> Right. Right. and certainly as a topology person
Speaker A:像设定了强大的边界之类的事情。所以实际上我看到了……
Original English
Speaker A: >> like setting setting strong bounds and and things like that. So actually I see
Speaker B:而且我认为它……我认为这对我来说仅仅是一个非常好的教训,当你有了一个新层次的抽象,告诉你这是整整一类可以被解决的问题。
Original English
Speaker B: >> and I think it I think that that to me was just a really good lesson in in when you have like a new level of abstraction that says this is a whole class of problems that can be solved.
Speaker A:是的。
Original English
Speaker A: >> Yeah.
Speaker B:然后你就可以构建在这个抽象层次上工作的工具,而且不用每个人都得从“好吧,我们正在做的东西的2-3树表示是什么”开始。
Original English
Speaker B: >> You can then build tools working at that level of abstraction and everybody doesn't have to start from like okay what's the two three tree representation of what we're doing.
AI与物理模拟的差异
Speaker A:所以,听着,[清嗓子],我听着,当你在谈论人工智能时,很难不去谈论哲学。所以,我要开始谈点哲学了,你可以叫我闭嘴,但我就是忍不住,就像你一样。那么,数学这件事在我看来有点不同,因为它似乎引出了以下问题,那就是数学是否能够代表物理现象,对吧?比如,是否有人曾经拿出一堆方程,然后真正预测了某种物理上的事情?我不知道答案。就像我曾经参与过那些大型模拟代码的工作,而这些大型模拟代码实际上是为了计算物理现象,比如恒星的爆炸,或者比如,你知道在空气模拟器或风洞模拟器中的飞机上会发生什么。但是所有那些,即使它们仅仅是在计算那些大型微积分方程,它们全都是基于经验结果的。
Original English
Speaker A: >> So listen [clears throat] I listen it's hard not to get philosophical when you're talking about AI. So, I'm gonna get philosophical and you can tell me to shut up, but I I just can't like you you kind of do. So, so the the math this math thing seems to me a little different because like it kind of begs the following question, which is will math ever be represented of physical phenomenon, right? Like has anybody ever like taken a bunch of equations and actually predicted something like physical? And I don't know the answer to that. Like so I worked in these large simulation codes and these large simulation codes are actually um trying to compute physical phenomenon like the explosion of a star or like you know what would happen to like whatever an airplane in like an uh an air simulator or a wind simulator. Um but all of those and even though they're just calculating these like large you know differential equations they were all based on empirical results.
Speaker B:是的。就像字面意义上状态方程的……
Original English
Speaker B: >> Yeah. like literally the equations of state for the
Speaker A:好吧,它们是模型,它们只是……它们就像我们可以测量这些地方的温度。
Original English
Speaker A: >> well they were model they were just they were like we could measure temperature in these places
Speaker B:完全正确,所以它全是、全都是基于经验的状态方程,因此我一直想知道,比如……
Original English
Speaker B: >> that's exactly right so it was all it was all based on empirical equations of state and so I've always wondered like
Speaker A:就像如果模拟在计算上是不可约的,所以你实际上必须去运行这个模拟,在这种情况下,我不清楚人工智能在多大程度上能有所帮助。比如我知道人们正在尝试用AI来解决这个问题,但是就像我不知道这些数学答案对于这类事物是否会有任何影响,对吧?所以也许存在一些独立的算法领域,就像你说的那些能够产生影响的领域,或者比如建模或者物流,但当涉及到类似“这颗星会爆炸吗”、“这栋楼能立得住吗”这样真正的模拟时,我认为这些东西是非常脱节的。然后我读了很多关于数学解决方案的论述,其中有一些主张说如果它能解决所有数学问题,你就能预测任何事情,但我仅仅认为那是一个巨大的、巨大的逻辑跳跃,我并不认为那显然是正确的。
Original English
Speaker A: >> like is simulation computationally irreducible and so you actually have to actually run the simulation in that case it's not clear to me to what extent AI helps like I know people are trying to solve this problem with AI but like I don't know if these math an these math answers have any impact on that type of stuff, right? Right. So maybe there's some separate algorithmics domain to to your point where they do or you know maybe like like modeling or logistics but when it comes to like you know will you know will this star explode will this building stand up like the actual simulation I think these things things are pretty disjoint and and then I read a lot of these discourses on the the math solutions and there's kind of these claims where if it can solve all math you can predict anything and I just think that that's a huge huge logical leap which is not clear to me that is is is is obviously true.
Speaker B:是的。
Original English
Speaker B: >> Yeah.
Speaker A:或者哪怕有任何迹象表明这是真的。就比如。
Original English
Speaker A: >> Or or there's any indication it's true at all. like it.
Speaker B:所以一种方法,我想我可能会去谈论那个,你知道我再次重申这真的超出了我对实际数学的理解能力范围……
Original English
Speaker B: >> So the way one way to that I think I might >> um talk about that you know again like this is so out of my league on the actual math
Speaker A:两个系统人一起……
Original English
Speaker A: >> two and two systems people
Speaker B:我很好,但我感到有一种动力,我本质上是个工具……我本质上是一个做工具的人,所以我有点能理解这一部分。那就是发生的事情是,AI可能不会是在某个重要规模下解决数学问题的下一个工具,但它可能会导向一种新型的、一个新的层次的模型的开发,所以我带了像道具一样的东西来展示这一点。所以,当然了,这是最初的数学工具。而且在有类似这种东西之前,这是一个,你知道的,从北京市场买来的真家伙之一。
Original English
Speaker B: >> I'm good but but I'm >> compelled I'm I'm inherently a tool I'm inherently a tools person and so I kind of get this part of it which is >> that what's happened is is that that AI might not be the next tool to solve math problems >> at at some scale that matters but it might lead to the development of a new kind a new level of model and so I brought like props to shows this off. So, of course, this is the original >> math tool. And so, before something like this, this is a, you know, one of these real ones from like Beijing market.
Speaker A:好吧,你知道,它是……
Original English
Speaker A: >> Well, I you know, it's
早期计算工具与数学的抽象
Speaker A: ……就是他们用法语讲给游客听的那些。不过,我对那件事感到非常自豪,因为我把价格砍到了大概七美分。但是,嗯,[笑声]
Original English
Speaker A: the ones they tell tourists in French. But, but I'm very proud of that because I negotiated it down to like seven cents. But, um, [laughter]
Speaker B: 但是你知道,那变成了一个抽象层级。突然之间,你有了这个基础的数学工具,然后你直接快进了一大截。我把这个带来了,因为它实在太酷了。确实如此。大家都知道计算尺是什么,但也都知道,没人知道怎么用它。是的。这个东西叫 Curta(科塔),它是奥地利的……基本上它就是一个圆柱形的计算尺。
Original English
Speaker B: but but you know, that became a level of abstraction and all of a sudden like you just had this basic math thing and then you just fast forward a whole bunch. I brought this because it's just so freaking cool. It is. So this everybody knows what slide rules are. You know, nobody knows how to use them. Yeah. This is called a a kerta and which is a Austrian uh basically it's a round uh slide rule.
Speaker A: 是的。
Original English
Speaker A: Yeah.
Speaker B: 它就像一个咖啡研磨机或者胡椒研磨器。你通过各种方式在侧面设定数字,然后朝一个方向转动进行加法,朝另一个方向转动进行减法。
Original English
Speaker B: And so it it's like a coffee grinder or a pepper mill and you you you have the all these ways you set the numbers on the side and then you turn it one way to add another way to subtract.
Speaker A: 哇哦。
Original English
Speaker A: Whoa.
Speaker B: 这个东西就是……
Original English
Speaker B: And it's this thing is it's
Speaker A: 等等,它是用来做多位数字的算术运算,还是用来算对数之类的?
Original English
Speaker A: Wait, is that used for like multi-umber arithmetic or is it used for stuff like like logarithm?
Speaker B: 不,它只用来做算术运算。好的。
Original English
Speaker B: No, it's only arithmetic. Okay.
Speaker A: 我觉得当然这取决于你怎么用它。但是,嗯……
Original English
Speaker A: Well, I think but of course it depends on how you use it. But but um
Speaker B: 我想它大概是 20 世纪中叶的产物。我叔叔把它从战场上带了回来。不过令人难以置信的是,这东西里面大概有 600 个机械加工的金属零件。
Original English
Speaker B: it it it's from the the 20th mid 20th century, I think. And uh my uncle brought this back from the war. And uh but it's what's incredible is this is like 600 pieces of machined metal.
Speaker A: 哇。
Original English
Speaker A: Wow.
Speaker B: 在这东西里面。现在如果要制造一个,大概要花 5 万美元。
Original English
Speaker B: Inside this. It would cost like $50,000 to make one. Now,
Speaker A: 你知道怎么用它吗?
Original English
Speaker A: do you know how to use it?
Speaker B: 其实我本来会用的,但我现在不打算尝试了。实际上,为了准备这次谈话,免得我看起来像个彻头彻尾的傻瓜,我还特意去查了一下我的存货。虽然它已经在我的架子上放了好几年,我居然真的费劲去学了怎么用它。
Original English
Speaker B: I I actually did, but I'm not going to try to do it. I I actually for prepping for this so I wouldn't be a complete idiot. Just go look what I have. I actually went through the trouble of learning how to use it, although it's been sitting on my shelf for years.
新技术的出现与人们的反应
Speaker B: 但有趣的是,你知道,突然之间,一个全新层面的问题得到了解决。而且……
Original English
Speaker B: But it's um but the interesting thing is, you know, then all of a sudden a whole new level of problems get solved. And
Speaker A: 等等,你的意思是,新的模型就像新型计算器,或者新型图形计算器,新型的……我其实还记得 TI-85 计算器刚出来的时候。
Original English
Speaker A: wait, so you're saying that the the the new model is the new calculator or the new graphing calculator, the new I actually remember when like remember the TI85.
Speaker B: 哦,当然记得。是的,是的。
Original English
Speaker B: Oh, of course. Yeah. Yeah.
Speaker A: 我记得那东西刚问世时,他们就像在说:“所有的数学老师都面临着危机。”我的感觉是:“要知道,我们以前发给你一张纸,我们要在上面画出 XY 方程的图像。现在他们可以在计算器上完成,还能解方程,我们的领域完蛋了。”
Original English
Speaker A: I remember that came out. They're like, "All of the math teachers had this crisis." I'm like, "You know, we used to give you a piece of paper. We plot the XY equation. Now they could do it on the calculator and they can solve equations and our field is dead."
Speaker B: 但是有趣的是,这也是为什么它对今天的 AI 如此重要。微积分刚出现时,那些人并没有抱怨,因为对他们来说,微积分已经是一个基准。其实问题在于有这样一种观念:人们对变化的反应,往往大于对他们最初所处的基准的反应。所以,很多类似的担忧……比如,我生活在那个时代,我真的拥有过像 TI-35 这样的计算器,那是学校里最早的计算器。他们用它做的唯一的高级数学运算,就是有一个百分号键和阶乘键。那时我们甚至都不知道阶乘是什么,而你可以在上面算到 59 的阶乘,那就是它能显示的最大值了。而且你知道,我上大学的时候,那些课程是不允许使用计算器的。
Original English
Speaker B: But but but what's interesting is this is why it's so important to AI today. Those people didn't complain about when calculus came out because calculus was a baseline to them. And and what it is is there's this notion this this people react to change more than they react to the baseline of where they all started. And so so much of like the concerns in a in a in a like I lived I literally got like a uh the TI35 were the first calculators in schools. The only advanced math they did they had a percent key and factorial which we didn't even know what it was and you could do like 59 factorial and that was the max that you could display. And you know I went to college and the classes were no calculators allowed
Speaker A: 我也经历过整个那个时期。我这辈子一直处于计算器对所有人“允许”和“不允许”使用的分界线上。我的意思是,我经历了图形计算器的时代。就像你真的得准备一本蓝皮答题簿。
Original English
Speaker A: the whole I was on that I my whole life I've been on the cus of allowed and not allowed for everybody. I mean, I was I was there for the graphing calculator. Like, you literally have a blue book.
Speaker B: 是的。
Original English
Speaker B: Yeah.
Speaker A: 就为了展示你所有的计算过程,为了证明你不是直接把数据输入到图形计算器里。
Original English
Speaker A: Just to show all of your work, just to show that you weren't plugging it into the graph.
Speaker B: 你看,我就错过了图形计算器这个阶段。当时我们大多数人其实都在后排写电子游戏代码,根本不在乎它做数学运算的能力。但是……
Original English
Speaker B: See, I missed the graph, which most of us were like actually writing video games in the back and could care less about its ability to write math. But
Speaker A: 绝对是,绝对是。而且,如果你倒回去看,你会意识到,在你知道这些人经历了代数、线性代数和微积分的发展历程之后,你知道所有这些,然后有了微积分,你就得到了傅里叶变换和流体动力学。而所有的这些首先就像你刚才提到的,都是基于需求。我的意思是,这么多这样的数学……
Original English
Speaker A: Absolutely. Absolutely. And but but you just play that backwards and you realize that after you know after these guys you went through this march of of algebra and then linear algebra and then calculus and you know all of and then you know and then with calculus then you ended up with fier transforms and fluid dynamics and all of that was first to your earlier point were all based on need. I mean so much of this math
计算的起源:需求驱动与战争背景
Speaker B: 所有的计算机从根本上来说都源自差分机,而差分机只是试图用来计算积分。当然,需要明确的是,计算积分是为了让我们能够互相发射导弹和火炮。
Original English
Speaker B: well all of computer computers are basically from difference engines which are just trying to calculate integrals. But and and but and of course but to be really clear to calculate integrals so that we could shoot missiles and at and cannons at each other
Speaker A: 好的,所以那就是……是的。
Original English
Speaker A: that okay so that's what yes
Speaker B: 我并不是在评判这件事,我只是说……
Original English
Speaker B: which I'm not judging it I'm just saying
Speaker A: 嗯嗯,是的。我不想对此显得过于学究气,但这是我最喜欢的历史片段之一。其实它最早源于计算潮汐,这也具有巨大的经济价值,你需要试图计算潮汐。这就是你某种程度上拥有的早期系统。然后那些架构当然被征用于战争中的对数计算。这就是我之所以提到这个,实际上非常有趣。它在处理这些事情上的速度大约是人类的 5000 倍。然后当然……
Original English
Speaker A: well well yes I don't mean to be pedantic about this but like it's one of my favorite parts of history. It actually started with with tides which also had massive economic value which you're trying to calculate the tides and this is where you kind of had like the the old you know um and then that those architectures got co-opted into of course the ward effort for the logorithms for that that's what I came from it actually it was very interesting uh was about 5,000 times faster than a human being when it came to like you know doing this and then of course
Speaker B: 而且它不会犯错,这算是一种……
Original English
Speaker B: and it didn't make mistakes which was sort of the
Speaker A: 但那是非常专门针对数学的,并且非常具体地为了经济效用。而我觉得有趣的问题在于,这些模型显然擅长某一种类型的数学。这是否是那种不知何故阻碍了某种经济……
Original English
Speaker A: but it was but it was very specifically math and very specific for economic utility. And the interesting question to me is is like these models are clearly good at a type of math. It is is it one that has somehow blocked some sort of economic
Speaker B: 是的。
Original English
Speaker B: Yeah.
Speaker A: 而我不知道答案。
Original English
Speaker A: And I don't know of the answer to that.
Speaker B: 哦是的。你知道,但我认为继续顺着这个思路想下去超级有趣。因为对我来说,最酷的地方在于,为了战争进行那些基础的微积分运算,制作那些导弹弹道表诸如此类的东西,结果它基本上解锁了太空竞赛、喷气式发动机、工厂自动化,以及所有这些事物。而且你知道,人们当时在为之欢呼。对我来说,在文化层面上这是最有趣的事情。那时候不仅有他们在欢呼,而且每位家长都看着自己的孩子说:“去学校学这个。去赢下西屋科学奖。去赢下通用电气的数学比赛。”
Original English
Speaker B: Oh yeah. I I you know, but I think it's super interesting to keep going with that because to me that it's so what's so cool is that that that doing that that basic calculus for the war and making those missile tables and and things like that, then it unlocked the space race basically and jet engines and factory automation and all of these things. And you know, people were cheering that on like that to me culturally is the most interesting thing. Like there was just this not only were they cheering it on, they were every parent was looking at their kids saying, "Go learn that in school. Go win the Westinghouse competition. Go win the GE math competition."
Speaker A: 那是因为冷战吗?是因为……
Original English
Speaker A: And was that because of the Cold War? Was it because
Speaker B: 显然,冷战无疑是一个巨大的文化因素,但这也是一种关于未来的普遍愿景。我就找到了一本非常酷的 IBM 手册,那是 1953 年的。也就是五三年。
Original English
Speaker B: Well, obviously the Cold War was a big cultural part of it for sure, but it was just a general the the future. I like I found this uh incredibly cool brochure from uh IBM from it's from 1953. So 193.
IBM 1953 年的手册与计算机愿景
Speaker A: 你是刚好家里就有这东西吗?
Original English
Speaker A: Like do you just have this stuff in your house?
Speaker B: 我是偶然发现它的。比如,这个是我刚拿到的。我简直不敢相信这东西居然还存在。但这就像是一本关于未来即是计算的宣传册。
Original English
Speaker B: I just stumbled across it. Like this this one I just got. I can't even believe this exists. But this is like this is a brochure about the future is computing.
Speaker A: 等等,我想看看。
Original English
Speaker A: Wait, I want to see it.
Speaker B: 但是你得先看看。它上面有像核能那样的图案,一整套东西。“计算的未来”就像是一个人头上环绕着旋转的原子。哦等等,我们正在拉近镜头,做像 Carol Merrill 那样的展示。不过最迷人的事情是,这是 1953 年的。所以那时的 ENIAC(埃尼阿克)就是计算机的全部了。那就是当时的计算机。那是在 74 之前,在 370 之前。所以这本 IBM 的宣传册解释的是计算机“可能”会是什么样,甚至还不是它“现在”是什么样。它的开头大概是这样写的:“人类花了几百万年的时间才发明并认识到了轮子的用处。”这就是这本宣传册开头的句子。而且那时人们对这些内容非常买账。但我想说的是接下来这部分。它谈到了计算机,说计算机分为两个家族。
Original English
Speaker B: But but but like first you got to look. It's it's got like nuclear like the whole thing. The future of computing is like a guy with like Adams racing around his head. Oh wait, we're zooming in and doing the Carol Merrell thing. So but the the fascinating thing is it's from 1953. So you're Aniac and and that point like that's it. That's the computer at the time. This is pre74, pre 370. And so it's a brochure from IBM explaining what a computer might be. Not even is. And it's like it took millions of years to invent and recognize the usefulness of the wheel. That's the opening sentence of of of the and and but like you people were eating the stuff up. But here's the part that I want to get to. It talks about computers and it's the two families of computers.
Speaker A: 是的。
Original English
Speaker A: Yeah.
Speaker B: 于是你当然会看到计算尺,它在解释这段历史。而所有这些其实都在为一个观点铺垫:我们也可以把这种技术用于文本处理。
Original English
Speaker B: And so of course you get the slide rule and that's explaining the history. And what this is really leading up to is we could do this for text too.
Speaker A: 是的。
Original English
Speaker A: Yeah.
Speaker B: 想象一下,在 1953 年读到这份宣传册的人。它甚至需要解释十六进制、十进制和二进制,并把它们和罗马数字做比较。
Original English
Speaker B: And so the idea and I mean like imagine who was reading this in 1953 that it has to explain hex and decimal and binary and compare it to Roman.
Speaker A: 这太不可思议了。
Original English
Speaker A: That's amazing.
Speaker B: 因为那时候根本没人,根本没人知道……
Original English
Speaker B: And because like nobody like nobody knew
Speaker A: 那个东西叫什么名字?
Original English
Speaker A: is the name of that thing.
Speaker B: 它就叫《IBM 之光照向未来》(IBM Light on the Future),上面画着一个像火箭试管一样的聚光灯。非常不可思议。背景里还有像示波器波形一样的图案。这是最惊人的东西。手册最后还附带了一个词汇表。想象一下,人们第一次向别人解释什么是计算机,而词汇表里的词不是,你知道,比如“算术单元”、“二进制数字”、“比特”,而是像“阴极射线管”、“静电存储管”这样的词。但我之所以打开这本册子,是因为里面有一页非常酷,那才是重点。“数字计算机的组织结构是什么?”这正是我所认为的,对于我们和 AI 而言,有关“抽象”的核心问题所在。七十五年来,这正是我们对计算机结构的认知。
Original English
Speaker B: It's just called IBM light on the future with like a rocket test tubeish spotlight looking thing. And it's incredible. There's like oscilloscope waves in the back. It is the most incredible thing. It has this dictionary in the back. Imagine the first time someone explains a computer and the diction the dictionary isn't, you know, arithmetic unit binary digit bit you know like cathode ray tube electrostatic storage tube and you know but but the thing is is the reason I open this because there's one cool page that really matters. What is the organization of digital computers? And so this is the thing that that I gets to this point about abstraction for us and AI. This is these have been for for 75 years how we thought computers are organized.
Speaker A: 是的。
Original English
Speaker A: Yeah.
Speaker B: 输入、存储、算术、控制,以及输出。
Original English
Speaker B: Input, storage, arithmetic, control, and output.
Speaker A: 是的。
Original English
Speaker A: Yeah.
Speaker B: 那就是一切,那就是我们在学校里学到的东西。你基本上修过每一门相关课程。
Original English
Speaker B: And that's all that's what we learned in school. You took courses basically in each
计算机科学中的抽象与网络 (Abstractions in Computer Science and Networking)
Speaker A: 其中之一。昨晚我们在反复讨论计算机科学中会保留下来的那些抽象概念。然后你提到了网络,这在某种程度上算是一种控制。
Original English
Speaker A: one of those. Last night we were going back and forth on the abstractions that will remain in computer science. And you tossed in networking, which is sort of control.
Speaker B: 是的。顺便说一句,大家都把网络给忘了。当然,那是因为——
Original English
Speaker B: Yeah. Everybody forgets networking by the way. Of course that was
Speaker A: 嗯,因为大多数人不再去操心网络了。
Original English
Speaker A: well because most people stop worrying about networking
Speaker B: 大多数人一旦数据包离开了计算机,就不再操心网络了。我想说,你知道,90年代末基本上就是将网络课作为必修课的终结时期。
Original English
Speaker B: stop worrying about as soon as the packet leaves the computer I would say you know the late 90s was the end of basically a mandatory networking class
Speaker A: 因为,因为像——但它已经被解决了。就像,就像再也没有——你知道,对我来说,那就是晶体管。我当时觉得那就像是计算机科学专业的学生最后一次必须要知道什么是晶体管。而且相信我,我现在实际上也不懂晶体管到底是什么,它现在就像是一个三角形的符号。但是,但是有趣的是,这些抽象概念导致了,好吧,所以现在我们有了这些抽象概念。它们基本上就是不同的领域,每一个领域都像,你在存储领域上花了你职业生涯的20年时间,你看着它从真空管发展到磁鼓,再到旋转磁盘,再到磁带等等。而且你知道,如果你做的是输出设备,你会看到发明的演进,从电传打字机,到面向行的电传打字机,再到黑白终端,再到彩色,再到矢量,以及所有的这一切。所有这些都曾经是独立的领域,而且它们都是平行发展的。任何计算机科学系(CS department),当初因为导弹研发的原因从数学系脱离出来——
Original English
Speaker A: because because like but it was solved like like there was no you know for me it was it was the transistor I was like the last time that computer science majors had to know what a transistor was and trust me I actually don't get what one is now it's like a triangle symbol But but the interesting thing is those abstractions led to okay so now we have those abstractions they were basically fields that did each one of them like you spent 20 years of your career on storage and you watched the march from from tubes to drums to spinning discs to tapes and so on. And you know if you did output you watch the invention of going from a teletype to a lineoriented teletype to a terminal black and white to color to vector and the whole deal. And all of those were the fields and they all rose in parallel. Any CS department which came out of the math department because of the missiles
Speaker B: 最终变成了由这些东西组成的系所,然后一切又崩溃、收缩,把我们变成了系统组。
Original English
Speaker B: ended up being like departments made up of those things and then it all collapsed and produced us to the systems group.
Speaker A: 当然。是的。是的。是的。所以,让,让我只从其中一个角度来深入探讨一下。当然。当然。因为我,我听着,我,我显然很喜欢这种框架,我们向上移动一个抽象层,在每一个抽象层仍然有一系列的问题。那只是一个更高层次的抽象。但我仍然认为这种关于经济实质的概念是非常重要的。
Original English
Speaker A: Sure. Yeah. Yeah. Yeah. So let let me just push on one angle of this. Sure. Sure. Because I I listen I I clearly love the framing and we move up an abstraction and every abstraction there's still a set of problems. It's just a higher level of abstraction. But I still think this kind of notion of economic meat is very important.
Speaker B: 哦,是的。是的。对的。所以比如说,嗯,我们,我们,我们,你知道布莱切利园(Bletchley Park)是为了战争破译密码,所以就像有这样一种努力创造了创新,它的结果是,你知道的,赢得了第二次世界大战。嗯,任何行动,我们当时试图做核能,不仅仅是研究,而是像创新,你知道的,在战争努力的层面上,所以我们需要去,比如,计算积分,而且我们当时是用手工计算的,所以,所以在那个时候。这些事情被赞美为仿佛在拯救人类。每个人都超级兴奋。所有的物理学家都热爱计算机并且使用计算机。而对我来说,关于当前解决数学问题的事情是,我不知道在另一边会有什么。
Original English
Speaker B: Oh yeah. Yeah. Right. So for example um we we we you know Bletzley Park was about cracking a code for a war and so like there's this effort that created innovation that the outcome was you know winning World War II um any act we were trying to do nuclear not just research but like innovation you know in terms of a war effort and so we needed to like calculate integrals and we were doing it by hand and so so at that point. These things were lauded as like saving humanity. Everybody was super excited. All the physicists loved computers and used computers. And for me, the thing about the current solving math is I don't know what that thing on the other
Speaker A: 哦,是的。不,但在另一方面是,我,我确实认为我们在过去曾经有过这样的情况。所以,你知道的——
Original English
Speaker A: Oh, yeah. No, but on the other side is we I I do think we've had that in the past. And so, you know,
Speaker B: 嗯,我们有过,我们有过 AlphaGo(阿尔法狗)时刻。那也是一样的事情。就像,我们,我,我们做了一期播客,不是在这个房间里,但是——
Original English
Speaker B: well, we did we had the Alph Go moment. It was the same thing. Like we I we did a podcast not in this room, but
Speaker A: 但是甚至在 AlphaGo 之前,我们也有过,就像你还记得国际象棋在国际象棋领域被击败的时候吗?是的,我们有过 IBM 国际象棋的那个事件,那是在,而且,而且 Frank Chen 和我,我们在 AlphaGo 期间做了一期播客,我们必须努力让人们理解,比如,为什么这是一个好主意,并且——
Original English
Speaker A: but even before Alpha Go, we had like remember when chess got bitten in chess? Yes, we had the IBM chess thing when it was and and Frank Chen and I we did this podcast at Alpha Go and we had to try to make people understand like why it was a good idea and
Speaker B: 并且我认为我们去问这个问题实际上是非常合理的,那就是:这些东西能解决某些事情,并且,你知道,那里有很大的效用和价值,而且,就像这将会推动事物向前发展,并且当那种情况倾向于发生时,人们往往会感到兴奋并且去支持它。然后还有一些你解决的事情,在这些事情上,我认为人们——
Original English
Speaker B: and I think it's actually pretty reasonable for us to ask the question which is there's things that these things solve and you know there's a lot of utility and value and that and like that's going to move things forward and and when that tends to happen people tend to be excited and get behind it and there's these things you solve where I think people
Speaker A: 我认为(人们)没有像那样积极的看法,并且我,我会认为那是因为它几乎就像,解决这个问题本身已经变成了最终目的,而不是实际的最终目的。但是正如我们也许都应该退后一步,然后想,如果你真的对某件事情被解决感到难过,也许它一开始就不值得去做,
Original English
Speaker A: I think don't have like as positive a view and I I would submit that's because it's almost like solving the problem had become the the end as opposed to the actual end. But as we should maybe all step back and be like if you're really like sad about something being solved, maybe it wasn't worth working on to begin with,
Speaker B: 对吧?所以这个课程,你知道,然后你就好像在做沙画曼陀罗,还有就像你的内心平静之类的,但这并没有推动经济向前发展,
Original English
Speaker B: right? And so this course, you know, and you're like doing the San Mandala and like your inner piece or something like but that's not moving the economy forward,
Speaker A: 对吧?嗯,我们俩看,我们都是搞系统的人,但我其实是个搞应用的人。我知道你不是,我不搞系统。是的,我们都是(系统)人,但是像系统——
Original English
Speaker A: right? Well, we're both look, we're systems people, but I'm actually an apps person. I know you're not I don't system. Yeah, we're both people but like system
Speaker B: 我,当然,绝对认为真正重要的是应用,当然还有互联网——
Original English
Speaker B: I of course absolutely think that that the wave that matters are apps and of course the internet
应用、互联网与实用性 (Apps, the Internet, and Utility)
Speaker A: 同样的问题也发生在 1995 年和 96 年的互联网上,当时互联网非常令人兴奋,但大多数人只是闲坐着说:“我不知道这对我有什么用。”看,现在有一本很棒的书,嗯,叫做《史蒂夫·乔布斯在流放中》(Steve Jobs in Exile),我绝对认为如果你在听这个播客,这本书是必读的。嗯,所以,呃,Kane 写了这本书,但它也包括了皮克斯(Pixar)的 Catmull,以及 Dan'l Lewin,他是史蒂夫的超级好朋友,也曾在微软工作。他们所有,他们,他们,这本书真的是太棒了,因为它解释了所有的这些,它概括了这种关于构建人们实际需要并能解决问题的东西的理念。但它非常清楚地指出,你知道,NeXT 实际上是蒂姆·伯纳斯-李(Tim Berners-Lee)用来编写 HTTP 协议的机器,
Original English
Speaker A: also this same problem happened in 1995 and 96 with the internet which was it was very exciting but most people just sat around saying I don't know what that does for me. Look, there's a great book out now um called Steve Jobs in Exile, which I absolutely think is required reading if you're listening to this podcast. Um so, uh Kane wrote the book, but it's with Catm who at Pixar and with Dan Leuen, who was at at Steve's super good friend and was also at Microsoft. They all they they this book is just fantastic because it explains all of it encapsulates all of this notion of like building things that people actually need and solve problems. But it pointed out very clearly, you know, the the next was actually the machine that Tim Berners Lee used to write the HTTP protocol,
Speaker B: 是的吧?所以他实际上——
Original English
Speaker B: right? So he actually
Speaker A: 一台 NeXT 机器。
Original English
Speaker A: a next machine
Speaker B: 并且他使用了一台 NeXT 机器。那是一个有趣的——
Original English
Speaker B: and he used the next machine. That's an interesting
Speaker A: 并且它超级有趣,因为没有人知道这台机器是用来干什么的,或者它能做什么。但是后来他构建了那个,却依然没有人知道这台机器是用来干什么的,或者它能做什么,因为他说,好吧,它是用来查找电话号码和其他研究人员的,并且用来分享论文的,然后我就像,哼,就像,而且,而且我认为有一个很好的例子,一家西雅图的公司,那家公司叫做,呃,Cyber Pizza(赛博披萨),这是一个当时甚至都没有撑到 2000 年(互联网泡沫破裂)的互联网公司,我想,但是它的理念基本上是,嗯,呃,呃,披萨界的 Instacart 或 DoorDash,只送披萨,而且他们基本上会让你下单,然后他们会找出附近的一家披萨店把披萨送过来。那可是 NeXT 在舞台上的发布会演示。他们做了那个演示,而且他们实际上在后台准备了披萨,以防万一它不起作用。而且我应该说对于 NeXTSTEP 或者 OpenStep 来说。但是,嗯,但是那个想法是,那个,那个向你展示了你能用它做什么。但当时字面上的反应就像是:“哇哦,那真的很酷,但你听说过电话吗?”
Original English
Speaker A: and it's super interesting because nobody knew what this machine was for or what it did. But then he built that and still nobody knew what the machine was for or what it did because he's like well it's to find the phone numbers and other researchers and to share papers and I'm like h like and and and I think there was a great example of a company a Seattle based company that was called uh cyber pizza and this was like a dot thing that didn't even make it to the 2000 I think but the idea was it was basically um uh uh in or Door Dash for pizza only pizza and they would basically you would order and then they would figure out a pizza place near and send the pizza. That was the launch demo for the next on stage. They did that and they had actually pizzas in the back in case it didn't work. And and I should say for next step or open step. But um but the idea was that that that that was showing what you could do with it. And literally the reaction was like, "Wow, that's really cool, but have you heard of the telephone?"
Speaker B: 是啊。是的。你的观点是,不是我们已知如何使用的每样东西(都能立即被接受)。所以我,我有点专注于这样一点,那就是在另一端有一个人们正在追求的解决方案。你提出的一点是,有很多被构建出来的平台,其用途并不清晰,但显然它们——
Original English
Speaker B: Yeah. Yeah. Your point is not everything we've known how to use. So I I'm a little focused on like there was a solution on the other side that people are going for. You're making a point that there's a lot of platforms that get built where that's not clear, but clearly they
Speaker A: 唔,电子表格就像,我,我将会,我将在这里展示,这可能是我今天的最后一个视觉辅助工具。但是,比如,文字处理器问世了,而且,而且那是在 1982 年,人们正在 Apple 2 计算机上使用它,还有这种叫做 CP/M 的新型计算机,它是 DOS 操作系统的前身,人们当时的反应是:“我不明白你为什么只是打字。”而且人们一旦使用过了计算机,(纯粹的)打字这个概念就真的,真的再也行不通了,而且,所以法学院里的一些人,你现在必须展示它了。
Original English
Speaker A: well the the spreadsheet was like I I will I will show here's my probably one of my last visual aids for today. But like the word processor came out and and and this is in 1982 and people are using it on Apple 2 computers and this new kind of computer called CPM which is the origin of DOSs and people were like I don't understand why you just type and the people once you used a computer the idea of typing really really just didn't work anymore and and so some people at law school you have to show it now.
Speaker B: 是的,我会的。我只是,我喜欢做铺垫。但是在哈佛法学院的这些人,他们带进了第一台,嗯,笔记本电脑。所以那是第一台笔记本电脑。
Original English
Speaker B: Yeah, I will. I'm just I like building up. But these people in at Harvard Law School, they brought in the first um laptop. So that's the first laptop.
Speaker A: 那些不是被称为“便携式电脑”(Luggables)吗?
Original English
Speaker A: Werent those called Lugables?
Speaker B: 唔,不。它们,这只被称为,它字面上只被称为 Osborne,而且它是唯一的一种。所以,所以猜一猜,埃里克(Eric),你,你当时还是个孩子。它的电池续航时间能有多长?
Original English
Speaker B: Well, no. They This was just called This was literally just called an Osborne, and it was the only one. So So as a guess, how Eric, you're you're a kid. How How much How was the battery life in this?
Eric: 嗯,不长。
Original English
Eric: Um not long.
Speaker B: 它根本没有电池。这个重达 25 磅的巨大箱子,里面根本没有电池。它就是插电使用的。
Original English
Speaker B: There was no battery. This giant case that weighed 25 lbs, there's no battery in it. It just plugged in.
Eric: 但那是一个陷阱问题,因为每次只要我把我的拔出来,我有我大学时买的那一台。就像人们会问,“好吧,电池能用多久?还有,还有,所以它简直就有缝纫机那么大。它比任何合法的随身行李箱都要大。”那是我大学时的电脑。但在,在我高中四年级的时候,它被哈佛法学院禁止了。所以有,有人带着它去参加考试。在哈佛,他们过去常常让你带打字机去参加考试,因为那样教授才能看得懂你的卷子。然后它,然后有两个学生带着电脑进去了。一个带了一台 Apple 2,另一个带了 Osborne,然后学校就把它们禁了。
Original English
Eric: But that was a trick question because every time I've ever plugged mine out, I have mine from college. Like people are like, "Well, how long does the battery last and and so it's literally the size of a sewing machine. It's bigger than a legal carry-on ever was." And that was my college computer. But in in my senior year of high school, it got banned from Harvard Law School. So some someone showed up to do their exams. So at Harvard, they used to bring your typewriter to exams because that way the professor could read it. And it and two kids brought brought computers in. One brought an Apple 2 and one brought the Osborne and then the school banned them.
Speaker B: 哇哦。
Original English
Speaker B: Wow.
Eric: 他们只是说,这是,而且出于所有你所能读到的原因,我有那些《时代》杂志和《纽约时报》的文章。你能读到的每一篇文章读起来都像是:“不要使用图形计算器”,
Original English
Eric: They just said this is and for all the every reason you could read and I have the Time magazine articles and the New York Times. Every article you could read reads like don't use the graphing calculator,
Speaker B: “不要听说唱音乐”,或者“不要读”,不知道……
Original English
Speaker B: don't listen to rap music or don't read don't know
关于在教育中使用AI的争议 (The Debate Over AI in Education)
Speaker A: 或者看看现在正在进行的那些争论。三年前,我试图让康奈尔大学(Cornell)在新生写作课程中使用AI,结果他们直接不理我了。
Original English
Speaker A: or the arguments that are going on now. Three years ago, I tried to get Cornell to use AI in freshman writing and they just stopped talking to me.
Speaker B: 哇。
Original English
Speaker B: Wow.
Speaker A: 但这其中的讽刺之处在于:在我大一那年,当我拥有一台电脑时——我当然是我们那栋90人的宿舍楼里唯一拥有电脑的人——我必须获得院长的许可,才能用它来写我的大一英语论文。那是1983年的秋天。所以,我们现在在所有这些(AI)事物上所处的阶段,与当时完全一样。你也可以把它看作是一种抽象层级的提升,因为现在去上大学的人不可能没有电脑。所以我同意你的看法,但是让我……
Original English
Speaker A: And but here's the irony of that. My freshman year when I had this computer, I was of course the only person in my 90-person dorm with a computer and I had to get permission from the dean to use it to write my papers for freshman English. This is the fall of 1983. And so that's exactly where we are now on all of this stuff. You could also think of it as a level of abstraction because like no one's going to college now without a computer. So I agree with you, but let me...
Speaker B: 对。没错。
Original English
Speaker B: Right. Right.
AI是否意味着放弃人类逻辑 (Does AI Mean Abdicating Human Logic?)
Speaker A: 偶尔我也会觉得,好吧,也许这次有点不一样。所以我会有这样的观点:在计算机科学的历史上,我不记得我们曾经放弃过实际的推理或逻辑。它一直都只是一种资源,对吧?它就像是计算、网络和存储,这就是你所提供的(基础设施),然后由人类输入高层次的问题,接着利用这些计算、网络和存储资源来计算出答案。但所有的初始设定都是我们提供的。我也许不该说互联网也是如此,但现在,我觉得我们在某种程度上真的在放弃思考。就好像你对它说“告诉我答案”,而我甚至都不太确定问题到底是什么。对吧。再进一步说,你也许会认为谷歌(Google)以前也是这样。但那仍然很大程度上带有社交属性。所以我觉得这跟仅仅是提升抽象层级还是有点不同,因为当你提升抽象层级时,你仍然倾向于拥有一个确定性的系统,它只是一个更高层次的抽象。你有一台电脑,依然是由人类来定义问题陈述的方方面面。但这(AI)感觉有点不一样。
Original English
Speaker A: Every once in a while I'm like well maybe it's a little different. So here'd be the argument. I don't think in the history of computer science that I can recall have we ever abdicated actual reasoning or logic. It's always been a resource, right? It's been like compute network and storage and like that's what you're providing and then the human is like putting in the high-level thing and then it's using the compute network and storage to calculate the answer. But like all of the kind of initial setup we're providing wherein, and I guess maybe it's not true for the internet, but now I feel like you're actually abdicating thinking in a way where you're like tell me the answer like I'm not even really sure what the question is. Right. And again, like I think maybe you could say, well, Google was kind of like that, too. But it was still a very much a social thing. And so it does feel like that's a little different than just going up in abstractions because going up in abstractions, you still tend to have like a deterministic system that's a higher level of abstraction that like you have a computer and like it's the human being that's kind of defining everything about the problem statement. It feels a little different.
Speaker B: 确实感觉很不一样。但对我来说,当年图形计算器出现时也是这种感觉。对我而言,图形计算器感觉就像是在作弊,因为测试的问题就是“画一个图”,所以现在发生的事情也是类似的,那就是工具的能力已经与测试问题相匹配了。现在让我们回到刚才讨论的关于计算机和数学家的话题。我大一那年也有一款新产品问世,那就是Maxima,它是麻省理工学院(MIT)开发的符号数学软件包。通过它,你真的可以直接在电脑里输入一个积分。我还记得第一次看到Mathematica的时候,我心想,这玩意儿简直就是黑魔法。
Original English
Speaker B: Well, it definitely feels different. Here's I also think for me, graphing calculators felt different. To me, graphing calculators felt like cheating, and because you know the test question was make a graph, and so that's what's going on right now is that the capabilities match the test question. Now getting us full circle to what we were talking about about computers and mathematicians. My freshman year also a new product, a new thing came out and it was Maxima which was the MIT symbolic math package and so this was a way you could literally type in like an integral into a computer. I remember the first time I saw Mathematica, I'm like this stuff is black magic.
Speaker A: Maxima是,你知道的,机器辅助计算,或者是符号数学,我想这是MIT实验室在60年代末、70年代初启动的项目,并且已经开始风靡一时。所以我大一的工程学课程里,我们用过一个在IBM PC上运行的版本。它叫做MUMath。当时我们拿到微积分作业后,你就可以直接跑到工程图书馆,借出一张PC磁盘,然后把答案敲进去。
Original English
Speaker A: Maxima is you know uh machine aided what was it? Machine aided computation symbolic math I think was the... and that was the lab at MIT started in the late 60s early 70s and that had started to sweep through. So my freshman engineering class we had a version of it that ran on IBM PC. It was called MUMath and like you could like we got our calculus homework you marched over to the engineering library checked out a PC disc and then just typed in the answers.
Speaker B: 所以你不觉得那……
Original English
Speaker B: So you don't think that so...
将逻辑控制权移交给第三方 (Abdicating Logic to Third Parties)
Speaker A: 那就是作弊。让我再深入讲一点点,因为我倾向于同意你的看法,但我偶尔也会产生片刻的怀疑。我不记得在编写程序时,你实际上会放弃逻辑。比如,如果我在写一个程序,无论如何我都会使用云数据库、使用存储、使用网络。但程序的正确性和逻辑仍在程序员的控制之下。也许我会使用一个第三方库。但同样,是我在选择这个库,我知道它的输入是什么,也知道输出是什么。而我觉得我们现在正在进入的这个领域,你实际上是在把逻辑控制权让渡给第三方。你就像在说,“告诉我答案吧。”所以也许这只是一种更高层次的抽象。但对我来说,它感觉还是有点不同。
Original English
Speaker A: And that was cheating. Let me just push on just a little bit because I tend to agree with every once in a while I have like moments of doubt. So I don't remember writing programs where you actually abdicate logic. Like if I'm writing a program I'll like whatever I'll use a cloud database, I'll use storage, I'll use networking, you know, whatever it is. But like correctness and logic for the program is under the programmer's control. Maybe I'll use a third party library. But again, like I'm choosing the library. I know the inputs. I know the outputs. And I feel like we're entering this realm where you're actually abdicating logic to a third party. You're like, tell me the answer. So maybe that's just a higher level of abstraction. It feels a little different to me.
Speaker B: 不,这就是争论的焦点。我完全投入到这场辩论中。这里有一个关于斯坦福(Stanford)的例子。在“AI寒冬”期间,也就是80年代……
Original English
Speaker B: No, like that's the debate. I'm like, I'm all in on the debate. Like here's a Stanford example. So in the during the AI winter that was the 80s...
Speaker A: 斯坦福是最大的……
Original English
Speaker A: Stanford the biggest...
Speaker B: 斯坦福是……我们在15年前还专门做了一期关于那个的播客。当时在斯坦福最大的一件事,就是将新型的AI与医学院结合起来。所以出现了很多这样的项目,比如做医疗诊断、化疗方案之类的。我在哈佛(Harvard)的一个团队里参与过一个关于有机合成的项目,这些都是最早的试图“让我把决策权移交出去”的尝试。事实上,80年代整个计算机时代的开端,就是他们过去所说的“专家系统”(Expert Systems)的黎明。
Original English
Speaker B: One of the AI winters, Stanford was... and we have a podcast on that from 15 years ago. One of the biggest things at Stanford was to combine new AI with the medical school. And so there were all of these projects to do like medical diagnosis, chemotherapy kind of stuff. I worked on one that was doing organic synthesis with a team at Harvard and all of those were sort of the earliest like let me turn over the decision-making. In fact, that's the whole era of the 80s in computers were the dawn of what they used to call expert systems.
Speaker A: 我记得。所以专家系统是我们第一次尝到这种辩论的滋味。
Original English
Speaker A: I remember. And so expert systems were the first time we got a taste of this debate.
Speaker B: 我记得非常清楚。那根本没用。你上的课很多都是关于这个的。大量的专家系统。我还不得不去构建专家系统,对吧?我写过很多Prolog代码。完全没错。所以我非常了解它。我只是觉得那东西从来没有真正奏效过。
Original English
Speaker B: I remember very well. It just didn't work. Your classes were mostly about like you had a bunch of classes on this stuff. Tons of expert systems. I've had to build expert systems, right? I've written a lot of Prolog. Exactly. So, I very much understand it. I just thought like that never really worked and...
Speaker A: 对。所以最大的区别在于,那时的东西还没起作用,但现在……
Original English
Speaker A: Right. So, the big difference is that stuff was working, but now...
Speaker B: 现在的起作用了,而且我们在使用这些工具时放弃了逻辑……
Original English
Speaker B: does work and we're abdicating logic using these...
从算法推演到生成结果 (From Algorithmic Derivation to Generating Results)
Speaker A: 这很有趣,因为如果你进行对比的话,即使是在使用Prolog的情况下,你仍然在编写代码,它本质上还是算法化的。你仍然在提供最终的目标状态,它只是在找到一条通往这个目标状态的路径。而在这里,你几乎是在问它,最终的目标状态应该是什么样子的。所以感觉还是有些不同。
Original English
Speaker A: But so it's interesting because to compare and contrast, and even in the case of Prolog, you're coding it. It's algorithmic. You're still providing the end state and it's just like finding a way to get to the end state where here like you're almost asking it what the end state should be. So it just feels a little different.
Speaker B: 特别是这样。我同意。我喜欢进行这种辩论,因为我认为,其中很大一部分原因归结于你一想到这件事就会感到担忧和毛骨悚然,这其实是因为我们所处的大环境。因为你想想看,我们现在面临着所有这些情况,人们不想建数据中心。但仅仅两年前,人们还在为了讨好州长而争抢着建设数据中心,或者你知道,10年前还在喊“在我们的州建一个汽车厂吧”,那种会冒黑烟、需要繁重体力的工厂。所以背景环境对于这些讨论真的非常重要。你不能把它们剥离开来。
Original English
Speaker B: And it's especially so I agree like I love having this debate because I think so much of it boils down to the concern and the willies that you get thinking about it. It's actually because of the context we're in, and because you know think about like we have all this stuff going on where people don't want to build data centers but like two years ago people were like beating each other to please governors were racing to have data centers built or you know 10 years ago like build a car factory in our state the one that billows smoke and is really hard labor and so the context really matters to these discussions. You can't separate them from...
Speaker A: 对,但我只想回到这个层次,我不是有意要……我只是觉得,我整个职业生涯都在沿着技术栈向上攀爬,但技术栈里始终有一个属于计算机的层级。你总是可以用一种基本上具有确定性的方式,把它映射到底层。比如计算抽象的更高层级。但这真的是第一次,感觉就像是来到了技术栈中一个截然不同的层面。也许这真的就是下一个抽象层,一个更偏向于人类思维层面的抽象,它不再直接映射到底层,因此实际上是不同的。所以我认为,不管是什么,从晶体管逻辑开始,到计算,再到硬件,然后到操作系统,接着到应用程序,最后到平台,你一直都是以这种方式在技术栈上向上移动。这可能意味着,我们正处于一个必须重新思考基础概念的层面,因为对我来说,这感觉大不相同,不仅仅是“这是下一层”那么简单。
Original English
Speaker A: Right but I just want to go back this layer and I don't mean to I just think so um my entire career has been moving up layers of stack but like there's always a computer layer of stack. Yeah. Yeah. You could always map it down to like the next layer in basically a deterministic way. Higher levels of like compute abstractions. This is the first time it feels like a different layer of the stack. Like maybe this is like really is the next abstraction which is more of a human level abstraction which doesn't map directly and so is actually different. So it may like I think you know whatever it is starting with like you know transistor logic and then going to compute and then going to like hardware and then going to OSs and then going to like applications and then going to platforms like you've been moving up the stack that way. It could be the case that like we're at a layer where like we have to rethink fundamentals because it feels a lot different to me than just like this is the next layer.
Speaker B: 最大的不同在于,无论你怎么争辩或者给它贴上哪种标签,我们实际上正在实现从“计算”到“命令式编程”(imperative programming)的跨越。这是我们一直以来的状态,也是大家目前所处的位置;紧接着,我们在很短的一段时间内进入了这种模式——基本上由数据来决定程序,那也是我们第一次认识到所有的推理及相关事物;而现在我们处于这样的阶段:它是任意的、随机的,且具有统计学属性。
Original English
Speaker B: The big difference is and we can argue you can argue this or debate it or label it either side which is we actually are making the leap from calculating to imperative programming. Yeah. Which is where we've been and which where everybody is that to now and then we were in this for a brief time we were in this mode where basically the data really determined the program and that was the first recognition all of the inference and everything and now we're at this where where it's arbitrary it's random and it's statistical.
Speaker A: 没错。所以我是这样看待这个问题的。在命令式编程中,你知道所有的步骤,所以你写下一份配方,然后它会遵循这些步骤执行。好吧,接下来是……
Original English
Speaker A: Right. So the way that I think about it is the following. So imperative programming you know all of the steps so you write the recipe and it follows the steps. Okay, then there's...
Declarative Programming vs. Generative AI Models
Speaker A: 声明式编程(declarative programming)的核心是,你清楚最终的状态是什么样子的。
Original English
Speaker A: Declarative programming is, you know, the end state.
Speaker B: 比如面向开发者的 Prolog 那类东西。
Original English
Speaker B: Which is this Prolog-y kind of thing for people.
Speaker A: 或者是 Datalog,又或者 SQL,你明确知道想要达到的最终状态。
Original English
Speaker A: Or Datalog, you know, or SQL, you know the end state.
Speaker B: 然后计算机负责执行所有中间步骤来达到那个最终状态。在此过程中,你很难去限制计算机的运行时间。这就好比写 Makefile,你只需要告诉它最终状态应该是什么样,它就会自动去完成。
Original English
Speaker B: But then the computer does all the stuff to get to that end state and you can't really bound the computer time. So you're like, this is like a Makefile. It's like, "Here's what the end state looks like," and it does it.
Speaker A: 但现在出现了一种新模式。在这种模式下,你其实并不确切知道最终的状态具体是什么。你只能在某种程度上通过输入合适的提示词来“祈求模型之神”,然后它就会生成一个刚好能派上用场的答案。
Original English
Speaker A: And this is like this new thing where it's almost like you don't really know what the end state is specifically, and you just kind of pray to the model God in the right words, and then it produces the answer that just ends up being useful.
Speaker B: 是的,没错。而且它的输出是随机(stochastic)的。
Original English
Speaker B: Yeah. Yeah. And but I look, and it is stochastic.
Speaker A: 这是一个事实。但从长远来看,思考它本身是否构成了我们理解计算(computing)的下一个抽象层,是一件非常有意思的事情。
Original English
Speaker A: That's a factual statement like that. But it's also interesting to think about it going forward in terms of, is that itself the next layer of abstraction in how we think of computing.
Speaker B: 是的。这可能就像是“计算一个婴儿”,在这一层面上,计算和自然现象产生了极其深度的交汇,因为最终的答案是由类似人类输出的语言生成的,这与过去的计算方式完全不同。
Original English
Speaker B: Yeah. And it may be like computing a baby. Like this is where compute and natural phenomenon actually intersect pretty heavily, because the answer is produced from human output which is language, which is kind of different than...
Rethinking Fundamental Assumptions
Speaker A: 如果我们确实需要重新思考某些基本假设,那将会是什么样子呢?我觉得像 Stephen 和我这样的人,基于过去四五十年观察行业发展的经验,对系统的运作方式以及它们如何冲击整个行业已经建立起了深刻的直觉。但我现在有点拿不准了。比如,价值究竟会流向底层模型还是应用层?你能够在这个领域投入多少资本?你能解决哪类问题,又解决不了哪类问题?你能提供什么样的保证?这会对生产力产生怎样的影响?我们在很多事情上都有既有的直觉,对我来说最大的疑问是:我们是否需要重塑这些假设?如果需要,又该在多大程度上重塑?因为现在这个领域的“物理定律”感觉已经有些不一样了。
Original English
Speaker A: If we do need to rethink some fundamental assumptions, what may that look like? Well, I just think that people like, you know, Stephen and myself have built these deep intuitions on how systems function and how they hit the industry based on 40, 50 years of watching this stuff. And I just don't know, like things like, will value go to the model or to the app? How much capital can you apply to this stuff? What classes of problems can you solve versus not solve? What guarantees can you provide? How does this impact productivity? There's a lot of things that we've got intuitions on, and for me the big question is, do we have to reshape those assumptions or not, and to what extent do we have to, because the laws of physics feel a little bit different.
Speaker A: 我举个例子。我已经说过很多次了,我认为这非常重要。在 20 年前,如果你是一个 10 人的初创团队,我给你 10 亿美元,你会用它来做什么?
Original English
Speaker A: I'll just give you one example. I mean I've said this many times, I think it's so important. 20 years ago, if you're a startup of 10 people and I gave you a billion dollars, what would you do with it?
Speaker B: 你最终会花掉一大笔钱去购买自己的计算机等硬件设备,如果你打算朝那个方向走的话。如果要招人、买设备,很快就会失控。你根本不知道该怎么花这 10 亿美元。
Original English
Speaker B: You would end up spending a ton of money on building, buying your own computers and things if that's where you're going. If that's what... hire people, you buy computers, you blow up. Like you wouldn't know what to do with a billion dollars.
Speaker A: 对,10 年前,如果我给你 10 亿,你会去雇佣工程师,但你会发现不知道下一步该做什么。去写代码?你需要——你要知道,那可是 10 个亿啊。重点在于,那是一笔巨款,而不仅仅是普通的资金。如果我两年前给你 10 亿美元——
Original English
Speaker A: Oh, I see what you're saying. Yeah. Yeah. 10 years ago, I give you a billion. You hire engineers and you'd be... Right. Right. Like what do you do? Like, write code. You've got to, you know, the billion. The important part of that is it's a billion. It's not that you got money. It's that it's a huge billion. It's a ton of money. If I give you a billion dollars two years ago...
Speaker B: 以前给你 1000 万,你去惠普买一堆设备,钱肯定就花光了。但这回是 10 个亿。在软件行业,你招兵买马,然后就会面临扩大规模的阻碍。“神话般的人月”现象是非常真实的。
Original English
Speaker B: Because 10 million, you'd buy a bunch of stuff from Hewlett-Packard and the money would be gone, for sure. For sure. This one is a billion dollars. I mean, like in software, you hire people and then it's all about the fucking scale. The mythical man-month is very real. Yep.
The Shift to a Capital-Bound Industry
Speaker A: 但现在,如果我给 20 个人 10 亿美元,他们实际上能把它有效地利用起来。所以,这就好比我们已经把整个行业从一个受限于“工程能力”的问题,转变成了一个受限于“资本”的问题,这在本质上是非常不同的。我们以前从未见过这样的情况。
Original English
Speaker A: And right now, if I give 20 people a billion dollars, they can actually use it usefully. So it's like we've kind of moved the industry from this engineering-bound problem to a capital problem that's fundamentally very different. We've never been like that before.
Speaker A: 所以说,这就仿佛是一条新的物理定律。我们早期的直觉是“所有问题都是工程问题”,但现在情况开始发生变化了。我认为大家(尤其是像我们这样的人)都应该思考一个非常开放的问题:我们究竟需要在多大程度上重新评估我们在这些事物上的先验认知?这不仅仅是改变了一层抽象,它实际上改变了资本、创新、竞争以及防御性等因素的本质。
Original English
Speaker A: And so like this is like a law of physics where our early intuition, which is like "all problems are engineering problems," starts to change. So I think there's this very open question we should be, especially people like us should be asking, which is like, to what extent do we have to re-evaluate our priors on this stuff? And it's not just one level of abstraction, it actually changes the nature of capital versus innovation versus competition versus defensibility, etc.
Speaker B: 这个视角非常棒,因为它迫使你去思考一种全新的模型。有趣的是,在最初的 30 到 40 年里,计算也是受限于资本的。如果你想用计算机做点什么——
Original English
Speaker B: That's a great way to think about it because it forces you to think about a new model. It's also interesting that computing was capital-bound for the first 30 or 40 years. Like if you wanted to do something...
Speaker A: 这是一个非常重要的一点。如果你想用计算机做事,第一步是必须先买一台,而这并不容易。你曾经受限于资本,后来受限于工程能力,而现在我们又回到了受限于资本的阶段,这太疯狂了。就好像你不得不往回穿越 40 年一样。
Original English
Speaker A: Such an important point. If you wanted to do something with a computer, like your first step was we have to get one and then you couldn't. You were capital-bound, and then you were engineering-bound, and now we're capital again, which is crazy. So it's almost like you have to hop back 40 years.
Speaker B: 是的。《广告狂人》(Mad Men)里就有这样一个场景:计算机被送到了广告公司,大家跑来跑去试图搞清楚、弄明白它能为人们做些什么。他们拿到复印机时也是这种反应。但有意思的是,当时他们虽然不知道该用它来做什么,但他们很兴奋,因为他们有资金去购买一台,这让他们看起来好像很懂行。
Original English
Speaker B: Yeah. Mad Men goes through the scenario where the computer shows up at the advertising agency, and they run around trying to figure out, explain what it does for people. Which they also got a copy machine, the same thing they did. But it was interesting because they couldn't figure out what to do, but they were excited that they had the capital to acquire one, and it made them look like they knew what they were doing.
The End of the Pure Lean Startup Era?
Speaker B: 五年前,Patrick Collison 在一个播客中采访了 Sam Altman。Patrick 当时说:“你看,我们一直处于‘精益创业’(lean startup)的时代,但对于你们的项目,比如 OpenAI,以及其他一些耗费大量精力的项目,你们一上来就筹集了巨额资金,这种做法是不是被低估了?”他当时的说法跟你的观点不谋而合。
Original English
Speaker B: Five years ago, Patrick Collison interviewed Sam Altman in a podcast, and Patrick was saying, "Hey, you know, we've been in this era of lean startup, but for your projects, you know, OpenAI, this sort of energy project was involved with a few other aging things, you've raised colossal amounts of money right out the gate, is that underrated?" And it's sort of just speaking to what you're saying.
Speaker A: 是的,很有意思。在 AI 出现之前,Eric Ries(精益创业提出者)和 Ben Horowitz 之间一直存在着观念的交锋。
Original English
Speaker A: Yeah. Yeah. You know, it's interesting. So prior to AI, there was always this battle between Eric Ries and Ben Horowitz, right?
Speaker B: 是的,你可以看到《精益创业》,然后 Marc 和 Ben 写了类似“重金创业的艺术”这样的东西。他们基本上主张筹集大量资金并放手去干。但过去实际上一直存在着一种天然的限制,那就是工程的复杂性。那曾是无法逾越的现实。
Original English
Speaker B: Yeah. Yeah. See lean startup, and then, you know, Marc and Ben wrote like the art of the fat startup, [laughter] which basically argued: raise the money and go for it. But there's always been this natural limiter actually, which is engineering.
Speaker A: 对。
Original English
Speaker A: Yeah.
Speaker B: Patrick Collison 说得对,我们现在有了一套方法,可以让小团队拿到大笔资金并进行高效利用。这是一个非常、非常巨大的变化。我认为我们还没有完全消化这一点。
Original English
Speaker B: Complexity is, that's actually been the reality. And so Patrick Collison is right, is like we now have a discipline for taking a lot of money with small teams and using it productively. That's a very, very big change. I don't think we've internalized it.
Speaker A: 这也是现在人们能够如此乐观的原因。因为尽管资本很稀缺、很难获取等等,但一旦你拿到了资金——我们都知道,过去那种单纯依赖堆人的建设模式非常艰难,光是扩大规模、做更多事情就很困难。9 个人凑在一起并不能让工作完成得更快。
Original English
Speaker A: Which also, it's incredibly... that is why there can be so much optimism now, because although capital is scarce and it's hard to get and all of these other things, once you get it, you... the, as we know, the building based on people was also hard, like just scaling that and doing more. And then nine people can't do anything faster, and...
Speaker B: 我完全同意。我过去十年的工作,你懂的,就是负责招募并给这些早期的团队发钱,然后帮他们招人,接着就是在一旁干等两年,看着工程团队慢吞吞地推进。我认为纯粹依靠增加工程人力是无法有效扩张(scale)的。
Original English
Speaker B: I'm telling you, yeah, my 10-year job, you know, was recruited and giving—literally giving these early teams money and then helping them recruit, and then watching, then waiting for two years while the engine... and I think engineering just doesn't scale.
Implications for Venture Capital
Speaker A: 这对风险投资也有着深远的影响。过去十年来,人们一直在喊“资本过剩,资金太多了”。我真的觉得这是一种很疯狂的看法。在创投圈里一直存在着这种“零和博弈”的思维,讽刺的是,恰恰是这帮最不该有零和思维的人在这么想。他们常常会说,“太多的资金追逐太少的项目”之类的话。如果你是个风险投资人,你难道不相信正和(positive sum)游戏吗?
Original English
Speaker A: It also has implications for venture capital because for the last decade people have been saying, "Hey, there's way too much capital, way too much capital." I just think this is such a crazy view. So there's been this view in venture, this zero-sum thinking, which is funny from the people that shouldn't be zero-sum thinking, you know? And they'll go up on, "Too much capital is chasing too few deals," and all this is like... you're a venture capitalist, don't you believe in positive sum stuff, right?
Speaker A: 如果你看数据就会发现,流入私募市场的资本越多,整个市场也就变得越大。这其中有几个原因。第一,就像我们刚才讨论的,像 AI 这种真正的技术浪潮能够消化掉大量的资本;第二,如果私募市场有更充裕的资金,公司就会更长时间地保持私有化状态,从而在私募阶段积累更多的价值。所以我认为,资本流入私募市场实际上是在做大整个目标潜在市场(TAM),它并不是一个上限固定的存量市场。我觉得这很可笑,早期风险投资人本该追求正和结果,他们真的需要停止那种零和思维。
Original English
Speaker A: And but if you look at the numbers, the more capital that flows into private markets, the larger the market gets. And there's a couple reasons. One of them is the one we've talked about, like technical waves that actually are able to consume capital like AI. But there's another one is, if there's more capital available on the private markets, companies will stay private longer, so more value accrues on the private side. And so I think capital going to private markets grows the TAM. It's not a limited TAM. And I think the people that should be... that's so funny, early stage venture investors who should think of like, you know, positive sum outcomes need to stop thinking about zero sum.
Speaker B: 对此,我换个角度来总结一下,这也是我认为你们所打下的基础带来的一项最令人激动的事情:我们真正处于一波全新应用浪潮的边缘。事实上,你现在可以纯粹地投入资本,而不用再兼职做十年的“招聘专员”,并且立刻就能看到产出。现在,世界上所有还没有被软件覆盖到的领域——字面意义上的“所有领域”,比如每个人都在抱怨的医疗病历系统等等,都将迎来改变。
Original English
Speaker B: Well, one way to think about that is, I'll bring it back to what I think your foundation enables, what I think is the most exciting thing, which is we're really on the cusp of a wave of apps. And like the fact that now you can apply capital without also being a recruiter for 10 years and have output now. All of the world that's unserved by software, which is literally all of it. Like everybody who complains about whether it's medical records or...
行业经验与抽象层的提升
Speaker A: 安排去看医生,或者我最喜欢的是律师。就像,没有人比这更欢呼了:“哦,天哪,我们终于可以用人工智能实现律师的自动化了”,在一个除了拥有更多律师之外,所有人都反对任何事情的世界里,这是最奇怪的事情。但是……但是……这一切都意味着,那些拥有领域经验的人……就像我们过去常说的风险投资一样,“哦,你知道,原来建造商业房地产真的、真的很难。如果懂商业房地产的人去创办一家软件公司,那不是很好吗?”但是他们不知道如何编写软件。那么,他们应该找一个知道如何编写软件的联合创始人,并花20年的时间向他们传授商业现实。这真的很难。但现在,从那种想法到实现的路径变成了一个资金问题,这是一个全新的抽象层。而且,我的意思是,我记得我作为一名专业产品开发人员的第一次客户拜访,是去拜访一位医生,他碰巧在主修了最早的计算机科学之后去读了医学院。哇哦。
Original English
Speaker A: scheduling it to go to to go to a a a doctor or my favorite are lawyers. Like nobody has cheered more that oh my god we're finally going to be able to automate lawyers with AI which is the weirdest thing in a world where everybody is against everything except having more lawyers and but but like all of all of this this means that the person who has the domain experience like we used to love like venture capital thing like oh you know it turns out it's like really really hard to like build commercial real estate. Wouldn't it be great if somebody who understands commercial real estate built a software company but then they don't know how to build software. Well, they should get a co-founder who knows how to build software and teach them about commercial 20 years of commercial reality. It's really hard. But now the path from that kind of idea is a capital problem and that's a new level of abstraction. And I mean I remember my very very first customer visit as a professional product developer was to visit a doctor who happened to have gone to medical school after majoring in the earliest computer science. Oh wow.
Speaker B: 而且他写了一个类似于 DOS 的程序来为医生诊所安排日程。那太不可思议了。
Original English
Speaker B: And he wrote like a DOSS program to schedule a doctor's office. That's amazing.
Speaker A: 你可能以为那仅仅是安排日程,就是一个带小时数的日历。但事实证明,那时的我,20岁的我,听到这家伙解释说:“不,你不明白。”你打电话给医生,你知道,你是在和一个调度员通话。所以,他们正在听关键词来决定,这需要5分钟,还是20分钟,他们需要X光机吗,他们需要做心电图吗?因此,他们实际上是在并行安排类似于抽血等所有这些事情,而不仅仅是你需要和医生相处的10分钟。这就是他的软件所做的。他花了好几年时间才自己把那个软件敲出来。
Original English
Speaker A: Which you think it's just scheduling. It's a calendar with hours. But it turns out this was me, 20-year-old me, hearing this guy explain, "No, you don't understand." You call the doctor and you know, you're talking to a scheduler. So, they're listening for keywords to decide, is this 5 minutes, 20 minutes, do they need the X-ray machines, do they need the EKG? And so, they're actually scheduling like a blood draw and all of this stuff in parallel, not just the 10 minutes you need with the doctor. And so, that's what his software did. It took him years to bang that out himself.
Speaker B: 是的。
Original English
Speaker B: Yeah.
Speaker A: 而这正是你刚才……
Original English
Speaker A: And and that's what you just
Speaker B: 但这正是那种能够被解决的事情……就像现在,这个问题可以被懂行的人解决了。
Original English
Speaker B: but that's the kind of thing that's gonna be able to h like now that problem can get solved by the person who knows
Speaker A: 代码……无代码时代终于到来了。
Original English
Speaker A: code no code is finally here.
Speaker B: 嗯,这可能是真的,而且……而且……实际上可能是,你不仅仅是在编写这种对你来说很难的一次性代码,而且其他人的抽象层也在上升。所以,你知道,你不需要去设计那段代码……你知道,如果你是在为手机开发,好吧,手机的抽象水平已经上升了,所以你不再需要构建文本控件,你不需要构建 UI 控件,然而在20年前,创办一家公司的第一步就是构建所有这些东西。所以,就你能够做些什么而言,这有多么重要,里面大有学问。
Original English
Speaker B: Well, it could really be and and and it and it might actually be that that you're not just building this throwaway code that's hard to you but also everybody else's abstraction layer is rising. So the you know you don't need to design that piece of code like you you know if you're doing it for a phone well the phone's abstraction level has risen so you're not building a text control you're not building UI controls whereas 20 years ago step one of building a company was building all of those things and so there's there's a lot to how important this is in terms of what you're able to do
现有企业与初创公司的竞争
Speaker C: 我想谈谈是否有其他基本假设可能值得重新审视一下……是不是说,现有企业与初创企业对比如何?你知道,我们经常谈论创新者的窘境。是不是说,你知道,既然现在这些初创企业……占据主导地位,或者是,你知道,拥有资金优势,它们是否能够做更多的事情?但与此同时,我们看到一些你原本以为现有企业会轻易摧毁的初创公司。疯狂的是,如果你在六个月前告诉我,你会问这个问题,说,‘现有企业有什么优势?’它们拥有现有企业始终拥有的相同优势:它们有资金,有现金流,而且它们有……诸如此类……
Original English
Speaker C: I want to talk about any other fundamental assumptions that might be interesting to revisit is is it sort of how about incumbents versus startups you know the we've talked a lot about innovators dilemma. Does it does that you know now that these startups are earth is incumbent or you know have the capital advantage are they able to to do more but at the same time we're seeing startups that you would think incumbents would just destroy. The crazy thing if you would have told me six months ago you would have asked this question say like what like what advantages do incumbents have? They have the same advantage incumbents always have they have the capital and they have the cash flow and they have like whatever
Speaker D: 分销渠道。疯狂的是,人工智能第一解决了分销问题,它直接解决了需求问题。第二,这些公司能够筹集到如此多的资金,以至于它们实际上与像微软、以及医学界的巨头处于平等的竞争地位。所以我认为,在应对这些新挑战与现有企业竞争时,我们进入了一个非常崭新的领域,特别是出于这两个原因。你知道,我认为分销这一点经常被误解,人们没有意识到它的影响力有多大。在过去,如果你有一家公司并且想让人们使用你的产品,这很难。你会雇佣营销人员。你完全不知道该投入多少资金,投在什么地方,而且你不知道你会得到什么投资回报。但是,对于 Token 和 GPU 的需求是如此无限。毫不夸张地说,你只需决定投入多少资金,就能推动漏斗顶部的增长。因此,过去对于初创公司来说通常非常非常困难的事情,你知道,现在变得容易多了。我认为这就是为什么我们看到 Cursor、Anthropic 和 OpenAI 实现了如此惊人的增长,这带来了资金渠道,并使它们处于不平等的(有利)地位。所以非常……
Original English
Speaker D: distribution distribution and like what's crazy is AI a solves the distribution problem. it just solves the demand problem and B these companies are able to raise so much money that they're actually on competitive footing with like the Microsofts and the medicine and the Microsofts and so I think we're in a very new territory when it comes to these new challenges versus the incumbents specifically for these two reasons you know I think that the the the um the distribution point is is is often misunderstood how impactful it is in the past if you had a company and you wanted to get people to use your stuff. It was hard. You'd hire marketing. You have no idea how much like to invest and where and like you didn't know what you're getting out of return on investment. But the demand is so unlimited for tokens and for GPUs. Like literally, you can just decide how much money you're putting into it in order to drive top of funnel growth. And so the things have typically been very very hard for startups, you know, are much easier now. And I think this is why we're seeing um such meteoric growth of the cursors, the anthropics and the open AIs that results in capital access and that has put them on on uneven footing. So very
Speaker C: 我认为关于有多难这一点,看,我的一生都在管理成千上万的工程师,去构建其他任何地方都无法构建的东西。就像,构建一个操作系统的护城河。那是无限的而且……
Original English
Speaker C: I and I think it's to your point about how hard look my whole life was managing thousands of people of engineers to build things that couldn't be built anywhere else. Like it was the moat to build an operating system. It was infinite and
Speaker E: 而且我认为……
Original English
Speaker E: and I think
Speaker C: 你必须拥有一个 Cutler(指 Dave Cutler)。是不是这样……
Original English
Speaker C: you have to have one cutler. Is that the
Speaker D: 嗯,它是,但是它是,它它真的,它阅读,阅读……
Original English
Speaker D: Well, it's but it's it it really it read read
Speaker C: 那主要是……
Original English
Speaker C: that was mostly
Speaker D: 是的,我知道。不,我明白。不,但是……但是他很聪明。
Original English
Speaker D: Yeah, I know. No, I get it. No, but but he's brilliant.
Speaker C: 但去读一下……去读一下那本关于流亡时期史蒂夫·乔布斯的《Exile》的书,因为从里面,你真的能感受到这种白手起家的过程。事实上,你知道,当然了,NeXT 出了名地只是……它拿了卡内基梅隆大学 Mach 操作系统的代码,然后从那里开始。我们不可能完全从零开始做这件事。但是这个……整个这个想法,即……思考特定领域的问题有多么重要,以及你如何颠覆别人,因为在哈佛商学院,当克莱(Clayton Christensen)还在世的时候,有一个老笑话,那就是:在商学院里把“颠覆”作为一种理论来教授真的很奇怪,而实际上它应该只是物理系的一个事实。
Original English
Speaker C: But read the um read the exile Steve Jobs and exile book because it you can you really get a sense for like building up. In fact, you know, of course, next was famously just it took the code from mock at at Carnegie Melon and started from there. We couldn't have done it from from scratch completely. But this this whole idea of of just um how how important it is to to think through the the domain specific and the and how you disrupt people because there was an old joke at Harvard Business School when Clay was was still with us which was they really it's weird that they teach disruption as a theory in the business school when really it should just be a fact in the physics department
Speaker D: 而且我很喜欢我在98年他在写那本书、那篇论文以及所有东西的时候也在那里。那时候我正在教书。
Original English
Speaker D: and and I love that I was there in 98 when he was writing the book and the paper and everything. That's when I was teaching.
Speaker C: 那很好。太棒了。而且……而且我真的,我过去常常……当然,在硅谷,每一个来自大公司的人,或者当你刚像我一样到来时,都有一个传说,理论总是这样的,你总是认为:“哦,天哪,我们只要碾压所有这些小公司就行了。”当你在大公司时,你总是这么想,然后你才意识到他们永远不会被碾压。
Original English
Speaker C: That's nice. Great. and and and I really I used to be of course there's a lore with everybody who's from a big company in Silicon Valley or when you arrive like I did the theory is always like you always think oh my god we're just going to crush all of these little companies you always think that when you're at the big company and then you realize they never get crushed
Speaker D: 就像……而且本(Ben)总是强调这一点,就像他们只是……而马克(Mark)在他的……
Original English
Speaker D: like and that Ben always makes this point like they just and Mark does in his um
Speaker C: 他的电影里也是,其实是 AWS 让他们倒闭了。
Original English
Speaker C: his movie it was AWS actually put out of business
Speaker D: 对,对,确实如此,并且因为……并且因为,你知道,初创公司并没有直接瞄准现有企业,而现有企业压根就没有注意到。他们……现有企业只对其他现有企业在做什么感兴趣。微软对亚马逊和谷歌在做什么的担忧,远远多于对初创领域里任何人的担忧。但……这些产生影响的颠覆要素是……是作为一家大公司的那些文化要素,而那些是恒定不变的。那些就像是物理定律,所以你无法……你就是无法改变它们。你无法改变记分卡。谁也无法改变现场销售、进入市场策略、薪酬制度、组织结构,以及传统资产和客户群体,因为,你知道,如果你有50万客户正在服务,你的行为方式就会受到限制。
Original English
Speaker D: right right exactly and because and the and because you know the startups don't aim aim straight at the incumbents and the incumbents just don't pay attention. They the incumbents are only interested in what the other incumbents are doing. Microsoft is worried way more about what Amazon and Google are doing than anyone in a startup space. But that that this what the elements of disruption that matter are the the cultural ones of being a big company and those are constant. Those are the laws of physics and so you can't you just can't change those. You can't change scorecards. who can't change field sales and go to market and compensation and org structures and and legacy and customers because you know the way you behave if you have you know 500,000 customers you're serving
Speaker C: 你……有很多事情你就是不能那样做,你只能……你只是被困住了。
Original English
Speaker C: you there's a bunch of stuff you just can't do like that you just you're just stuck
Speaker D: 就像你……而那才真正是颠覆的本质。这就是为什么我们正处在一个神奇的时刻:不仅仅是因为这种文化一如既往地存在,而且还有初创生态系统。它非常……它反映了在云计算时代发生的事情,那是一大堆你所需要的东西。再说一次,这是抽象层。你不需要……你知道,如果你像过去那样是一家初创公司,你不需要去建立一个数据中心,建立你自己的出口,打电话给 AT&T,然后去做所有那些事情。现在你在吃第一顿晚餐的头几个小时里就能启动并运行了。
Original English
Speaker D: like you and and that is really the essence of of disruption and that's why we're at a magic moment where it's not just that that the culture is there like it always is but the startup ecosystem. It is very it has it has it's a reflection of what happened during cloud which was a whole bunch of stuff that you needed. Again, it's this abstraction layer. You don't you know if you're a startup like you were, you don't have to go build a data center and build your own egress and call AT&T and do all of that stuff. You now you're up and running in the first hours of your first dinner.
Speaker C: 但是,但是关于云计算的事情,我其实认为它……是的,你其实表达得非常好。我实际上也用过这个观点,因为这很棒。就像关于云计算的事情是,没有人认为他们能让 AWS 倒闭。
Original English
Speaker C: But the but the thing with cloud I actually think it's Yeah, you actually articulated it very well. And I actually use this because this is great. Like the thing with cloud is like nobody thought they could put AWS out of business.
Speaker D: 对。对。
Original English
Speaker D: Right. Right.
Speaker C: 就像,你只是在某种程度上接受了这种寡头垄断,然后你在它的基础上进行构建。问题是:他们会在我们那点小小的、不起眼的角落里把我们扼杀吗?答案是……
Original English
Speaker C: Like you just kind of accepted the oligopy and you built on top of it. And the question is is like will they kill us in our little kind of pipsqueak corner? The answer was
Speaker E: 他们只是会免费把你添加进去,还是以某种价格……
Original English
Speaker E: will they just add you for free or for some price
AI 初创公司的资本反转与文化挑战
Speaker A: 我其实认为,这一直是个问题。微软会开发这款应用吗?对吧。但现在这些公司实际上是在挑战现有的行业巨头。你提出了一个很棒的观点,我其实也是这么想的。过去几十年来,这些领域一直是由非常复杂、庞大的工程努力所定义的,比如制造芯片、构建系统。那本书叫什么来着?《新机器的灵魂》(The Soul of a New Machine) 还是……
Original English
Speaker A: I actually think you know and that's always been the question. Will Microsoft [build] the app? Right. But but now these companies are actually taking on the incumbents. And you make this great point which I actually had thought about it this way but like coffee has been defined by these very complex large engineering efforts building a chip building a system. What's that the age of the new machine or
Speaker B: 对,对,对。是那本……
Original English
Speaker B: Yeah. Yeah. Yeah. The solar well
Speaker A: 那个解决方案……
Original English
Speaker A: the solution
Speaker B: 是那本《新机器的灵魂》(The Soul of a New Machine)。对。
Original English
Speaker B: solar machine. Yeah.
Speaker C: 那是一本很美的书,对吧。书中讲述了构建那些系统有多么困难。即使在云计算领域构建一个操作系统也是如此。比如,在 Jeff Dean 那个时代,人们构建这些分布式集群,那是人类第一次弄清楚如何做到这一点。一旦你掌握了那个技术,那就是一个巨大的优势。所以这些都是巨大的工程挑战,任何一家初创公司都不可能做到。但现在,对于这些大模型来说,它实际上只是资本的获取途径。所以现在的“物理定律”已经完全不同了。只要你能筹集到足够的资本,你就能干成一番事业。我的意思是,你看,谷歌终究是谷歌。他们拥有所有的数据,他们拥有所有的顶尖人才。但他们的模型却正在被 OpenAI 和 Anthropic 痛击。这恰恰说明了……
Original English
Speaker C: Beautiful book right talked about how hard it was to build like you know these jack systems building an operating system even in the cloud like I mean like Jeff Dean in that era of people were building these distributed clusters and they're the first time that people could figure out how to do that. Once you had that was a massive advantage. So these were these massive engineering efforts that no startup could do and now for these models it really is just capital access and so it's a very different laws of physics where like if you can amass the capital you can do something like I mean you know I mean Google is Google they have all the data they have all the intelligence and like their models are getting trounced yeah by open AI and by anthropic and it just goes
Speaker A: 因为文化因素。
Original English
Speaker A: because the cultural element
Speaker C: 我认为,外界的人往往会低估这一点,直到你亲身经历过尝试去做的文化挑战。我敢打赌这就是文化原因。这不像是一个典型的工程问题。就像,他们一开始非常兴奋,然后就会问:“但是这里面装的是什么?” 我说:“嗯,这是一颗 ARM 芯片。”
Original English
Speaker C: I I think that people people on the outside underestimate it until you've lived the cultural element of trying to to do I'll bet it's I'll bet it's cultural. It's not like a typical, you know, engineering problem like they're they got very excited and then they were like, "But what's in here?" I said, "Well, it's an ARM chip."
Speaker A: 哇哦。
Original English
Speaker A: Oh, wow.
Speaker C: 你知道,哪怕我只是带了一块 ARM 芯片进大楼,那也是非常非常艰难的。他们从来不觉得那能成气候,他们觉得那只是用在打印机里的芯片。他们看着我,那眼神就像在说,我们是英特尔,我们无所不知。而我就会说,但这关乎功耗、关乎图形处理、关乎永远在线这些特性。然而他们的文化就是,在英特尔,他们只搞摩尔定律;就像在谷歌,他们只搞超大规模计算。
Original English
Speaker C: And and you know, like the fact I even brought one into the building, you know, and it was very very tough. and and and they just never felt that that was going to that that that was like a chip used in a in a printer and also and they looked at me like we're in we're we're ARM lences we we knew all and I'm like but it's the power it's the graphics it's the you know always connected all of this stuff and the culture was they they do moors law at Intel and just like with Google they do hypers scale
Speaker A: 所以,如果 AI 转移到端侧设备上。
Original English
Speaker A: so like if if AI moves on device.
Speaker C: 是的,是的,是的。当然。
Original English
Speaker C: Yeah. Yeah. Yeah. Of course.
Speaker A: 这可不是他们擅长的领域。
Original English
Speaker A: Like that's not what they do.
Speaker C: 对,确实如此。
Original English
Speaker C: Yeah. Sure.
Speaker A: 你知道,如果在微软,他们当时就被挤压了。现在他们依然被挤压着,你知道的。而且,我认为你提出了一个超级有趣的观点,那就是关于机遇……
Original English
Speaker A: And and you know, and if it with with Microsoft, they were squeezed. They're squeezed now, you know. And I I think you raised super interesting points about the opportunity though for
Speaker C: 对于初创公司而言……
Original English
Speaker C: for start
Speaker A: 伴随着这种资本反转现象。
Original English
Speaker A: with this capital inversion kind of thing.
Speaker C: 去筹集资本,然后去追逐……
Original English
Speaker C: Go raise go raise capital and go after the
Speaker A: 嗯,而且这不仅仅是筹集资本,你的意思似乎还在说,如果你试图去融那笔钱,我们其实不会质疑你。我们不会用看疯子一样的眼神看你。
Original English
Speaker A: Well, and it's not just it's like you're also saying like we're actually not going to question you if you're trying to raise that capital. like we're not going to look at you like you're crazy
百亿美元模型的未知能力边界
Speaker C: 你只要看看现在正在发生的一轮轮融资就知道了。正如你所知,这些初创公司因此取得了相当大的成功。最后一点,当 Vichel 来上我们的播客节目时,他认为大模型取得的元素性成果是一项伟大的成就。但他对模型做出新发现的能力,尤其是像科学突破之类的能力,持悲观态度。我很好奇,你认为目前数学领域的进展与他的观点一致吗?或者,关于当前模型架构的局限性,你的最新想法是什么?对比那种“我们只是需要更多数据/算力”的观点。我现在的看法是这样的:我认为我们确切地知道这些东西是如何运作的。你把一堆数据喂给它们,它们就被这些数据限制住了。它们只能做分布内(in-distribution)的事情,并且完全以贝叶斯的方式沿着该流形(manifold)移动。所以,我们可以用这些词来描述它。但接下来的问题是:好,但这意味着什么?它究竟能解决什么问题,对吧?我认为,对于人类来说,要去推理、去理解一个用 50 亿美元打造出来的数字人工制品——在这种情况下也就是这个模型——真的太难了。在人类历史上,我们从未创造过任何一个包含如此巨大的浮点运算量(flops)和数据量的单一数字人工制品。所以,一方面,从力学机制上讲,我们完全清楚它是怎么运作的。但另一方面,它包含了太多的数据和太多的算力,也许所有的知识和能力已经都蕴含在里面了,它可以解决你想要的任何问题。所以你知道,对话已经从“这些东西到底是怎么运作的?(我们已经知道了)”,转移到了“它能做分布外(out-of-distribution)的事情吗?”——答案是不能。嗯,那存在迁移学习吗?可能没有。比如如果你在现实生活(IRL)中训练它做一件事,它并不会因此就会发另一条毫不相关的推文。奇点来了吗?可能还没。我想大多数人目前都同意这样一点:我们还没有处于快速起飞的阶段,我们仍然被限制在分布内的能力中,这一点大家都有共识。但我认为目前没有人知道的是:好吧,你还要继续往这东西里砸上百亿美元,那它现在究竟具备了多大的能力?如果你考虑到这种元经济机制(metaeconomic machinery),也就是 Anthropic 等公司筹集巨额资金的能力,然后把所有的钱都倾注到这个东西里,去创造一个超级强大的东西。我不认为我们中任何人能预测那意味着什么,以及它会走向何方。所以这是一个不同层面的对话,但核心问题依然是一样的:它能治愈癌症吗?也许吧。如果你在一个项目上投入 200 亿美元,也许它真的能有效地治愈癌症。我认为这就是目前讨论演变的方向和现状。而且说实话,我已经断定,我无法预测一个耗资 200 亿美元创造出来的人工制品到底能做些什么。听着,我认为这一点至关重要。对于那些深度关注所有新生事物的人来说,承认自己无法预测未来,是非常重要的。我认为这很好。因为事实证明,就像我曾经写过 58 份关于互联网未来会怎样的备忘录,绝大多数都被证明是错得离谱的。但我确实认为,在……在这方面……
Original English
Speaker C: and you just look at the raises that are happening right now and like you know these companies have been quite successful as a result. The um last thing when Vichel came in uh and we had him on the podcast, he was sort of um he thought elements were a great achievement, but he was bearish on their ability to invent new discoveries, particularly like scientific breakthroughs or things like that. And I'm curious if you think the the sort of math progress um is consistent with that or or or what is your latest thinking on sort of the limitations of the of the current sort of uh you know model architecture versus like well we need more um so here's my here's kind of my new view which is I think we know exactly how these things work. You put a bunch of data in them. They're stuck to that data. They can only do distribution stuff and they can move along that manifold. um in a perfectly Beijian way. So we okay so we can say these words and then then the question is is okay but what are the implications of that like what problems can it solve right? I think it's just so hard for a human being to reason to reason about a digital artifact in this case the model that was built with $5 billion. So like in the history of humanity we've never created a single digital artifact that had that many flops and that much data in it. So on one hand we know exactly how it works from a mechanic standpoint. On the other hand that is so much data and that is so much compute maybe all of that stuff's already in there and it can solve anything that you want and so you know the conversation has moved from but how do these things work? We know can it do out of distribution stuff? No. Um uh does you know is there transfer learning? Probably not. like if IRL one thing it doesn't tweet something else like are these is the singularity here probably not I think everybody kind of most many people kind of agree on like we're not in fast takeoff you know we're stuck to it being in distribution we haven't closed we all agree about that but what I don't think anybody knows is okay but you're still putting 10 billions of dollars in that thing what's it capable of now and if you if you consider this metaeconomic machinery which means the ability from anthropic to raise lots of money then then pour all of that money into this thing to create this super powerful thing. I don't think any of us can predict what that means and where that goes. And so it's a different conversation, but the question is the same. It's like will that be able to cure cancer? Maybe. But if you put $20 billion into something, maybe it can cure cancer effectively. And that's where I think the discourse has evolved and where it is now. And I I honestly have decided that I cannot predict what an artifact worth that was, you know, that like you used $20 billion to create is capable of. I look, I I think it's just so important. It's important for people who are deep in watching everything that's new to admit that they can't predict. And I think that that's great because it turns out like I wrote 58 memos on what the internet was going to be. And I was wrong a lot of them by far. But I I do think on on the and and I
Speaker B: 但是,甚至这一次也是有一点不同的。这就像是,我拿 200 亿美元,把它投入到一个模型中,对吧?然后你和我看着那个模型,我们可以拿它做任何我们想做的事情。我认为我们根本无法理解那到底意味着什么。(笑)如此庞大的浮点运算量,如此海量的数据,我真的不知道它能做到什么程度。
Original English
Speaker B: but but even this one is a little different. This is like I I I take $20 billion and I put it into a model, right? and and then you and I look at that model and we can do whatever we want. I don't think we can comprehend the like what that even means. It's [snorts] so many flops and so much data like I don't know what that's capable of.
AI 在生物医学与脑外科的实际应用
Speaker C: 我觉得我们……我觉得那是真的很正确,而且我认为……但我不得不说,特别是在生物医学领域。你看,我家里另一半是一位使用 AI 的研究型医生。我们家里有一台 Spark,她装满了……
Original English
Speaker C: I I and I think we are I think that that's really true and I and I think but I will say on on biio medicine in particular look the other half of my household is a research doctor who uses AI. We have a spark at home and she's loaded
Speaker B: 像一吨那么多数据?
Original English
Speaker B: like a a ton
Speaker C: 就像一台 Sun Spark 工作站。不,不。呃,是 Nvidia Spark。哦,对。不,不,不。拼写里没有 C,是带 K 的(注:Apache Spark)。哦,好吧。哇哦。那一瞬间我们好像回到了旧时代,我心想,总不能是 Scott McNealy 时代的那个 Sun Spark 工作站吧。不,不是。嗯,它简直像个古董。
Original English
Speaker C: like a sun spark. No, no. Uh uh Nvidia Spark. Oh yeah. No, no, no. Not not with a C or with a K. Oh yeah. Wow. We were in old times there for I was like not a Scott McNeely Spark. No. No. Um and like a relic
Speaker A: 不。而且……而且……就好像现在全是 AI。她做大脑相关的研究,还有脑外科手术方面的研究。全都是 AI。这看起来非常有趣,因为 AI 真正能做到的就是,它就是能看出那些你看不到的模式。
Original English
Speaker A: and No. And and um and like it's all AI like she does brain stuff and and surgical brain stuff. All AI. And it's so interesting to see because what it what it really can do is it it just it it sees the patterns that you can't that
AI 的规模法则与资本的力量
Speaker A: 只有经验才能告诉别人。但是,如果关于某个主题有 10,000 篇论文是她模型的一部分,那么这就只是在寻找那些别人没有发现的模式。在现阶段,这是一种非常基础的 AI 能力,但它实际上正在开启新的解决方案、发现新问题、新的研究方向等等。我想说明一点,这并不是发现药物的魔法,因为药物研发的难点一直都不是缺乏候选药物。真正的难点一直是有效性和安全性。自 80 年代以来,我们能开发出的候选药物就一直多于我们能够测试的数量。测试需要人类患者,这非常非常非常困难。我能告诉你们在这件事上我错在哪里了吗?我很喜欢你问的那个问题,那就是我们对这些东西的通用能力的看法是如何演变的。我之前是在回应博斯特罗姆(Bostrom)关于递归自我改进和快速起飞的概念,也就是你创造了其中一个东西,然后你退后一步,它就接管了世界,对吧。我当时对此有些嗤之以鼻,因为显然那并不是正在发生的事情,而且我认为很多人都同意情况并非如此。但我错在哪里呢?我错在没有意识到我们可以有效地继续向其中投入资金,就好像规模法则(scaling laws)依然成立一样。我不知道这意味着什么——比如说我们进行一次 1000 亿美元的训练,来得到这个你投入了 1000 亿美元的东西。然后这笔钱来自这样一个元经济(meta-economic)机器,它可能想要解决他们想解决的任何问题,比如癌症,但他们也可能想制造一种武器,谁知道呢?因此,以一种有用的方式集中这么多资源,我认为是一件非常新鲜的事。我不认为我们真正理解了这其中的含义。我认为你可以合理地主张,如果你把这 1000 亿美元用错了地方,那是极其危险的。所以,我认为这才是我们这场对话需要转向的地方。少去谈论那些虚无缥缈的末日论,而是更多地去探讨能够如此集中资源到底意味着什么。
Original English
Speaker A: only experience could tell somebody. But if there's 10,000 papers on a topic that's part of her model, then like it's just finding the patterns that you just that no one has. And that's a pretty basic AI capability at this point, but it's actually opening up solutions or problems or research directions and things like that. I will say just for the like this is not a magic to discover drugs because the hard part of drugs has always been candidates not candidate. It's always been efficacy and safety. The candidates have since the 80s have been able to develop more than we could test. It's human patients and it's very very very hard. Can I can I just tell you something that I got wrong on this? So um I I love the question that you asked which is how's our thinking evolved on like you know whether these things you know like their capabilities in generality which is um I was responding to this boastrum notion of recursive self-improvement fast takeoff you create one of these things you step back and it takes over the world right and so I kind of poo pooed that because that's clearly not what's happening and I think most a lot of people agree that that's the case right but here's what I got wrong what I got wrong is I did not know that But we could effectively just continue to pour money in this like the scaling laws are holding and I I don't you know I don't know what it means to just let's say we do a hundred billion dollar training run to like have this thing that you're putting a hundred billion dollars in and then that that money comes from this meta economic machinery that may be able want to solve whatever they may want to solve cancer but they may also want to create a weapon like who knows and so this concentration of this many resources in a useful way I think is very new. I don't think we understand the implications. I think you could reasonably argue that that's very dangerous if you kind of apply that $100 billion in the wrong way. So I think that's kind of where this conversation needs to evolve to. So less the fume, you know, and more the what does it mean to be able to concentrate resources,
Speaker B: 这也就是说,你基本上是在谈论指数级增长,而这只是资金上的指数级增长,我们都知道,我们中没有谁能很好地建立指数级增长的模型。
Original English
Speaker B: which also was in all I mean this is you're you're basically talking about exponential growth and and this is just exponential in dollars and and we all know none of us can model exponential very well.
Speaker C: 是的,我们以前从未能够做到这一点,就像进行复杂的工程项目一样。你并不是用大量的资金去解决一个问题,或者只是建造这台机器。嗯,你知道你是对的。你百分之百正确,我完全同意。但我只记得当年坐在英特尔(Intel)一场接一场的会议里,听他们说我们有 5 GHz,我们有多少 GHz,多少个晶体管,但实际上没有人知道我们要拿它们来做什么。
Original English
Speaker C: Yeah, we we've never been able to do that like like complex engineering project. You were not like tackling one problem with a lot of money or just kind of building this machine. Well, we we you know it's you're right. You're 100% right and I completely agree, but just I I remember just sitting in meeting after meeting Intel saying we have 5 gigahertz, we have this many gigahertz, this many transistors and literally nobody knows what we're going to do with them all.
Speaker A: 不,不,你那是在建造机器。我是说在这个例子中,如果你想穷尽探索每一种蛋白质组合,对吧?我们只需把它变成一个钱的问题即可。是的,情况变得非常奇特。
Original English
Speaker A: No, no, you're building the machinery. I'm saying in this case, if you're like, I want to exhaustively explore every protein combination, right? We can just turn that into a money problem. Yes. Got a very strange,
Speaker D: 这是一种很好的表述方式:我们可以把以前那些无限的问题,通过投入资本,将其变成有限的问题。
Original English
Speaker D: which is a great way to say it that we can take previously um infinite problems and apply capital and it becomes finite.
Speaker C: 这就把它变成了一个资本问题,而不是一个工程问题。是的,没错。这就像是完全不同的物理定律。
Original English
Speaker C: Just makes it a capital problem and not an engineering problem. Yeah. Yeah. Which is just a very different laws of physics.
Speaker B: 是的,没错。因为现在是 2:30 了,我们就以此作为结语吧。这是一期非常棒的节目。谢谢你们。
Original English
Speaker B: Yeah. Yeah. Let's wrap on that cuz it's 2:30. This has been a great episode. Thank you guys for
Speaker A: 谢谢。
Original English
Speaker A: Thank you.