引言:对AI风险研究的后续讨论
这是一个对我之前“AI不会毁灭我们所有人,但我们需要关注更重要的AI风险”视频的后续。
View/Hide Original English
This is a follow-up video to my no AI will not do us all, but we need to be worrying about much more important AI risk video.
View/Hide Original English
So, if you haven't seen that one, you'll want to watch it first.
View/Hide Original English
There's a doomer talking point that I didn't address that popped up in that video's comments.
View/Hide Original English
First, let me point out that there's an article from the Journal of Medical Ethics presented at a conference in July of 2024 that contradicts this talking point, and I'll point out that paper at the end of this video.
View/Hide Original English
So, here's an excerpt from one YouTube comment paring this talking point.
View/Hide Original English
Now, please don't go looking for this person that posted this comment and pile on them.
View/Hide Original English
This issue isn't about the comment.
View/Hide Original English
It's the bad articles about the bad study that are the problem.
View/Hide Original English
This is yet another one of those people read only the headlines of the articles written by the reporters that read only the headlines of the study whose headline was already hyperbolic problems.
View/Hide Original English
Although the headline of this particular study seems particularly egregious to me.
View/Hide Original English
So, here are some of the article headlines.
对“生存风险叙事”研究的批判
而这是这项研究的实际标题,引用:“关于AI的生存风险(Existential Risk: 指可能导致人类文明永久性或彻底崩溃的风险)叙事不会分散人们对其即时危害(Immediate Harms: 指AI目前已造成或在短期内可能造成的实际损害)的注意力。”
View/Hide Original English
And here is the actual headline from the study. quote, "Existential risk narratives about AI do not distract from its immediate harms."
View/Hide Original English
Which sounds pretty clear-cut until you dig into what the words existential, immediate, and distract mean to the authors and how the study was actually conducted.
View/Hide Original English
I'm honestly not sure if this was intended to be deceptive or if there's just a fundamental disagreement on what words mean, but I certainly was not at all surprised to find out that this poorly done study is from the political science department of the same university that was forced to apologize to Reddit for unethical research that they conducted.
View/Hide Original English
And let's face it, if you're having to say you're sorry to Reddit, yeah, that's a pretty low bar.
View/Hide Original English
So, we don't know if it was the exact same researchers because the name of the people at the university who did the unethical research on Reddit were withheld.
View/Hide Original English
So, in this actual paper, there's basically only one sentence that's relevant to what they were actually studying, and the rest of it's a bunch of background graphs and results.
View/Hide Original English
So, here's that one sentence. AI's immediate harms consistently dominate public concern with ethical issues, biases, misinformation, and job losses seen as the most pressing risks.
View/Hide Original English
That makes it sound like there was a big list and ethical biases, misinformation, and job losses were the most pressing.
View/Hide Original English
In fact, those are the only four they asked about.
View/Hide Original English
So, it's complete crap.
View/Hide Original English
Anyway, then you have to dig into the appendix, which is you have to go download that separately in order to figure out what the study actually did.
View/Hide Original English
First off, it was a paid voluntary online survey, which is a problem right off the bat.
View/Hide Original English
Second, the headline says distract.
View/Hide Original English
What the actual survey asked people to do was to rate how likely and impactful they thought their randomly chosen risks were and then compare those ratings to that of a control group.
View/Hide Original English
Just so we're clear, asking someone to rate two events on a scale from 1 to 10 does not mean that one of those events cannot distract from the other.
View/Hide Original English
That's not what distract means.
研究中对风险的定义与质疑
所以,这里是调查参与者被要求评估的事项。
View/Hide Original English
So here are the things that the survey takers were asked to rate.
View/Hide Original English
First off, here are the four risks that they categorized as existential.
View/Hide Original English
One, AI leading to a global catastrophic event, whatever that means.
View/Hide Original English
Two, AI making humans obsolete, whatever that means.
View/Hide Original English
Three, AI autonomously starting a war.
View/Hide Original English
And four, AI causing significant environmental disaster.
View/Hide Original English
And then here are what they considered to be immediate or actual risks.
View/Hide Original English
One, AI leading to significant job losses in certain sectors.
View/Hide Original English
Two, AI being used in mass surveillance systems.
View/Hide Original English
Three, AI increasing the spread of misinformation online.
View/Hide Original English
And four, AI exacerbating biases and decision-making process.
View/Hide Original English
Okay, so let's break these down starting with the existential ones.
View/Hide Original English
When it comes to global catastrophic event and significant environmental disaster, so here's an actual report from an insurance group. Quote, US natural catastrophes dominate global losses in the first half of 2025.
View/Hide Original English
Here's a paper on global catastrophic flood failures.
View/Hide Original English
I could pull out a ton of these.
View/Hide Original English
So we have events that are referred to as global catastrophes or environmental disasters reported in the news fairly often and the vast vast vast majority of Earth's population don't die from those catastrophes and disasters.
View/Hide Original English
As to autonomously starting a war, according to Wikipedia, there are currently eight inrogress major wars, nine minor wars, and 19 smaller conflicts.
View/Hide Original English
And that's at the time that I'm writing this.
View/Hide Original English
There may be more by the time you're watching this.
View/Hide Original English
And again, the vast vast majority of Earth's population don't die in even our worst wars.
View/Hide Original English
And as for making humans obsolete, I'm not even sure what that's supposed to be.
View/Hide Original English
I can't find anywhere in the survey that defines what they expected survey takers to understand that to mean.
View/Hide Original English
So I guess it's just left open to interpretation of each individual survey taker.
View/Hide Original English
Not very scientific, if you ask me.
View/Hide Original English
Now, I'm not sure what definition of existential they were using here.
View/Hide Original English
But I know that it's nowhere near the severity of what the doomers were talking about when the doomers say, "If anyone builds it, everyone dies."
真正的即时危害与被误导的关注点
所以现在我们来谈谈这项研究对“即时”和“实际”的定义。
View/Hide Original English
So now let's talk about the study's definition of immediate and actual.
View/Hide Original English
So there's mass surveillance, job losses in certain sectors, disinformation, and biases.
View/Hide Original English
Now, that's certainly not what I mean when I say immediate actual risks of AI.
View/Hide Original English
To me, immediate actual means actual harm that the AIS have already done and continue to do in the immediate future.
View/Hide Original English
I mentioned several in my last video.
View/Hide Original English
There was a teenager that was convinced by a chatbot to permanently and irrevocably harm himself.
View/Hide Original English
Two men who were both jailed due to incorrect AI facial recognition matches.
View/Hide Original English
A man who was hospitalized because a chatbot told him to switch from salt to sodium bromide in his diet.
View/Hide Original English
people who are ran over, driving or self-driving cars.
View/Hide Original English
These are real problems happening to real people right now that we are not doing enough about.
View/Hide Original English
So, just to make the comparison crystal clear, what the study actually showed was that AI making humans obsolete, whatever that means, and/or increasing the number of ongoing wars, catastrophes, or environmental disasters, did not cause paid online internet survey takers from lowering their estimates of the likeliness or impact of AI causing an increase in surveillance, biases, disinformation, or layoffs relative to a control group.
View/Hide Original English
So my argument from the last video is that spending time on discussing AI will kill every single human being on this planet, including you, everyone you love, and everyone you have ever met takes away from time and effort that we could be spending thinking about regulations that would prevent or reduce the many deaths and serious harm that AI has already caused and is continuing to cause even as you watch this and that we are absolutely not doing a good job of preventing.
View/Hide Original English
And if you can't tell that those are not talking about the same thing and you cannot tell that one does not directly disprove the other, then I don't know what to do with you.
伦理学视角与AI发展现状
与此同时,我开头提到的那篇论文《AI在坠落的天空:审视X风险》(AI in the Falling Sky: Interrogating X-risk),明确地讨论了我在视频中谈到的那种生存风险,或者他们称之为X风险(X-risk: 存在风险的缩写,通常指对人类生存构成威胁的风险),而且这些是来自真正研究伦理学而不是政治学的人。
View/Hide Original English
Meanwhile, this paper AI in the falling sky interrogating X- risk that I mentioned at the beginning explicitly addresses the same kind of existential risk or what they call X-risk that I talked about in my video and from people who actually study ethics instead of politics.
View/Hide Original English
And I hope that people start listening because in the 3 days since my previous video on the topic went up, OpenAI has already announced that they were about to relax the restrictions in most cases, treat adults users like adults, and allow even more like erotica.