Anthropic和OpenAI的前安全研究员雅各布·考可森对Anthropic首席执行官达里奥·阿莫代伊呼吁放缓人工智能发展表示赞赏。
“我觉得很棒。“这非常令人兴奋,”考可森-上周因人工智能安全问题从Anthropic辞职-周日告诉“本周”主播乔治·斯特凡诺普洛斯。“我认为这是朝着我所说的方向迈出的实质性一步,需要在建立不同人工智能的人们之间进行某种放缓。”
在周六一封题为“我们必须走在前沿”的令人震惊的信中,阿莫代伊呼吁放缓人工智能公司开发革命性技术的步伐,他写道:“我认为我们应该尝试。”
考可森上周从Anthropic辞职时引起了轩然大波,他在XT上发帖称,Anthropic和OpenAI都“不负责”。他们正在向自我提升的超级智慧赛跑,用我们的生命在赌博。”
他还强调了行业内对人工智能被接管的可能性的担忧:“开发人工智能的人真诚地认为,它可能会在十年内杀死我们所有人,”考可森写道。
考可森告诉斯特凡诺普洛斯,他被解雇的方式让他震惊。
“实际上,我并不指望会有什么大的反响。看到这种参与程度,令人非常惊讶...我认为这确实表明进行这种对话的时机已经成熟,”考可森说。
考可森还谈到,在他工作的公司中,是否有越来越多的人认为人工智能技术变得越来越难以控制。
“没有足够的时间来不断考虑风险,但肯定的是,我注意到最近几个月,它越来越频繁地出现,”考可森说。“所以,不管你在公司的哪个位置,我想大概一周几次,都会有一些关于这项技术巨大风险的讨论。”
Former Anthropic, OpenAI employee sounds alarm over AI development pace
Jacob Coxon, a former safety researcher for Anthropic and OpenAI, applauded Anthropic CEO Dario Amodei’s calls for a slowdown in artificial intelligence development.
“I think it's great. It's very exciting,” Coxon -- who resigned from Anthropic last week over AI safety concerns -- told “This Week” anchor George Stephanopoulos Sunday. “I think this is a substantial step towards what I was talking about, needing some sort of slowdown between the people building the different AIs.”
In a stunning letter on Saturday titled“We Must Pace the Frontier,”Amodei called for a slowdown in the pace at which artificial intelligence companies develop the revolutionary technology, writing "I believe we owe it to humanity to try."
Coxon made waves last week when he resigned from Anthropic,posting on Xthat neither Anthropic nor OpenAI "is acting responsibly. They are racing straight to self-improving superintelligence and gambling with our lives."
He also highlighted the fear within the industry about the potential for an AI takeover: “The people building AI earnestly believe that it could kill us all by the end of the decade,” Coxon wrote.
Coxon told Stephanopoulos the way in which his post took off shocked him.
“I wasn't actually hoping for any big response, really. It was exceptionally surprising to see the level of engagement ... and I think it was really indicative of the moment being ripe for this sort of chat," Coxon said.
Coxon also spoke to whether there was a growing sentiment in the companies at which he worked that AI technology was becoming more difficult to control.
“There's not enough time to be constantly thinking about the risks, but definitely, I've noticed that in recent months, it comes up more and more often," Coxon said. "So no matter where you are in the company, probably around a couple of times a week, I guess, there'll be some sort of conversation around the big risks of the technology.”





