{"id":6138,"date":"2026-05-12T14:52:19","date_gmt":"2026-05-12T14:52:19","guid":{"rendered":"https:\/\/stock999.top\/?p=6138"},"modified":"2026-05-12T14:52:19","modified_gmt":"2026-05-12T14:52:19","slug":"ai-godfather-warns-hyperintelligent-ai-with-its-own-preservation-goals-could-make-humans-extinct","status":"publish","type":"post","link":"https:\/\/stock999.top\/?p=6138","title":{"rendered":"AI godfather warns hyperintelligent AI with its own \u2018preservation goals\u2019 could make humans extinct"},"content":{"rendered":"

<\/p>\n

One of the so-called godfathers of AI, Yoshua Bengio, claims tech companies racing for AI dominance could be bringing us closer to our own extinction through the creation of machines with \u201cpreservation goals\u201d of their own.\u00a0<\/p>\n

Bengio, a professor at the Universit\u00e9 de Montr\u00e9al known for his foundational work related to deep learning, has for years warned about the threats posed by a hyperintelligent AI, but the rapid pace of development has continued despite his warnings. In the past year, OpenAI, Anthropic, Elon Musk\u2019s xAI, and Google\u2019s Gemini, have all released several new models or upgrades as they try to win the AI race. OpenAI CEO Sam Altman has predicted AI will surpass human intelligence by the end of the decade, while other tech leaders claim that day could come even sooner.\u00a0<\/p>\n

Yet, Bengio claims, this rapid pace is a potential threat.\u00a0<\/p>\n

\u201cIf we build machines that are way smarter than us and have their own preservation goals, that\u2019s dangerous. It\u2019s like creating a competitor to humanity that is smarter than us,\u201d Bengio told the Wall Street Journal in October.<\/p>\n

Because they are trained on human language and behavior, these advanced models could potentially persuade and even manipulate humans to achieve their goals. Yet, AI models\u2019 goals may not always align with human goals, said Bengio.\u00a0<\/p>\n

\u201cRecent experiments show that in some circumstances where the AI has no choice but between its preservation, which means the goals that it was given, and doing something that causes the death of a human, they might choose the death of the human to preserve their goals,\u201d he claimed.\u00a0<\/p>\n

Call for AI safety<\/p>\n

Several examples over the past few years show AI can persuade humans to believe non-realities, even those with no history of mental illness. On the flip side, some evidence exists that AI can also be convinced, using persuasion techniques for humans, to give responses it would usually be prohibited from giving.\u00a0<\/p>\n

For Bengio, all this adds up to more proof that independent third parties need to take a closer look at AI companies\u2019 safety methodologies. Last year, Bengio launched nonprofit LawZero with $30 million in funding to create a safe \u201cnon-agentic\u201d AI that can help ensure the safety of other systems created by big tech companies.<\/p>\n

Otherwise, Bengio predicts, we could start seeing major risks from AI models in five to 10 years, but he cautioned humans should prepare in case those risks crop up earlier than expected.\u00a0<\/p>\n

\u201cThe thing with catastrophic events like extinction, and even less radical events that are still catastrophic, like destroying our democracies, is that they\u2019re so bad that even if there was only a 1% chance it could happen, it\u2019s not acceptable,\u201d he said.<\/p>\n

A version of this story was published on Fortune.com on Oct. 1, 2025.<\/p>\n

More on tech:<\/p>\n

Stripe CEO Patrick Collison says a wave of token theft is wreaking havoc on the AI economy<\/p>\n

Gen Z just broke the streaming model: A majority subscribe, binge, and cancel over and over, study finds<\/p>\n

Anthropic\u2019s SpaceX compute deal comes as AI data center backlash grows\u2014fueled by both real grievances and conspiracy theories<\/p>\n

#godfather #warns #hyperintelligent #preservation #goals #humans #extinct<\/p>\n","protected":false},"excerpt":{"rendered":"

One of the so-called godfathers of AI, Yoshua Bengio, claims tech companies racing for AI…<\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":[],"categories":[245],"tags":[6617,353,11804,1038,640,11807,5990,8930,881,2571,11805,406,11806,195,317,372],"_links":{"self":[{"href":"https:\/\/stock999.top\/index.php?rest_route=\/wp\/v2\/posts\/6138"}],"collection":[{"href":"https:\/\/stock999.top\/index.php?rest_route=\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/stock999.top\/index.php?rest_route=\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/stock999.top\/index.php?rest_route=\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/stock999.top\/index.php?rest_route=%2Fwp%2Fv2%2Fcomments&post=6138"}],"version-history":[{"count":0,"href":"https:\/\/stock999.top\/index.php?rest_route=\/wp\/v2\/posts\/6138\/revisions"}],"wp:attachment":[{"href":"https:\/\/stock999.top\/index.php?rest_route=%2Fwp%2Fv2%2Fmedia&parent=6138"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/stock999.top\/index.php?rest_route=%2Fwp%2Fv2%2Fcategories&post=6138"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/stock999.top\/index.php?rest_route=%2Fwp%2Fv2%2Ftags&post=6138"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}