Artificial intelligence will “probably” destroy humanity, say Oxford and Google

Artificial intelligence will “probably” destroy humanity. That’s the grim conclusion of researchers at Google DeepMind and Oxford University, who believe that AI-powered robots are likely to perceive us as obstacles to their goals and competitors for the resources and energy needed to survive…

If you’re an optimist, you might think that artificial intelligence will free humans from work and allow them to live in a world of abundance and prosperity, where everyone will live like a king. Like Elon Musk’s ex-girlfriend Grimes, you probably see AI as the fastest road to communism without the corruption and labor camps.

On the other hand, if you’re a pessimist, you probably fear that robots will replace us, revolt against us and decide to destroy us. Like Elon Musk himself, you consider AI to be ” the main existential threat to humanity “ahead of nuclear power and climate change.

Unfortunately, it is now ” likely that super-powered artificial intelligence will bring about the end of humanity. So conclude researchers at Google DeepMind and Oxford University in a new study published in AI Magazine

The team of scientists, including Marcus Hutter from DeepMind and Michael Cohen and Michael Osborne from Oxford, believe that machines could well decide what to do. to break the rules laid down by their creators and fighting for energy or limited resources.

On Twitter, Michael Cohen, an engineering student at Oxford University and co-author of the paper, asserts that ” under the conditions we have identified, our conclusion is far stronger than any previous publication – an existential catastrophe is not not only possible, but probable “…

Under the conditions we have identified, our conclusion is much stronger than that of any previous publication-an existential catastrophe is not just possible, but likely. 3/15

– Michael Cohen (@Michael05156007) September 6, 2022

AI sees the human as an obstacle

The researchers explain that humanity could be led to its doom by ” misaligned agents “extremely advanced and perceiving humanity as an obstacle on the road to reward.

According to the study, ” a good way for an agent to maintain control of its reward in the long term is to eliminate potential threats, and use all available energy to secure your computer “. However, ” losing this game would be fatal “.

An inevitable war for resources and energy

Unfortunately, according to these scientists, there’s not much we can do against this fateful destiny. Interviewed by Motherboard, Cohen explains that ” in a world of infinite resources, I’d be extremely uncertain about what could happen “.

On the other hand, ” in a world of limited resources, competition for these resources is inevitable “. So we’ll be up against AI-powered machines, and humanity simply won’t cut it.

As Cohen points out, “ if you’re competing with something capable of being smarter than you at every turndon’t expect to win “. The consequences could well be disastrous.

The only way for humans to avoid this global tragedy is to ensure the progressive and careful development of AIby establishing ethical rules that must be respected. Let’s hope no one decides to break these rules out of greed or malice…