UK prime minister Rishi Sunak called for honesty and openness ahead of this week’s AI Safety Summit in Bletchley Park for global politicians, tech executives and experts. But warm words and loose promises may not be enough to stem the AI tsunami.
Several days prior to the attack on Israel by Hamas, the renown Israeli author, historian and philosopher Yuval Noah Harari was in Azerbaijan, its own territorial dispute with Armenia having flared up only a week earlier, to give a keynote address at the opening ceremony of the 74th International Astronautical Congress (IAC) in Baku.
For this annual global gathering of world-leading space scientists, rocket engineers and space graduates, all with their futuristic eyes firmly set on the heavens above, his evocative and challenging words brought them crashing down to Earth.
“Soon the era of human domination of this planet might come to an end,” he warned, laying out the stark reality of AI (Artificial Intelligence) and the inherent dangers it presents to humanity. His talk drew rapturous applause from delegates crammed into the 3,000-capacity auditorium.
Despite suggesting that AI has the potential to help humanity, Harari, most famous for his international best-selling book ‘Sapiens’, expressed serious concerns about its precipitant threat to the very life that brought it into being.
Era of human domination
“Just as spaceships, without ever developing feathers, fly much further than birds, so computers may come to solve problems, much, much better than human beings without ever developing feelings,” he said.
“If human consciousness goes extinct and our planet falls under the dominion of super intelligent but entirely non-conscious entities that would be an extremely sad and dark end to the story of life. It would be an empire of total darkness.”
How can we avoid this dark fate and deal with the numerous challenges posed by AI? The good news is that while AI is nowhere near its full potential, the same is true of humans too.
“We humans need to stop fighting among ourselves and cooperate on our shared interests. Unfortunately, in too many countries, like in my own country of Israel and elsewhere, people are not focused on our shared human interests, but rather on fighting with the neighbours about a few hills. What good would it do to win these hills if humanity loses the whole planet?”
Even if humans across the world cooperate He described the task of regulating AI as a difficult and delicate one.
“Given the pace at which AI is developing it is impossible to anticipate and regulate in advance all the potential hazards, therefore regulations should be based less on creating a body of rigid rules and more on establishing living regulatory executions that can quickly identify and respond to problems as they arise,” he said.
“To function well the institutions should also be answerable to the public and should stay in close contact with the human communities all over the world that are affected and impacted by AI.”
“In this era of AI the greatest danger to humanity comes from a false belief in infallibility. But even the wisest people make mistakes and AI is not infallible either,” he said.
“If we put all our trust in some allegedly infallible AI, in some allegedly infallible human being or in some allegedly infallible institution, the result could be the extinction of our species.
“In the past humans have made some terrible mistakes, like building totalitarian regimes, creating exploitative empires and waging world wars.
“Nevertheless, we survived because previously we didn’t have to deal with the technology that can annihilate us. Hitler and Stalin killed millions but they couldn’t destroy humanity itself, so humanity got a second chance to learn from its catastrophic mistakes and experiments.”
But Harari warned that AI is very different. “If we make a big mistake with AI we may never get a second chance to learn from it. We should not allow any single person, corporation or country to take a gamble on the fate of our entire species and perhaps on the fate of all earthly life forms,” he said.
“As far as we know today, terrestrial animals maybe the only conscious entities in the entire galaxy or perhaps in the entire universe. There might be other conscious beings out there somewhere, but at least to the best of my knowledge we haven’t met any of them, so we cannot be sure.
“We have now created a non-conscious but very powerful alien intelligence here on Earth. If we mishandle this, AI might extinguish not just the human dominion over this planet but the light of consciousness itself, turning the universe into a realm of utter darkness. It is the responsibility of all of us to prevent this.”
* * *
The 74th International Astronautical Congress (IAC), in Baku, Azerbaijan, held between 2 and 6 October 2023, was organised by the International Astronautical Federation (IAF) in conjunction with Azercosmos (the Space Agency of the Republic of Azerbaijan) under the theme ‘Challenges and Opportunities: Give Space a Chance’. In 2024 the IAC will be held in Milan, Italy.
A shorter version of this article was published by Central Bylines on 5 November 2023.