AI Existential Risk: How Worried Should We Be?
AI Existential Risk: How Worried Should We Be?

Ten per cent. That is the risk, more or less, claimed a high-profile AI developer last week, that the technology wipes humanity out in the next decade. The figure has intensified a growing public and political debate about the existential dangers of artificial intelligence.

Over the last few months, there has been a string of warnings, resignations, and even stories of AI companies losing control of their bots. These events have pushed the issue from the margins of tech discourse to the mainstream, prompting a closer examination of how much concern is warranted.

A Crossover Moment for AI Safety

“I think it’s a crossover moment for the AI safety story because this has been for a long time talked about inside the AI world,” says Robert Booth, the UK technology editor for the Guardian. “But now, the general public and the political class have become increasingly concerned about it.”

Wide Pickt banner — collaborative shopping lists app for Telegram, phone mockup with grocery list

Booth’s comments come amid a wave of high-profile figures in the tech sector who have either warned about or resigned over the perceived threats posed by AI. The concerns range from job displacement to the potential for AI systems to act in ways that are harmful to humanity.

Key Warnings and Resignations

The recent warnings are not isolated. Several leading AI researchers and developers have publicly expressed their fears, with some stepping down from their positions to advocate for stronger safety measures. The stories of AI companies losing control of their bots have added a layer of urgency to the discussions, suggesting that the risks are not merely theoretical.

These developments have led to a broader conversation about the need for regulation and oversight. The political class, in particular, has begun to take notice, with calls for more robust frameworks to ensure that AI development proceeds safely.

How Worried Should the Public Be?

Annie Kelly, the host of the podcast, asks the central question: how worried should we be? While the 10% figure is alarming, experts like Booth suggest that the situation is complex. The AI safety story has been a topic of discussion within the AI community for years, but it has now reached a point where public awareness is crucial.

The podcast episode, featuring Booth, delves into the specifics of these risks, the credibility of the warnings, and what steps might be taken to mitigate potential dangers. It also explores the psychological and societal impact of living with such existential uncertainties.

As the debate continues, the focus remains on balancing innovation with safety. The coming months will likely see more discussions, and possibly more resignations, as the AI community grapples with these profound questions.

Pickt after-article banner — collaborative shopping lists app with family illustration