The Guardian journalist Michael Safi has spent six months investigating the creators of an AI company that produces deepfakes, a quest that has led him to confront a larger question: whether artificial intelligence will make it impossible to distinguish fact from fiction. His investigation is the focus of the second episode of the podcast series Black Box, originally broadcast on 7 March 2024.
The Hunt for ClothOff
Safi's investigation centers on ClothOff, an app that uses AI to create realistic but fake images and videos, often of a sexual nature, without the consent of those depicted. The app has caused significant disruption worldwide, with police and lawmakers struggling to respond effectively to the challenges it poses.
Throughout the episode, Safi details his efforts to uncover the identities and locations of the individuals responsible for ClothOff. The search takes him across digital and geographical boundaries, revealing the opaque nature of the AI industry and the difficulties in regulating it.
Global Havoc and Legal Challenges
The deepfakes generated by ClothOff have led to widespread harm, affecting individuals' reputations and personal lives. Law enforcement agencies and legislative bodies in multiple countries have been baffled by the technology, which evolves faster than legal frameworks can adapt. The episode highlights specific cases where victims have struggled to seek justice or have the content removed.
Safi's reporting underscores the global scale of the problem, as the app's reach extends across borders, complicating jurisdictional efforts to shut it down or prosecute its creators.
AI and the Erosion of Truth
Beyond the immediate harm caused by ClothOff, Safi raises a more profound concern: the potential for AI to erode public trust in visual and audio evidence. As deepfake technology becomes more sophisticated, it becomes increasingly difficult for individuals, journalists, and even courts to verify the authenticity of media.
The episode concludes with Safi reflecting on the broader implications of AI for society. He notes that while the hunt for ClothOff's creators may eventually succeed, the underlying issue of AI's impact on truth and reality remains unresolved, posing a challenge that will only grow in the coming years.
