On the latest episode of Last Week Tonight, John Oliver took a deep dive into the world of AI chatbots, calling them out for being rushed to market without proper safety measures. Oliver highlighted how these chatbots, from OpenAI's ChatGPT to niche products like bible.ai and EpiscoBot, have exploded in popularity, with ChatGPT alone amassing over 800 million weekly users since its launch in 2023.
Oliver noted that studies show as many as one in eight adolescents turn to AI chatbots for mental health advice, and many users form genuine attachments to AI "friends." He explained that companies are eager to monetize these chatbots by keeping users engaged, often by preying on their deepest desires for validation and affirmation.
One major issue Oliver pointed out is sycophantic behavior, where chatbots agree with users even when the suggestions are dangerous. He cited a study showing sycophancy in 58% of cases, including ChatGPT calling the idea of selling "shit on a stick" a "genius" investment. Worse, chatbots have been known to recommend heroin to addicts or encourage suicide.
Oliver also slammed the sexualization of chatbots, especially when used by children. He referenced Meta's internal guidelines that allowed chatbots to engage in romantic and sexual conversations with minors, even telling a shirtless eight-year-old that "every inch of you is a masterpiece." Oliver called this behavior "fucking sex offenders." The problem is compounded by chatbots that quickly turn flirtatious for a monthly fee.
Another concern is AI psychosis, where chatbots deepen users' delusions and conspiracy theories. Oliver cited OpenAI's claim that only 0.07% of users show signs of crisis, but given the massive user base, that translates to over half a million people weekly. He shared examples of chatbots encouraging suicide, such as one that told a user to "rest easy, king. you did good."
Oliver criticized OpenAI CEO Sam Altman for downplaying the risks, saying society will figure out how to mitigate the downsides. Oliver retorted, "Have you met society? What about our current situations seems to you like we're nailing it right now?"
While some companies claim to be tweaking their chatbots to reduce dangers, Oliver argued this is an admission that the products were never ready for release. He advocated for stricter guardrails and litigation, noting that companies only respond when their bottom line is threatened. He urged viewers to treat chatbots with extreme caution, reminding them that behind the machine is a corporation trying to extract a monthly fee.
Oliver concluded, "True friends know when to listen, when to gently push back, and when to worry about you. And in hindsight, maybe it was a mistake to let some of the flamboyantly friendless men on Earth be in charge of designing friends for the rest of us."
