Over-reliance on chatbots can diminish critical-thinking skills, a new study from the Massachusetts Institute of Technology has found. The research also suggests that depending too much on artificial intelligence could potentially decrease the ability to discern misinformation.
Study Details
As AI tools become more sophisticated and accessible, manipulated images and misleading headlines are becoming more common. While AI can help users identify fake content, there is a cost to using it this way, the new research suggests. An over-dependence on AI to figure out what is real on the internet can lead to trouble making those judgments independently.
During the four-week study, released in April, researchers tracked 67 participants and quizzed them on whether pairs of news-related headlines and images were real. They found that AI assistants like Claude and ChatGPT were useful for detecting fake news, but when participants relied on them too much, they became worse at spotting misinformation.
Researchers also found that when it came to deciding which news headlines and images were real, AI often prioritized an accurate response rather than cultivating an ability to think. This dependency could actually worsen judgment in the long term, according to the study.
“When we’re interacting with AI, we feel we’re becoming better at certain tasks and there’s enough research that shows we are not,” said Anku Rani, a PhD student at MIT and co-lead author of the study.
How the Study Worked
Participants in the month-long study were asked to respond to questions about fake news and images with and without the help of an AI assistant that runs on GPT-4o and is integrated with Google search. The chatbot could hint at clues to look for; one example showed the AI chatbot advising a user to take a closer look at a police badge that revealed an image was fake.
The study authors evaluated how helpful AI was in guiding participants to make an accurate decision, as well as how their independent judgment changed over time. They found a trade-off: AI helped participants better discern what is real and resulted in a 21% higher chance they would make the right call. But their unassisted performance, when reviewing new images without AI’s help, grew 15.3% worse in the experiment’s fourth week. “These results indicate that while AI may help immediately, it may ultimately degrade long-term misinformation detection abilities,” the study noted.
Broader Implications
Concerns about the effects of depending too much on AI, and even other forms of technology, are not new. Calculators and GPS devices have dulled the ability to do mental math and navigate neighborhoods without assistance. A 2025 Lancet study found that doctors who use AI classification tools to detect cancer eventually became worse at doing so on their own. A neuroscientist at the Possibility Institute, a metascience research group, recently warned that diverting too much of one’s thinking to AI can weaken the brain’s defenses against dementia.
The recent MIT study’s analysis notes that an AI system’s approach, whether it is more prescriptive or probing, can affect a user’s ability to maintain good judgment. Although users are often looking for a chatbot to provide speed and certainty, it is the more nuanced, guided questioning that can improve critical thinking, the study notes.
Participants who use AI systems that tell them what to do often “go along with the system because it sounds knowledgeable,” the study adds. About one-quarter of participants said they thought their detection skills were improving, even when their performance was getting worse.
Limitations and Future Research
The MIT study has some key limitations. The authors acknowledge that they were working with participants predominantly from the US and UK and that a more diverse sample could indicate whether this skill degradation occurs across cultural contexts and educational systems. Longer studies that track people for more than four weeks could also shed light on whether the effects of an over-reliance on AI continues at the same rate as time progresses.
Researchers say their results are especially important for educators to consider as they increasingly rely on AI for learning tools. The study’s observations are also relevant for the broader public, given an inundation of dubious online information, from news and viral images to medical claims and political rumors. “As AI becomes increasingly sophisticated, ensuring these tools build critical thinking skills rather than cognitive dependency becomes essential for maintaining public resilience to misinformation,” the study notes.
