The narrative of a Christian revival sweeping across Britain, fueled by reports of swelling congregations and young people flocking back to churches, recently captivated headlines. A 2024 Bible Society report, citing YouGov survey data, claimed church attendance was increasing in England and Wales, with particular growth among youth. However, this story has unraveled dramatically, as the survey has been withdrawn due to "fraudulent" data, exposing a deeper crisis in polling integrity exacerbated by artificial intelligence.
The False Prophets of Artificial Intelligence
Academics and researchers are sounding alarms that this episode serves as a stark parable about the dangers posed by AI to reliable social research. Online opt-in surveys, which shape national discourse on everything from religion to politics, are increasingly infested with bogus data. Paid participants are using automated AI tools to generate responses at scale, undermining the foundational assumptions of survey methodology.
David Voas, a quantitative social scientist and emeritus professor at University College London, emphasized the difficulty of correcting such misinformation once it spreads. "The amount of effort required to correct it is an order of magnitude higher than the effort needed to disseminate it in the first place," he said. "We are finding our confidence in these sorts of polls undermined, and then it's very difficult to move back."
A Broken Survey Model
Sean Westwood, an associate professor in government at Dartmouth College, highlighted how AI has shattered core assumptions of survey research. "The assumption with survey research – that someone gives coherent, logical answers, they're a real person – that assumption is now broken," he stated. While there's no direct evidence AI caused the fraudulent church attendance data, Westwood warned that AI tools are "cheap, accessible and available right now" to systematically bias results.
Westwood explained that AI models can be weaponized with simple instructions to manipulate political polls or geopolitical questions while maintaining demographic profiles that evade standard screening. "Even without explicit instructions to cheat, the agent can figure out what a researcher is trying to test and produce data that confirms the hypothesis," he added. The rapid evolution of AI technology makes detection particularly challenging, as fixes become obsolete within months.
The Youth Influence and Survey Farming
The Bible Society report specifically highlighted increasing church attendance among young people, but this demographic appears particularly vulnerable to data manipulation. Courtney Kennedy, vice-president of methods and innovation at Pew Research Center, noted that opt-in estimates for people under 30 tend to contain high error levels and are more likely to stem from "click farms."
"People who are highly skilled using the internet and concealing their identity skew younger," Kennedy explained. "Bogus cases want to qualify for as many surveys as possible. It is well known in the industry that young adults are hard to reach for surveys. So from this standpoint, it is advantageous to self-present as young because surveys tend to need such respondents."
Kennedy also identified "positivity bias" among fraudulent respondents, who tend to answer affirmatively regardless of questions, artificially inflating estimates. Voas criticized the Bible Society report for failing to critically compare YouGov findings with other church research, noting that serious scholarly work requires reviewing existing literature.
Industry Responses and Detection Challenges
YouGov maintains rigorous detection measures despite the growing threat. A spokesperson told the Guardian: "The rise of organised survey farms, bots, and now AI-assisted responses makes detection a vital, continuous and constantly evolving discipline." The company employs identity checks, device fingerprinting, multi-source geolocation, real-time threat scoring, and payout oversight to prevent bad actors from slipping through.
"When someone joins the YouGov panel we link the information they supply with every data point we can observe about their device, location and behavior," the spokesperson explained. "From this we decide who to invite, who to verify and, if necessary, who to remove."
However, Voas emphasized that the problem extends beyond any single polling organization. "It's a growing problem because if you [as a participant] can work at scale, you can actually generate a reasonable amount of revenue, even in western terms, never mind global south terms," he said, highlighting the financial incentives driving survey fraud.
The withdrawal of the church attendance data serves as a cautionary tale about the vulnerability of self-selecting online surveys to manipulation. As AI tools become more sophisticated and accessible, researchers warn that our understanding of social trends faces an existential threat unless polling methodologies adapt to this new reality of automated deception.
