Artificial intelligence is poised to transform public services, but its adoption raises critical questions about privacy, accountability, and the future of human-centric care. David Winskill, a campaigner from Crouch End, has highlighted these concerns, urging council and NHS leaders to address them before widespread implementation.
Concerns Over AI Development and Regulation
Winskill draws attention to prominent figures—Sam Altman, King Charles III, and Pope Leo XIV—who have all voiced fundamental concerns about AI's development, its impact on communities, and the need for regulation. Despite AI's incredible potential, Winskill notes that society is only in the early stages of understanding its capabilities and implications, with limited comprehension of how the technology actually works.
Virtually every commercial and government sector is exploring AI applications. However, Winskill warns that white-collar workers, particularly managers and previously secure professionals, are in the direct line of fire when organisations consider downsizing. The public sector, under intense financial pressure for 15 years, is especially vulnerable to the temptation of reducing headcount and delivering services via 'intelligent' bots.
Potential AI Applications in Public Services
The superficially attractive possibilities include delivering housing repairs services, automating HR, assessing eligibility for domiciliary care, replacing library staff, and in the NHS, supporting everything from research into new therapies to assisting GPs in surgeries. Winskill anticipates that proponents will emphasise better decision-making and faster services, but he cautions that there will be little discussion of the challenges posed by safe data storage, environmental impacts, more remote and impersonal services, and the further marginalisation of the digitally excluded, the poor, and those with English as a second language.
Privacy is a central concern. Personal details were once ink on paper, locked away in filing cabinets. Now, vast amounts of intimate information on all citizens are only a hack away from an AI agent. Winskill asks whether confidentiality can ever be guaranteed.
Fundamental Questions for Leaders
After an internet search, Winskill identifies fundamental questions that council and NHS leaders should be asking—and be asked: who is accountable when AI gets it wrong, how is personal data used and protected, is the system fair, safe, and free from bias, and are decisions transparent and open to challenge?
Winskill draws a chilling parallel to the Manhattan Project, noting that when Oppenheimer and his team wanted to test the atomic bomb, they found a great big desert to try it in. He observes that 80 years later, still-in-development AI is already available on a laptop near you, signalling the urgency of addressing these concerns now.