NYC Hospitals Sever Ties with Palantir as UK Grapples with AI Data Controversy
New York City's public hospital system has announced it will not renew its contract with Palantir Technologies, an American software company specializing in big data analytics. This decision comes amid mounting scrutiny in the UK over the firm's government contracts, particularly with the National Health Service (NHS).
Contract Termination and Privacy Concerns
Dr. Mitchell Katz, president of NYC Health + Hospitals, testified before the New York City Council that the agreement with Palantir, set to expire in October, was always intended as a short-term arrangement. He emphasized an "absolute firewall" preventing data sharing with US Immigration and Customs Enforcement (ICE) and stated there have been no incidents. However, documents reveal the hospital system paid Palantir nearly $4 million since November 2023 for services focused on revenue cycle optimization, including reviewing patient health notes to claim more public benefits like Medicaid.
The contract allowed Palantir to "de-identify" protected health information for purposes beyond research, raising alarms among data privacy experts. NYC Health + Hospitals confirmed it will transition to in-house systems, ceasing all data sharing with Palantir post-contract.
UK Expansion Amid Backlash
As New York moves away from Palantir, the company faces similar privacy issues in the UK, where it holds a £330 million agreement with the NHS. Health officials worry controversy may hinder the nationwide rollout of Palantir's data system, despite efforts by Prime Minister Keir Starmer to accelerate deployment. A briefing by health justice charity Medact warned that Palantir's software could enable "data-driven state abuses of power," though the company denies such misuse, citing legal and contractual breaches.
Palantir's influence in the UK is expanding, with contracts including the Ministry of Defence and a recent deal with the Financial Conduct Authority to investigate financial crime data. This has sparked outcry from MPs and calls for government investigations, though Starmer dismisses claims of overreliance on American tech firms.
Activist Victories and Ongoing Campaigns
Activists in New York, part of the Purge Palantir campaign, celebrate the contract termination as a win. Groups like the American Friends Service Committee, which obtained the contract via public records, argue against using AI systems linked to immigration enforcement in hospitals. In the UK, campaigns such as "No Palantir in our NHS" hope New York's decision fuels their fight to cancel the NHS contract, with organizations like Medact and Amnesty International UK urging similar action.
Data privacy experts highlight risks in Palantir accessing de-identified data, noting AI capabilities make re-identification easier. Law professors warn of vulnerabilities when companies collect information on marginalized populations, underscoring broader ethical concerns in government-tech partnerships.
