Google AI health summaries under scrutiny over accuracy concerns

Google’s “AI Overview” shows brief summaries atop search results but can give inaccurate guidance

Concerns have emerged over the reliability of Google’s AI-generated health summaries, after a Guardian investigation revealed instances of misleading and potentially harmful medical information.

The feature, known as “AI Overview,” appears at the top of Google search results and provides brief, AI-generated summaries of complex topics. While designed to offer quick, authoritative insights, several cases showed the tool delivering inaccurate guidance.

Examples cited include incorrect dietary advice for pancreatic cancer patients, misleading interpretations of liver blood tests, and false information regarding women’s cancer screening. Health professionals warned that such errors could prompt patients to ignore symptoms, delay treatment, or adopt unsafe practices.

Charities and experts highlighted the lack of context in AI summaries, noting that variability in answers to identical queries further undermines trust. Sophie Randall, director of the UK Patient Information Forum, said the findings “demonstrate that Google’s AI Overview can pose health risks by placing inaccurate health information at the top of online searches.”

Read More: Grok says safeguard lapses led to images of 'minors in minimal clothing' on X

Pancreatic Cancer UK’s Anna Jewell echoed the concern, explaining that following the AI’s dietary guidance could prevent patients from consuming enough calories, jeopardizing their ability to tolerate treatments or life-saving surgeries.
Google responded, asserting that most AI Overviews are “accurate and helpful,” and that the company is investing in improving the quality of health-related summaries. A spokesperson emphasized that the summaries are linked to reliable sources and recommended consulting medical professionals for definitive advice.

The investigation underscores the challenges of integrating AI into health information, as experts stress the importance of human oversight to prevent potential harm.