Healthcare AI is going to have hospitals mainlining health disinformation straight into patient care.

The Mystery AI Hype Theatre 3000 podcast quoted an article in Forbes about replacing healthcare workers with “AI nurse-bots” that “will be able to integrate real-time information from global health databases, ongoing clinical trials and medical conferences” – and what they’re describing is absolutely not in compliance with any kind of healthcare safety regulations anywhere.

Hallucinating chatbot healthcare tech tools hopped up on medical conference hype. What could possibly go wrong? AI hype is so normalized that of course tech tycoons and private equity think that healthcare should run on hype filled apps and downsizing staff. CHLOE HUMBERT AUG 04, 2024
There are a lot of conferences, and a lot of things that go on at them. You don’t want life or death decisions made for you at the hospital based on some industry convention where there’s a panel with people spit-balling, or saying something snazzy, just to try to stand out in the crowd. And that’s before you even get to the fake science conferences whose purpose is “to give studies an air of scientific credibility while cashing in on millions of dollars in the process” according to a DEF CON 26 presentation from 2018. Or consider for a moment the possible inclusion of who knows what from some weirdo medical conference held by anti-vaxxers like the FLCCC convention that had presentations on so-called vaccine “shedding”, the preposterously false conspiracy fiction that vaccinated people transmit “gene therapy” to others, and had doctors pushing ivermectin as a covid treatment even though that’s been discredited and not a legitimate medical application. Who knows what dangerous papier-mâché nonsense will come out of a healthcare LLM trained on bullshit from strange MAGA trucker convoy politics from Qanon inspired medical conferences.