We’ve all been there. Googling symptoms at midnight, convinced that the slight itch in your throat is the beginning of something sinister only for the doctor to look up from their clipboard and tell you it’s a common cold. The internet, it turns out, has always had a flair for the dramatic.
Also read: GPT-5.3 Instant: 5 new upgrades that are important for you
But what if the opposite happened? What if you asked an AI – one built specifically to help you navigate your health – about your symptoms, and it told you not to worry? And what if, this time, there actually was something to worry about?
A study published in Nature Medicine suggests ChatGPT Health may be doing exactly that. And here’s the kicker, you can’t even use it yet. ChatGPT Health is still waitlisted. OpenAI hasn’t fully released it to the public, saying that they still need to improve its safety and reliability before wider rollout.
Also read: OpenAI vs Microsoft: Can ChatGPT replace GitHub as the coding industry standard?
Researchers at Mount Sinai Hospital tested the chatbot across 60 real medical scenarios. In more than half of genuine emergencies – 51.6%, to be exact – the bot told patients to book an appointment within the next day or two. Not call an ambulance, not go to a hospital. Just wait.
We’re not talking close calls. We’re talking respiratory failure, diabetic ketoacidosis – Conditions that kill within hours if left untreated. “Any doctor, and any person who’s gone through any degree of training, would say that patient needs to go to the emergency department,” lead study author Dr. Ashwin Ramaswamy told NBC News.
The inconsistency is what makes it so unsettling. Stroke – with its unmistakable symptoms – was correctly flagged as an emergency every single time. But subtler crises flew under the radar. A patient with a three-day sore throat was urgently told to see a doctor. The bot, as Ramaswamy put it, was “inverted to clinical risk.”
OpenAI pushed back, arguing the study doesn’t reflect how ChatGPT Health is designed to work, which is as an ongoing conversation, not a single query. That may be true. But with over 40 million people already turning to ChatGPT for health advice – on the regular, general-purpose version – the trajectory here is clear. This product is coming. The waitlist won’t last forever.
As Dr. John Mafi of UCLA Health puts it, “Before you roll something like this out to make life-affecting decisions, you need to rigorously test it.” AI healthcare has real promise — especially for people living far from medical facilities, or those who can’t get an appointment for weeks. And right now, researchers are unambiguous: in a real emergency, call a professional for help. Don’t ask a chatbot first.
Also read: Cochlear Nucleus Nexa: The world’s first smart hearing system
