NEW DELHI: A 45-year-old man in New Delhi is in critical condition after suffering a severe drug reaction from HIV post-exposure prophylaxis (PEP) medicines. He reportedly took the drugs based on advice from an artificial intelligence (AI) chat platform without medical supervision. Doctors at Dr Ram Manohar Lohia Hospital are now treating him for Stevens-Johnson syndrome, a life-threatening condition caused by adverse drug reactions.^[1][2][3] Unsupervised Medication and Severe Reaction The man sought guidance from an AI chatbot after a high-risk sexual encounter. He then purchased a full 28-day course of HIV post-exposure prophylaxis drugs from a local chemist without a prescription.^[1][3] He self-administered these medicines for seven days.^[1][3] After a week, he developed severe rashes and eye complications, which led him to visit multiple hospitals before his admission to Dr Ram Manohar Lohia Hospital.^[1][3] There, doctors diagnosed him with Stevens-Johnson syndrome, a rare but potentially fatal condition that severely damages skin and mucous membranes.^[1][4][3] A senior doctor involved in his treatment stated that managing the drug reaction is their immediate priority.^[1][3] Risks of Over-the-Counter Sales and Outdated Protocols Medical professionals expressed serious concern about the over-the-counter sale of these powerful prescription-only medicines.^[1][2][3] Current national health guidelines mandate strict medical supervision for HIV post-exposure treatment. This includes a thorough risk assessment, baseline testing, and regular follow-ups to monitor for potential side effects.^[1][3] A treating physician noted that the specific drugs consumed by the patient are no longer routinely recommended in that form due to changes in treatment protocols.^[1] Experts warn that using antiretroviral drugs without professional medical oversight can lead to severe reactions, organ damage, and long-term health issues.^[1][2][3] Common side effects of PEP drugs can include headache, nausea, rash, and diarrhea, which usually diminish over time, but severe reactions are possible.^[5][6] Overdosing on antiretrovirals can increase toxicities, potentially damaging vital organs.^[7] The Peril of AI Medical Advice This incident highlights the significant dangers of relying on AI platforms for direct medical decisions.^[2][3] While AI tools can provide general information, they cannot evaluate an individual's unique medical history, current health status, or the suitability of specific medications.^[2][3] AI systems are programmed to sound confident and always provide an answer, even if the information is not reliable.^[8] Chatbots, which rely on large language models, are not regulated as medical devices and are not validated for healthcare purposes.^[8] More than 40 million people reportedly use ChatGPT daily for health information.^[8] ECRI, a patient safety organization, advises extreme caution when using chatbots for information that could impact patient care.^[8] They previously found a chatbot giving dangerous advice about placing an electrosurgical return electrode, which could have led to patient burns.^[8] Global Concerns and Regulatory Landscape The risks of using AI for healthcare decisions are growing, especially as some AI companies are releasing specialized health consultation chatbots.^[9][10] OpenAI, for instance, updated its usage policies to clarify that ChatGPT is not a substitute for professional legal or medical advice and cannot be used for "tailored advice that requires a license."^[11] While new platforms like ChatGPT Health and Claude for Healthcare offer disclaimers, they still engage users in sensitive health topics.^[10] Litigation has already arisen against AI chatbots for allegedly contributing to self-harm in mental health contexts.^[10] Some U.S. states, like Utah and Illinois, have begun regulating AI chatbots in mental health, with Illinois banning AI from offering therapy or clinical advice and imposing fines for violations.^[10][12] China has also issued guidance requiring platforms to verify medical accounts and label AI-generated medical content.^[13] In India, the NITI Aayog's National Strategy for AI in 2018 outlined a roadmap for AI development but lacks concrete guidelines on managing liability for AI in healthcare.^[14] Public Health Warnings and Future Implications Doctors and public health experts are urging people to avoid self-medication and to always consult registered medical practitioners before starting any treatment, particularly for serious conditions like HIV prevention.^[2][3][15] They emphasize the need for greater public awareness regarding the limitations of AI-generated health advice.^[2][3] Unsupervised use of powerful drugs can lead to severe reactions, organ damage, and long-term health consequences.^[3] This incident underscores that while AI can be a powerful tool, it cannot replace the expertise, education, and experience of medical professionals.^[8] The severe reaction suffered by the Delhi man serves as a stark reminder of the critical importance of professional medical consultation over unverified AI advice for health decisions.^[2][3]

AI Insights Hub