AIJB

Experts Warn of Risks of AI Chatbots in Healthcare

Experts Warn of Risks of AI Chatbots in Healthcare
2025-08-25 voorlichting

brussel, maandag, 25 augustus 2025.
While AI chatbots are becoming increasingly popular, healthcare experts urge caution when using them for medical or mental health advice. Despite the accessibility and speed with which chatbots can provide information, there are significant risks, such as inaccurate information and lack of human interaction. These risks can lead to misleading or even dangerous recommendations, making it crucial to always trust the advice of qualified healthcare providers.

Accessibility Issues in Traditional Healthcare

Accessibility issues with traditional healthcare, such as high costs, long waiting times, and limited insurance coverage, can drive people to consult chatbots for medical or mental health advice. These barriers make AI chatbots attractive to many, but experts warn that the risks often outweigh the benefits [1].

Risks of AI Chatbots in Healthcare

There are several risks associated with using AI chatbots for medical or mental health advice. These risks include inaccurate information, lack of human interaction, and the possibility of ‘hallucinations’ (inaccurate information). For example, chatbots may provide misleading or even dangerous recommendations, especially if they are not supplemented with human judgment [1].

Importance of Professional Medical Advice

Experts emphasize the importance of advice from qualified healthcare providers rather than AI-generated information. Chatbots cannot provide personalized advice based on individual needs and medical history. Therefore, it is essential that people always consult a doctor or other healthcare professional for health issues [1].

Ethical Considerations and AI Literacy

Ethical considerations regarding data confidentiality and psychological impact require special attention. Experts recommend encouraging open discussions about AI literacy and its potential drawbacks. This helps increase awareness and promote responsible use of AI in healthcare [1].

Future Role of AI in Healthcare

Despite current warnings, experts see a role for AI chatbots in the future of healthcare. They can help improve access to information and support patients in managing their health. However, it is crucial that this technology is used as a supplement and not as a replacement for human care [1].

Sources