Using artificial intelligence (AI) chatbots to help seek medical advice can be \u00ab\u00a0dangerous\u00a0\u00bb, a new study has found.<\/p>\n
The research found that using AI to make medical decisions presented risks to patients, due to its \u00ab\u00a0tendency to provide inaccurate and inconsistent information\u00a0\u00bb.<\/p>\n
It was led by researchers from the Oxford Internet Institute and the Nuffield Department of Primary Care Health Sciences at the University of Oxford.<\/p>\n
Dr Rebecca Payne, who co-authored the study, said it found that \u00ab\u00a0despite all the hype, AI just isn’t ready to take on the role of the physician\u00a0\u00bb.<\/p>\n
\u00ab\u00a0Patients need to be aware that asking a large language model about their symptoms can be dangerous, giving wrong diagnoses and failing to recognise when urgent help is needed,\u00a0\u00bb Dr Payne, who is also a GP, added.<\/p>\n
In the study, researchers asked nearly 1,300 participants to identify potential health conditions and a recommended course of action using different scenarios.<\/p>\n
Some participants used large language model (LLM) AI softwares to receive a potential diagnosis and next steps, whereas others used more traditional methods – such as seeing a GP.<\/p>\n
Researchers then evaluated the results, and found that the AI often provided a \u00ab\u00a0mix of good and bad information\u00a0\u00bb which users struggled to distinguish.<\/p>\n
They found that, while the AI chatbots now \u00ab\u00a0excel at standardised tests of medical knowledge\u00a0\u00bb, its use as a medical tool would \u00ab\u00a0pose risks to real users seeking help with their own medical symptoms\u00a0\u00bb.<\/p>\n
\u00ab\u00a0These findings highlight the difficulty of building AI systems that can genuinely support people in sensitive, high-stakes areas like health,\u00a0\u00bb Dr Payne said.<\/p>\n
The study’s lead author, Andrew Bean – from the Oxford Internet Institute – said the study showed \u00ab\u00a0interacting with humans poses a challenge\u00a0\u00bb for even the top performing LLMs.<\/p>\n
\u00ab\u00a0We hope this work will contribute to the development of safer and more useful AI systems,\u00a0\u00bb he added.<\/p>\n
You can follow BBC Oxfordshire on Facebook, X (Twitter), or Instagram.<\/p>\n","protected":false},"excerpt":{"rendered":"
Using artificial intelligence (AI) chatbots to help seek medical advice can be \u00ab\u00a0dangerous\u00a0\u00bb, a new study has found. The research found that using AI to make medical decisions presented risks to patients, due to its \u00ab\u00a0tendency to provide inaccurate and inconsistent information\u00a0\u00bb. It was led by researchers from the Oxford Internet Institute and the Nuffield […]<\/p>\n","protected":false},"author":0,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[1],"tags":[],"class_list":{"0":"post-9770","1":"post","2":"type-post","3":"status-publish","4":"format-standard","6":"category-uncategorized"},"_links":{"self":[{"href":"https:\/\/placedesnations.org\/index.php\/wp-json\/wp\/v2\/posts\/9770","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/placedesnations.org\/index.php\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/placedesnations.org\/index.php\/wp-json\/wp\/v2\/types\/post"}],"replies":[{"embeddable":true,"href":"https:\/\/placedesnations.org\/index.php\/wp-json\/wp\/v2\/comments?post=9770"}],"version-history":[{"count":0,"href":"https:\/\/placedesnations.org\/index.php\/wp-json\/wp\/v2\/posts\/9770\/revisions"}],"wp:attachment":[{"href":"https:\/\/placedesnations.org\/index.php\/wp-json\/wp\/v2\/media?parent=9770"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/placedesnations.org\/index.php\/wp-json\/wp\/v2\/categories?post=9770"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/placedesnations.org\/index.php\/wp-json\/wp\/v2\/tags?post=9770"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}