Chatbots talk Strabismus: Can AI become the new patient Educator?

dc.contributor.authorEdhem Yılmaz, İbrahim
dc.contributor.authorBerhuni, Mustafa
dc.contributor.authorÖzer Özcan, Zeynep
dc.contributor.authorDoğan, Levent
dc.date.accessioned2024-11-07T10:40:00Z
dc.date.available2024-11-07T10:40:00Z
dc.date.issued2024
dc.departmentNiğde Ömer Halisdemir Üniversitesi
dc.description.abstractBackground: Strabismus is a common eye condition affecting both children and adults. Effective patient education is crucial for informed decision-making, but traditional methods often lack accessibility and engagement. Chatbots powered by AI have emerged as a promising solution. Aim: This study aims to evaluate and compare the performance of three chatbots (ChatGPT, Bard, and Copilot) and a reliable website (AAPOS) in answering real patient questions about strabismus. Method: Three chatbots (ChatGPT, Bard, and Copilot) were compared to a reliable website (AAPOS) using real patient questions. Metrics included accuracy (SOLO taxonomy), understandability/actionability (PEMAT), and readability (Flesch-Kincaid). We also performed a sentiment analysis to capture the emotional tone and impact of the responses. Results: The AAPOS achieved the highest mean SOLO score (4.14 ± 0.47), followed by Bard, Copilot, and ChatGPT. Bard scored highest on both PEMAT-U (74.8 ± 13.3) and PEMAT-A (66.2 ± 13.6) measures. Flesch-Kincaid Ease Scores revealed the AAPOS as the easiest to read (mean score: 55.8 ± 14.11), closely followed by Copilot. ChatGPT, and Bard had lower scores on readability. The sentiment analysis revealed exciting differences. Conclusion: Chatbots, particularly Bard and Copilot, show promise in patient education for strabismus with strengths in understandability and actionability. However, the AAPOS website outperformed in accuracy and readability. © 2024 Elsevier B.V.
dc.identifier.doi10.1016/j.ijmedinf.2024.105592
dc.identifier.issn1386-5056
dc.identifier.pmid39159506
dc.identifier.scopus2-s2.0-85201452962
dc.identifier.scopusqualityQ1
dc.identifier.urihttps://doi.org/10.1016/j.ijmedinf.2024.105592
dc.identifier.urihttps://hdl.handle.net/11480/11337
dc.identifier.volume191
dc.indekslendigikaynakScopus
dc.indekslendigikaynakPubMed
dc.language.isoen
dc.publisherElsevier Ireland Ltd
dc.relation.ispartofInternational Journal of Medical Informatics
dc.relation.publicationcategoryMakale - Uluslararası Hakemli Dergi - Kurum Öğretim Elemanı
dc.rightsinfo:eu-repo/semantics/closedAccess
dc.snmzKA_20241106
dc.subjectChatbots in healthcare
dc.subjectChatGPT
dc.subjectHealth literacy
dc.subjectPatient engagement
dc.subjectStrabismus patient education
dc.titleChatbots talk Strabismus: Can AI become the new patient Educator?
dc.typeArticle

Dosyalar