Do Artificial Intelligence Chatbots Provide Adequate Information to Patients Using Implant-Supported Prostheses?

Authors : Fulya Basmacı, Ali Can Bulut

Pages : 74-83

Doi:10.54617/adoklinikbilimler.1592592

View : 72 | Download : 98

Publication Date : 2025-05-26

Article Type : Research Paper

Abstract :Aim: Artificial intelligence (AI) chatbots hold promise with regard to patient education because of their ability to deliver human-like responses to inquiries, yet their reliability in providing accurate information on the use and care of implant-supported prostheses – a critical aspect of prosthodontics – remains uncertain. This study sought to assess the alignment of responses from six AI chatbots to questions on this topic with the current literature on implant-supported prostheses. Materials and Method: Twenty-five questions related to the usage and maintenance of implant-supported prostheses were posed to six AI chatbots: ChatGPT-4, ChatGPT 01-Preview, ChatGPT 01-Mini, Gemini Advanced, Co-pilot, and Claude 3.5 Sonnet. The accuracy of their responses was assessed by two prosthodontists using a five-point Likert scale, and the average scores were calculated. Differences among the chatbots were analyzed using one-way ANOVA, with the significance level set at α=0.05. As the post-hoc comparison test, Tamhane’s T2 test was used. Results: The accuracy and relevance of the responses provided by the six AI chatbots to questions about the maintenance and use of implant-supported prostheses were evaluated. In terms of accuracy, ChatGPT 01-Preview achieved the highest mean score (4.80±0.08), while Co-pilot received the lowest score (3.22±0.20). ANOVA and Tamhane’s T2 tests revealed statistically significant differences between the models (p<0.05). Regarding relevance, Claude 3.5 Sonnet obtained the highest mean score (4.94±0.17), whereas Co-pilot demonstrated the worst performance (4.12±0.59). Conclusion: AI chatbots can serve as effective tools for patient education about implant-supported prostheses. However, inaccuracies in the responses given by certain models and the suboptimal performance of Co-pilot highlight the necessity for human oversight when utilizing these technologies.
Keywords : Yapay zeka, Sohbet robotu, Dijital sağlık, Hasta eğitimi, Dental implant

ORIGINAL ARTICLE URL