Using ChatGPT for medical education: the technical perspective

Abstract Background The chatbot application Bennie and the Chats was introduced due to the outbreak of COVID-19, which is aimed to provide substitution for teaching conventional clinical history-taking skills. It was implemented with DialogFlow with preset responses, which consists of a large constr...

Full description

Saved in:
Bibliographic Details
Main Authors: Kwan Yin Chan, Tsz Hon Yuen, Michael Co
Format: Article
Language:English
Published: BMC 2025-02-01
Series:BMC Medical Education
Subjects:
Online Access:https://doi.org/10.1186/s12909-025-06785-9
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1823861939202162688
author Kwan Yin Chan
Tsz Hon Yuen
Michael Co
author_facet Kwan Yin Chan
Tsz Hon Yuen
Michael Co
author_sort Kwan Yin Chan
collection DOAJ
description Abstract Background The chatbot application Bennie and the Chats was introduced due to the outbreak of COVID-19, which is aimed to provide substitution for teaching conventional clinical history-taking skills. It was implemented with DialogFlow with preset responses, which consists of a large constraint on responding to different conversations. The rapid advancement of artificial intelligence, such as the recent introduction of ChatGPT, offers innovative conversational experiences with computer-generated responses. It provides an idea to develop the second generation of Bennie and the Chats. As the epidemic slows, it can become an assisting tool for students as additional exercise. In this work, we present the second generation of Bennie and the Chats with ChatGPT, which provides room for flexible and expandable improvement. Methods The objective of this research is to examine the influence of the newly proposed chatbot on learning efficacy and experiences in bedside teaching, and its potential contributions to international teaching collaboration. This study employs a mixed-method design that incorporates both quantitative and qualitative approaches. From the quantitative approach, we launched the world’s first cross-territory virtual bedside teaching with our proposed application and conducted a survey between the University of Hong Kong (HKU) and the National University of Singapore (NUS). Descriptive statistics and Spearman’s Correlation were applied for data analysis. From the qualitative approach, a comparative analysis was conducted between the two versions of the chatbot. And, we discuss the interrelationship between the quantitative and qualitative results. Results For the quantitative result, we collected a questionnaire from 45 students about the evaluation of virtual bedside teaching between territories. Over 75% of the students agreed that teaching can enhance learning effectiveness and experience. Moreover, by exchanging patients cases, 82.2% of students agreed that it helps to gain more experiences with diseases that may not be prevalent in their own locality. For the qualitative result, the new chatbot provides better usability and flexibility. Conclusion Virtual bedside teaching with chatbots has revolutionized conventional bedside teaching by its advantages and allowing international collaborations. We believe that the training of history taking skills by chatbot will be a feasible supplementary teaching tool to conventional bedside teaching.
format Article
id doaj-art-097b2b9d8fb1492393d4f93fbce681b5
institution Kabale University
issn 1472-6920
language English
publishDate 2025-02-01
publisher BMC
record_format Article
series BMC Medical Education
spelling doaj-art-097b2b9d8fb1492393d4f93fbce681b52025-02-09T12:42:33ZengBMCBMC Medical Education1472-69202025-02-0125112910.1186/s12909-025-06785-9Using ChatGPT for medical education: the technical perspectiveKwan Yin Chan0Tsz Hon Yuen1Michael Co2Department of Computer Science, University of Hong KongDepartment of Software Systems & Cybersecurity, Monash UniversityCentre for Education and Training, Department of Surgery, Queen Mary Hospital, University of Hong KongAbstract Background The chatbot application Bennie and the Chats was introduced due to the outbreak of COVID-19, which is aimed to provide substitution for teaching conventional clinical history-taking skills. It was implemented with DialogFlow with preset responses, which consists of a large constraint on responding to different conversations. The rapid advancement of artificial intelligence, such as the recent introduction of ChatGPT, offers innovative conversational experiences with computer-generated responses. It provides an idea to develop the second generation of Bennie and the Chats. As the epidemic slows, it can become an assisting tool for students as additional exercise. In this work, we present the second generation of Bennie and the Chats with ChatGPT, which provides room for flexible and expandable improvement. Methods The objective of this research is to examine the influence of the newly proposed chatbot on learning efficacy and experiences in bedside teaching, and its potential contributions to international teaching collaboration. This study employs a mixed-method design that incorporates both quantitative and qualitative approaches. From the quantitative approach, we launched the world’s first cross-territory virtual bedside teaching with our proposed application and conducted a survey between the University of Hong Kong (HKU) and the National University of Singapore (NUS). Descriptive statistics and Spearman’s Correlation were applied for data analysis. From the qualitative approach, a comparative analysis was conducted between the two versions of the chatbot. And, we discuss the interrelationship between the quantitative and qualitative results. Results For the quantitative result, we collected a questionnaire from 45 students about the evaluation of virtual bedside teaching between territories. Over 75% of the students agreed that teaching can enhance learning effectiveness and experience. Moreover, by exchanging patients cases, 82.2% of students agreed that it helps to gain more experiences with diseases that may not be prevalent in their own locality. For the qualitative result, the new chatbot provides better usability and flexibility. Conclusion Virtual bedside teaching with chatbots has revolutionized conventional bedside teaching by its advantages and allowing international collaborations. We believe that the training of history taking skills by chatbot will be a feasible supplementary teaching tool to conventional bedside teaching.https://doi.org/10.1186/s12909-025-06785-9ChatGPTClinical educationSimulationsMobile learning
spellingShingle Kwan Yin Chan
Tsz Hon Yuen
Michael Co
Using ChatGPT for medical education: the technical perspective
BMC Medical Education
ChatGPT
Clinical education
Simulations
Mobile learning
title Using ChatGPT for medical education: the technical perspective
title_full Using ChatGPT for medical education: the technical perspective
title_fullStr Using ChatGPT for medical education: the technical perspective
title_full_unstemmed Using ChatGPT for medical education: the technical perspective
title_short Using ChatGPT for medical education: the technical perspective
title_sort using chatgpt for medical education the technical perspective
topic ChatGPT
Clinical education
Simulations
Mobile learning
url https://doi.org/10.1186/s12909-025-06785-9
work_keys_str_mv AT kwanyinchan usingchatgptformedicaleducationthetechnicalperspective
AT tszhonyuen usingchatgptformedicaleducationthetechnicalperspective
AT michaelco usingchatgptformedicaleducationthetechnicalperspective