- P-ISSN 1010-0695
- E-ISSN 2288-3339
- Log In/Sign Up
- P-ISSN1010-0695
- E-ISSN2288-3339
Article Detail
Home > Article Detail
Pilot Development of a 'Clinical Performance Examination (CPX) Practicing Chatbot' Utilizing Prompt Engineering
Journal of Korean Medicine / Journal of Korean Medicine, (P)1010-0695; (E)2288-3339
2024, v.45 no.1, pp.200-212
&
(2024). Pilot Development of a 'Clinical Performance Examination (CPX) Practicing Chatbot' Utilizing Prompt Engineering. Journal of Korean Medicine, 45(1), 200-212.
- Downloaded
- Viewed
Abstract
Objectives: In the context of competency-based education emphasized in Korean Medicine, this study aimed to develop a pilot version of a CPX (Clinical Performance Examination) Practicing Chatbot utilizing large language models with prompt engineering. Methods: A standardized patient scenario was acquired from the National Institute of Korean Medicine and transformed into text format. Prompt engineering was then conducted using role prompting and few-shot prompting techniques. The GPT-4 API was employed, and a web application was created using the gradio package. An internal evaluation criterion was established for the quantitative assessment of the chatbot's performance. Results: The chatbot was implemented and evaluated based on the internal evaluation criterion. It demonstrated relatively high correctness and compliance. However, there is a need for improvement in confidentiality and naturalness. Conclusions: This study successfully piloted the CPX Practicing Chatbot, revealing the potential for developing educational models using AI technology in the field of Korean Medicine. Additionally, it identified limitations and provided insights for future developmental directions.
- keywords
- CPX(Clinical Performance Examination), AI(Artificial Intelligence), LLM(Large language model), Chatbot, Medical Education
- Downloaded
- Viewed
- 0KCI Citations
- 0WOS Citations
Other articles from this issue
- Multifaceted validity analysis of clinical skills test in the educational field setting
- Sharing Experiences in Selecting Clinical Outcome and Approving Validated Questionnaires : Insights from an Elderly Registry Study
- The Effect of Laser Therapy for Stroke Patients : A Systematic Review and Meta-analysis
- Gamitaeeumjowee-tang for Weight Loss in Post-Menopausal Obese Women:A Retrospective Chart Review
- Review on Weight Loss Interventions that Can Prevent Muscle Mass Loss in Sarcopenic Obesity
- Questionnaire Survey on Perception and Attitude Toward of Remote Treatment by Korean Medicine Doctors
- Network pharmacology-based prediction of efficacy and mechanism of Myrrha acting on Allergic Rhinitis
- Association of Cold/Heat Sensation with Sleep Quality and Insomnia in Middle-aged Women
- The Potential of Yangdorak Diagnosis Application of Gallstone
- The Analysis of relation to brain iron deposition of Parkinson’s Disease using Quantitative Susceptibility Mapping
- Status of reports of adverse events related to botanical herbal medicines with toxic precautions officially managed by Korean government: A descriptive analysis from WHO VigiAccess
- Current Status of Informed Consent Form for Acupotomy in Korean Medicine Hospitals and Development of a Standard Informed Consent Form Using Delphi Method
- Pilot Development of a 'Clinical Performance Examination (CPX) Practicing Chatbot' Utilizing Prompt Engineering
- A Case of Chronic Nummular Dermatitis Improved by Hwangryunagyo-tang
- Chuna therapy include Space Spinal Conduction Exercise and Manipulation Treatment for Functional dyspepsia patients: A case report
- A Case of Presbystasis Patient Improved after Korean Medicine Treatment -Focusing on Taking Gamiboik-tang and Body Balance Test
- Korean Medicine Treatment Accompaning Myofascial Trigger-Point Accupuncture for Lower Urinary Tract Symptoms after Radical Prostatectomy : A Case Report
- The short-term effect of Blood Pressure Reduction after Biofeedback in Malignant Hypertension: A case report
- Current Status and Sustainable Development Strategies of Traditional Korean Medicine Official Development Assistance (ODA) in Global Health
- more
Recommanded Articles
This website recommended the use the Chrome browser for journal website.