ACOMS+ 및 학술지 리포지터리 설명회

  • 한국과학기술정보연구원(KISTI) 서울분원 대회의실(별관 3층)
  • 2024년 07월 03일(수) 13:30
 

논문 상세

Home > 논문 상세
  • P-ISSN 1010-0695
  • E-ISSN 2288-3339

프롬프트 엔지니어링(Prompt Engineering)을 활용한‘진료수행시험 연습용 챗봇(CPX Practicing Chatbot)’ 시범 개발

Pilot Development of a 'Clinical Performance Examination (CPX) Practicing Chatbot' Utilizing Prompt Engineering

대한한의학회지 / Journal of Korean Medicine, (P)1010-0695; (E)2288-3339
2024, v.45 no.1, pp.200-212
김준동 (가천대학교)
이혜윤 (부산대학교)
김지환 (가천대학교)
김창업 (가천대학교)
  • 다운로드 수
  • 조회수

Abstract

Objectives: In the context of competency-based education emphasized in Korean Medicine, this study aimed to develop a pilot version of a CPX (Clinical Performance Examination) Practicing Chatbot utilizing large language models with prompt engineering. Methods: A standardized patient scenario was acquired from the National Institute of Korean Medicine and transformed into text format. Prompt engineering was then conducted using role prompting and few-shot prompting techniques. The GPT-4 API was employed, and a web application was created using the gradio package. An internal evaluation criterion was established for the quantitative assessment of the chatbot's performance. Results: The chatbot was implemented and evaluated based on the internal evaluation criterion. It demonstrated relatively high correctness and compliance. However, there is a need for improvement in confidentiality and naturalness. Conclusions: This study successfully piloted the CPX Practicing Chatbot, revealing the potential for developing educational models using AI technology in the field of Korean Medicine. Additionally, it identified limitations and provided insights for future developmental directions.

keywords
CPX(Clinical Performance Examination), AI(Artificial Intelligence), LLM(Large language model), Chatbot, Medical Education


  • 다운로드 수
  • 조회수
  • 0KCI 피인용수
  • 0WOS 피인용수

권호 내 다른 논문

추천 논문

상단으로 이동

대한한의학회지