Abstract

Objectives: This study aims to evaluate the clinical validity of the system by conducting a clinical study to assess the diagnostic agreement between the system and Korean medical doctors. Methods: This study was conducted from September 7, 2023, to December 7, 2023, across five Korean medicine institutions, involving 100 adult participants aged 20-64 who consented to participate. Participants first entered their symptoms into a web-based program, which utilized an AI-based algorithm to diagnose 36 types of pattern differentiation. Subsequently, Korean medical doctors conducted face-to-face diagnoses using the same 36 types. The diagnostic agreement between the system and the doctors’ diagnoses was analyzed using descriptive statistical analysis, and the results were expressed as a percentage agreement. Results: Analysis of the diagnostic data from 100 participants revealed that the web-based diagnosis support system identified an average of 7.76±0.79 patterns per patient, while Korean medical doctors identified an average of 7.99±0.10 patterns per patient. The diagnostic agreement between the system and the doctors showed an average of 7.08±1.08 patterns per patient, with an overall diagnostic agreement rate of 88.57±13.31%. Conclusion: This study developed a web-based diagnosis support system for traditional Korean medicine and evaluated its clinical validity by assessing diagnostic agreement. Comparing the diagnoses of the system with those of Korean medical doctors for 100 patients, the system showed an approximately 89% agreement rate with the clinical diagnoses. The system holds potential for aiding Korean medical doctors in pattern differentiation diagnosis in clinical practice.