바로가기메뉴

본문 바로가기 주메뉴 바로가기

Performance Improvement of Facial Gesture-based User Interface Using MediaPipe Face Mesh

Journal of The Korea Internet of Things Society / Journal of The Korea Internet of Things Society, (P)2799-4791;
2023, v.9 no.6, pp.125-134
https://doi.org/https://doi.org/10.20465/kiots.2023.9.6.125
Jinwang Mok
Noyoon Kwak

Abstract

The purpose of this paper is to propose a method to improve the performance of the previous research is characterized by recognizing facial gestures from the 3D coordinates of seven landmarks selected from the MediaPipe Face Mesh model, generating corresponding user events, and executing corresponding commands. The proposed method applied adaptive moving average processing to the cursor positions in the process to stabilize the cursor by alleviating microtremor, and improved performance by blocking temporary opening/closing discrepancies between both eyes when opening and closing both eyes simultaneously. As a result of the usability evaluation of the proposed facial gesture interface, it was confirmed that the average recognition rate of facial gestures was increased to 98.7% compared to 95.8% in the previous research.

keywords
얼굴 제스처 인식, 양안 개폐

Journal of The Korea Internet of Things Society