A Real-Time Hand Gesture Recognition System for Elderly Care Using MediaPipe and Line Application

Article Sidebar

pdf
Published: Jun 9, 2025
Keywords:
hand gesture, elderly, MediaPipe

Main Article Content

Ponwana Rattanachuchok
Department of Computer, Faculty of Science and Technology, Chiang Mai Rajabhat University
Chulawalee Maneelert
Department of Computer, Faculty of Science and Technology, Chiang Mai Rajabhat University

Abstract

This research presented a real-time hand gesture recognition system for elderly care using MediaPipe and the LINE application. The primary objective was to develop a prototype of a real-time hand gesture recognition system for elderly care using MediaPipe and the LINE application. When predefined hand gestures were detected, the system sent notification alerts to users via the LINE application. The prototype development was divided into two main components: hardware, consisting of a Raspberry Pi 5 and a Raspberry Pi Camera Module 3; and software, featuring a gesture detection notification system integrated with LINE. The innovation effectively identified three specific gestures used for requesting assistance and delivered alerts via the LINE application. Accuracy measurements for the system showed that Gesture 1 ("love") achieved 93%, Gesture 2 ("pointing up") reached 98.5%, and Gesture 3 ("victory") attained 99.5%. This innovation demonstrated its potential applicability in assisting elderly individuals by enabling them to communicate with caregivers using simple hand signals.

Article Details

How to Cite
Rattanachuchok, P., & Maneelert, C. (2025). A Real-Time Hand Gesture Recognition System for Elderly Care Using MediaPipe and Line Application. PKRU SciTech Journal, 9(1), 37–51. retrieved from https://ph01.tci-thaijo.org/index.php/pkruscitech/article/view/260375
Issue
Vol. 9 No. 1 (2025): January - June
Section
Research Articles
Creative Commons License

This work is licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License.

  1. The original content that appears in this journal is the responsibility of the author excluding any typographical errors.
  2. The copyright of manuscripts that published in PKRU SciTech Journal is owned by PKRU SciTech Journal.

References

(1) กรมกิจการผู้สูงอายุ. (2564). สังคมผู้สูงอายุในปัจจุบันและเศรษฐกิจในประเทศไทย. [ออนไลน์], สืบค้นจาก https://www.dop.go.th/th/know/15/926 (25 พฤศจิกายน 2567).

(2) มูลนิธิสถาบันวิจัยและพัฒนาผู้สูงอายุไทย. (2566). รายงานสถานการณ์ผู้สูงอายุไทย พ.ศ. 2565. [ออนไลน์], สืบค้นจาก https://thaitgri.org/?wpdmpro=รายงานสถานการณ์ประจำปี (25 พฤศจิกายน 2567).

(3) Veluri, R. K., Sree, S. R., Vanathi, A., Aparna, G., & Vaidya, S. P. (2022). Hand gesture mapping using MediaPipe algorithm. In Proceedings of the Third International Conference on Communication, Computing and Electronics Systems, 597–614.

(4) Nguyen, T. T., Nguyen, N. C., Ngo, D. K., Phan, V. L., Pham, M. H. P., Nguyen, D. A., Doan, M. N., & Le, T. L. (2022). A continuous real-time hand gesture recognition method based on skeleton. In Proceedings of the 11th International Conference on Control, Automation and Information Sciences (ICCAIS), 273–278.

(5) Jo, B. J., Kim, S. K., & Kim, S. (2023). Enhancing virtual and augmented reality interactions with a MediaPipe-based hand gesture recognition user interface. International Information and Engineering Technology Association, 28(3), 633–638.

(6) Indriani, I., Harris, M., & Agoes, A. S. (2021). Applying hand gesture recognition for user guide application using MediaPipe. In Proceedings of the 2nd International Seminar of Science and Applied Technology (ISSAT), 101–108.

(7) Mahmoud, N. M., Fouad, H., & Soliman, A. M. (2021). Smart healthcare solutions using the internet of medical things for hand gesture recognition system. Complex & Intelligent Systems, 7(3), 1253–1264.

(8) Google for Developers. (2023). Hand landmarks detection guide. [ออนไลน์], สืบค้นจาก https://developers.google.com/mediapipe/solutions/vision/hand_landmarker (25 พฤศจิกายน 2567).

(9) Osipov, A., & Ostanin, M. (2021). Real-time static custom gestures recognition based on skeleton hand. In International Conference "Nonlinearity, Information and Robotics" (NIR), 1–4.

(10) Mahmood, N. T., Jabbar, M. S., & Abdalrazak, M. (2024). A real-time hand gesture recognition based on Media-Pipe and support vector machine. In F. Saeed, F. Mohammed, & Y. Fazea (eds.), Advances in intelligent computing techniques and applications, Lecture Notes on Data Engineering and Communications Technologies (pp. 263–273). Springer.

(11) Kim, J. W., Choi, J. Y., Ha, E. J., & Choi, J. H. (2023). Human pose estimation using MediaPipe pose and optimization method based on a humanoid model. Applied Sciences, 13(4), 1–21.

(12) Sundar, B., & Bagyammal, T. (2022). American sign language recognition for alphabets using MediaPipe and LSTM. Procedia Computer Science, 215, 642–651.

(13) Mallik, B., Rahim, M. A., Miah, A. S. M., Yun, K. S., & Shin, J. (2024). Virtual keyboard: A real-time hand gesture recognition-based character input system using LSTM and MediaPipe Holistic. Computer Systems Science and Engineering, 48(2), 555–570.

(14) Hernández-Del-Toro, T., Martínez-Santiago, F., & Montejo-Ráez, A. (2022). Chapter 7 - Assessing classifier's performance. In Torres-García, A. A., Reyes-García, C. A., Villaseñor-Pineda, L., & Mendoza-Montoya, O. (eds.), Biosignal processing and classification using computational learning and intelligence (pp. 131–149). Academic Press.

(15) ณัฐวดี หงส์บุญมี, และนันทวดี บุญสะอาด. (2566). ระบบวิเคราะห์สายพันธุ์อะโวคาโดด้วยเทคนิคการเรียนรู้เชิงลึกผ่านสมาร์ตโฟน. วารสารวิชาการซายน์เทค มรภ.ภูเก็ต, 7(1), 46–58.

(16) เอกรินทร์ แสงยอ, ศุภชัย รอดฤทธิ์, ภานุวัฒน์ เมฆะ, พยุงศักดิ์ เกษมสำราญ, และกิตติกร หาญตระกูล. (2568). การพัฒนาระบบสแกนใบหน้าในการบริหารงานทรัพยากรบุคคล : กรณีศึกษา บริษัท ดูดี อินดีด จำกัด. วารสารแม่โจ้เทคโนโลยีสารสนเทศและนวัตกรรม, 11(3), 54–82.

(17) Lindroth, H., Nalaie, K., Raghu, R., Ayala, I. N., Busch, C., Bhattacharyya, A., Moreno Franco, P., Diedrich, D. A., Pickering, B. W., & Herasevich, V. (2024). Applied artificial intelligence in healthcare: A review of computer vision technology application in hospital settings. Journal of Imaging, 10(4), 1–29.

(18) Rahul, A., Priyanka, S. S., Dappuri, B., Lakshmi, N. D., & Koneru, A. (2024). Hand gesture recognition for patient monitoring in the medical field: A deep convolution neural networks approach. In Proceedings of the 7th International Conference on Circuit Power and Computing Technologies (ICCPCT), 1533–1539.

(19) นโรตม์ นิลสุขุม, และวิยดา ยะไวทย์. (2567). ระบบการแจ้งเตือนการล้มอัจฉริยะเพื่อการระบุตัวตนและท่าทางการล้ม. วารสารวิทยาการสารสนเทศและเทคโนโลยีประยุกต์, 6(1), 65–83.

(20) Dhuzuki, N. H. M., Zainuddin, A. A., Zaman, N. A. S. K., Razmi, A. N. M. A., Kaitane, W. S., Puzi, A. A., Johar, M. N., Yazid, M., Nordin, N. A. M., Sidek, S. N., & Zaki, H. F. M. (2025). Design and implementation of a deep learning-based hand gesture recognition system for rehabilitation Internet-of-Things (RIoT) environments using MediaPipe. IIUM Engineering Journal, 26(1), 353–372.

(21) Sánchez-Brizuela, G., Cisnal, A., de la Fuente-López, E., Fraile, J., & Pérez-Turiel, J. (2023). Lightweight real-time hand segmentation leveraging MediaPipe landmark detection. Virtual Reality, 27, 3125–3132.