Development of a Computer Vision-Based Auto-Scroll Guitar Chord Application Using Motion Detection

M. Zikry Sahendra Chan; Qatrunnada Athirah Herdiyanto; Chelsea Febiola Sebayang; Debi Yandra Niska

doi:10.31294/reputasi.v7i1.12681

Authors

M. Zikry Sahendra Chan
Qatrunnada Athirah Herdiyanto
Chelsea Febiola Sebayang
Debi Yandra Niska

DOI:

https://doi.org/10.31294/reputasi.v7i1.12681

Keywords:

Computer Vision, Auto Scroll, Guitar Chords

Abstract

The development of computer vision technology enables the creation of a more natural human-computer interaction system through the use of body movements as a control medium. One of the problems often faced by users of digital guitar chord applications is the process of navigating the chord display which is still done manually so that it can interfere with guitar playing activities. This study aims to design and implement a computer vision-based AutoChord application that utilizes head movement detection as a control medium to automatically auto-scroll the guitar chord display. The research method used is the Waterfall software development method which includes the stages of system requirements analysis, system design, implementation, and system testing. The system was developed using webcam-based facial detection technology to read changes in the user's head orientation in real-time. The results of the study show that the AutoChord application is able to automatically run the chord display navigation function through the user's head movements so that it can increase the comfort and efficiency of user interaction when playing the guitar. Thus, the developed system can be an alternative solution in supporting guitar playing activities based on computer vision interaction

References

Anis, Y., Mukti, A. B., & Rosyid, A. N. (2023). Penerapan Model Waterfall Dalam Pengembangan Sistem Informasi Aset Destinasi Wisata Berbasis Website. KLIK: Kajian Ilmiah Informatika Dan Komputer, 4(2), 1134–1142. https://doi.org/10.30865/klik.v4i2.1287

Dwi Wijaya, Y., & Wardah Astuti, M. (2021). PENGUJIAN BLACKBOX SISTEM INFORMASI PENILAIAN KINERJA KARYAWAN PT INKA (PERSERO) BERBASIS EQUIVALENCE PARTITIONS BLACKBOX TESTING OF PT INKA (PERSERO) EMPLOYEE PERFORMANCE ASSESSMENT INFORMATION SYSTEM BASED ON EQUIVALENCE PARTITIONS. Jurnal Digital Teknologi Informasi, 4(1), 22–26. https://doi.org/https://doi.org/10.32502/digital.v4i1.3163

Huttunen, H., Chen, K., Thakur, A., Krohn-Grimberghe, A., Gencoglu, O., Ni, X., … Jacob Van Veen, H. (n.d.). Computer Vision for Head Pose Estimation: Review of a Competition. Retrieved from http://sites.google.com/TUT-head-pose/

Kapoor, A., & Picard, R. W. (2001). A Real-Time Head Nod and Shake Detector. Retrieved from http://www.almaden.ibm.com/cs/blueeyes

Lu, P., Zhang, M., Zhu, X., & Wang, Y. (2005). Head Nod and Shake Recognition Based on Multi-View Model and Hidden Markov Model. https://doi.org/10.1109/CGIV.2005.41

Marpaung, F., Aulia, F., Suryani SKom, N., & Cyra Nabila SKom, R. (n.d.). COMPUTER VISION DAN PENGOLAHAN CITRA DIGITAL. Retrieved from www.pustakaaksara.co.id

Mitra, S., & Acharya, T. (2007). Gesture recognition: A survey. IEEE Transactions on Systems, Man and Cybernetics Part C: Applications and Reviews, 37(3), 311–324. https://doi.org/10.1109/TSMCC.2007.893280

Pressman, R. S. (2010). Software Engineering: A Practitioner’s Approach. Retrieved from www.mhhe.com/pressman.

Ratnawati Djuwitaningrum, E., & Risqi Pangestu, D. (n.d.). Implementasi Mouse Virtual Berbasis Pengenalan Gerakan Tangan Menggunakan MediaPipe dan OpenCV (Implementation of a Virtual Mouse Based on Hand Gesture Recognition Using MediaPipe and OpenCV). Retrieved from https://mediapipe.readthedocs.io/en/latest/solutions/ha

Riza Mufita, A., & Utaminingrum, F. (2025). Deteksi Arah Pergerakan Kepala untuk Navigasi pada Kursi Roda Pintar Menggunakan Kombinasi Metode Berbasis YOLOv8N (Vol. 9). Retrieved from http://j-ptiik.ub.ac.id

Saeed, A., Al-Hamadi, A., & Ghoneim, A. (2015). Head pose estimation on top of haar-like face detection: A study using the Kinect sensor. Sensors (Switzerland), 15(9), 20945–20966. https://doi.org/10.3390/s150920945

Saragih, S. (2025). Implementasi Algoritma Haar Cascade Menggunakan Pengolahan Citra Digital untuk Absensi Deteksi Wajah dan Nama Menggunakan Python. Jurnal Sosial Dan Teknologi (SOSTECH), 5(3). https://doi.org/https://doi.org/10.59188/jurnalsostech.v5i3.32044

Sri Rahayu, Y., Saputra, Y., & Irawan, D. (2024). IMPLEMENTASI METODE WATERFALL PADA PENGEMBANGAN SISTEM INFORMASI MOBILE E-DISARPUS. In Jurnal Sistem Informasi (Vol. 6). https://doi.org/https://doi.org/10.31849/zn.v6i2.20538

Vélez Vásquez, M. A., Baelemans, M., Driedger, J., Zuidema, W., & Burgoyne, J. A. (n.d.). QUANTIFYING THE EASE OF PLAYING SONG CHORDS ON THE GUITAR. Retrieved from https://github.com/Marcel-Velez/playability-

Voulodimos, A., Doulamis, N., Doulamis, A., & Protopapadakis, E. (2018). Deep Learning for Computer Vision: A Brief Review. Computational Intelligence and Neuroscience, Vol. 2018. Hindawi Limited. https://doi.org/10.1155/2018/7068349

Wahid, A. A. (2020). Analisis Metode Waterfall Untuk Pengembangan Sistem Informasi. Jurnal Ilmu-Ilmu Informatika Dan Manajemen STMIK. Retrieved from https://www.researchgate.net/profile/Aceng-Wahid/publication/346397070_Analisis_Metode_Waterfall_Untuk_Pengembangan_Sistem_Informasi/links/5fbfa91092851c933f5d76b6/Analisis-Metode-Waterfall-Untuk-Pengembangan-Sistem-Informasi.pdf

Zabulis, X., Baltzakis, H., & Argyros, A. (n.d.). Vision-based Hand Gesture Recognition for Human-Computer Interaction. https://doi.org/10.1201/9781420064995-c34