International Journal For Multidisciplinary Research

E-ISSN: 2582-2160   •   Impact Factor: 9.24

A Widely Indexed Open Access Peer Reviewed Multidisciplinary Bi-monthly Scholarly International Journal

Call for Paper Volume 8, Issue 3 (May-June 2026) Submit your research before last 3 days of June to publish your research paper in the issue of May-June.
Submit Research Paper Join as a Reviewer

Plagiarism is checked by the leading plagiarism checker TurnItIn

Call for Paper

Volume 8 Issue 3
May-June 2026

Submit your research paper

Indexing Partners
Academia Advanced Sciences Index Bielefeld Academic Search Engine CiteSeer DRJI Google Scholar Independent Search Engine & Directory Network ISI (International Scientific Indexing) Issuu Mendeley Research Networks
RefSeek ResearcherId - Thomson Reuters ResearchGate Scirus Scribd Semantic Scholar UTeM - Universiti Teknikal Malaysia Melaka Wiki for Call for Papers WorldCat Zenodo

Real-Time Gesture Recognition for Virtual Musical Instrument Control Using Binary Finger Encoding

Author(s) Megha Kuliha, Ujjwal Singh
Country India
Abstract This paper presents a real-time hand gesture recognition system for virtual musical instrument control, designed to make music creation more accessible, expressive, and cost-effective. Using a standard webcam and MediaPipe-based hand tracking, the system converts five-finger combinations into binary codes, allowing for 32 distinct gestures. These gestures can be freely mapped to piano notes or drum sounds through an interactive Streamlit interface. Pygame enables multi-channel audio playback, allowing for rapid, overlapping notes, while adaptive frame skipping maintains real-time responsiveness across devices. A key feature is the gesture customization system, which allows artists to define their own controls and download a personalized cheat sheet for reference. Unlike existing gesture- music systems that rely on specialized hardware, this approach requires only a webcam, making it highly portable and affordable. The system successfully supports performance of real melodies such as “Happy Birthday.” Future work includes dual- hand control for chords and melody, predefined gesture mappings, and deployment as a cloud-based, mobile-responsive platform. This solution represents a significant step toward democratizing digital music creation through low-cost, intuitive, and inclusive design.
Keywords Gesture recognition, binary encoding, real- time interaction, assistive music technology, human-computer interaction.
Field Engineering
Published In Volume 8, Issue 1, January-February 2026
Published On 2026-01-12
DOI https://doi.org/10.36948/ijfmr.2026.v08i01.66600
View / Download PDF File

Share this



E-ISSN 2582-2160
CrossRef

CrossRef DOI is assigned to each research paper published in our journal.

IJFMR DOI prefix is
10.36948/ijfmr

Downloads
Research Paper Format Copyright Permission Form and Undertaking Form Cover Page Vol 8 Isu 3Cover Page Vol 8 Isu 2Cover Page Vol 8 Isu 2

All research papers published on this website are licensed under Creative Commons Attribution-ShareAlike 4.0 International License, and all rights belong to their respective authors/researchers.

CC-BY-SA Open Access

About IJFMR
Fees & Payment
Current Issue
Publication Archive 		Submit Research Paper
Track Submission Status
Publication Guidelines
Publication Ethics
Peer Review & Plagiarism 		Join as a Reviewer
Editors & Reviewers
Reviewer Referral Program
Get Reviewer Membership Certi. 		Website/Journal Policies
Usage Policy
Content Policies
Privacy Policy
Contact Us +91-9687-828-838 editor@ijfmr.com
Powered by Sky Research Publication and Journals