AERO MOUSE: A Multi-Modal Touchless Human–Computer Interaction System

Alok Bhuyan; Mrunal Pathak; Kamlesh Bari; Om Hajare

AERO MOUSE: A Multi-Modal Touchless Human–Computer Interaction System

Author(s)	Mr. Alok Bhuyan, Prof. Dr. Mrunal Pathak, Mr. Kamlesh Bari, Mr. Om Hajare
Country	India
Abstract	Touchless human-computer interaction is a key areaof concern for both hygiene-sensitive environments and accessibil-ity technologies. However, current vision based systems are oftenlimited to a single modality which restricts their usability overa wide range of user conditions. The objective of this paper isto present AERO MOUSE: A multi-modal touchless interactionsystem that combines hand-gesture control, facial movementcontrol, and air-based signature input into a unified real-timeinteraction model. The system utilizes MediaPipe landmark- based computer vision technology, utilizing a consumer-gradewebcam, to convert user gestures and movements into mouseactions, as well as enabling users to transition seamlessly throughthe various modalities of the system and maintain consistencyin how they interact with it. The experimental evaluation of AERO MOUSE, conducted using standard computing hardware,demonstrated that the system maintains high levels of sustainedreal-time performance across all three modes of operation.Specifically, the experiments demonstrated that AERO MOUSEachieved an average frame rate greater than 22 fps, latency less than 100 ms, and successful gesture recognition rates greater than86 percent, and also demonstrated a high degree of accuracy (¿93%) in transitioning from one mode of operation to another.Additionally, the experiments demonstrated that the system wasable to operate at the same level of performance for extendedperiods of time (i.e., ¿ 30 minutes), with minimal degradation(3.2% FPS drift). Overall, these experimental results demonstratethat the multi-modal approach to touchless human-computerinteraction can achieve practical levels of responsiveness usingaccessible hardware. Further, by providing a means of supportinga wide variety of user capabilities and interaction scenarios,AERO MOUSE represents a foundation upon which researcherscan build adaptive and accessible human-computer interactionmodels.
Keywords	Touchless interaction, Multi-modal systems, Hand gesture recognition, Facial tracking, Computer vision, Accessibility, Human–computer interaction
Field	Computer > Artificial Intelligence / Simulation / Virtual Reality
Published In	Volume 8, Issue 3, May-June 2026
Published On	2026-05-30

View / Download PDF File

E-ISSN 2582-2160

doi

CrossRef DOI is assigned to each research paper published in our journal.

IJFMR DOI prefix is
10.36948/ijfmr

Downloads

Research Paper Format Copyright Permission Form and Undertaking Form Cover Page Vol 8 Isu 3 Cover Page Vol 8 Isu 2 Cover Page Vol 8 Isu 2

All research papers published on this website are licensed under Creative Commons Attribution-ShareAlike 4.0 International License, and all rights belong to their respective authors/researchers.

CC-BY-SA

About IJFMR Fees & Payment Current Issue Publication Archive	Submit Research Paper Track Submission Status Publication Guidelines Publication Ethics Peer Review & Plagiarism	Join as a Reviewer Editors & Reviewers Reviewer Referral Program Get Reviewer Membership Certi.	Website/Journal Policies Usage Policy Content Policies Privacy Policy

Contact Us		+91-9687-828-838	editor@ijfmr.com

International Journal For Multidisciplinary Research

A Widely Indexed Open Access Peer Reviewed Multidisciplinary Bi-monthly Scholarly International Journal

AERO MOUSE: A Multi-Modal Touchless Human–Computer Interaction System

Share this