International Journal For Multidisciplinary Research

E-ISSN: 2582-2160     Impact Factor: 9.24

A Widely Indexed Open Access Peer Reviewed Multidisciplinary Bi-monthly Scholarly International Journal

Call for Paper Volume 8, Issue 3 (May-June 2026) Submit your research before last 3 days of June to publish your research paper in the issue of May-June.

Virtual Mouse: an Ai-based Multimodal Human-computer Interaction System

Author(s) Mr. MANJUNATHA G, Ms. NANDITHA G P, Mr. NISHANT NISHANT, Mr. SOURABH PATIL, Ms. SUPRITHA G C
Country India
Abstract As a logical progression of human-computer interaction (HCI), touchless interface development has become increasingly popular. The Virtual Mouse, an AI-based multimodal interaction system that combines voice and hand gesture recognition to operate a computer without the need for physical input devices, is presented in this paper. Accessibility, hygiene, and usability are improved in a range of contexts, including education, healthcare, and assistive technologies, by utilizing computer vision and deep learning for real-time gesture tracking and speech-to-command processing. According to experimental results, physical strain is reduced by almost 78% and operational efficiency is increased by over 160%. The architecture, algorithms, outcomes, and potential ramifications of AI-driven multimodal HCI systems are covered in the paper.: Patient, Doctor, and Staff. This setup ensures smooth real-time collaboration, quicker clinical decisions, and improved hospital coordination. It will exhibit low latency, high accuracy, and user-friendly interaction, making it quite feasible for application in sterile environments, public kiosks, and for people with physical limitations. In healthcare settings, the Virtual Mouse can facilitate touch-free operation of medical systems, ensuring sterility and minimizing the risk of contamination. For example, within hospital environments, the system supports real-time collaboration among patients, doctors, and staff, enabling quicker clinical decision-making and smoother coordination without the need for direct contact with shared devices. Similarly, in educational contexts, it can empower instructors and students to engage in more dynamic, interactive learning experiences. Moreover, individuals with physical limitations can benefit from enhanced accessibility, as the system offers an intuitive alternative to traditional input interfaces. Overall, the Virtual Mouse exemplifies the next generation of touchless AI interfaces, combining the precision of computer vision with the natural intuitiveness of speech and gesture control. Its deployment across sectors underscores its potential to create smarter, safer, and more inclusive digital environments, paving the way for future innovations in multimodal HCI.
Keywords Virtual Mouse, Gesture Recognition, Computer Vision, Human-Computer Interaction, Image Processing, Hand Tracking, Machine Learning, OpenCV, Cursor Control, Real-Time System, Touchless Interface, AI-Based Mouse Control, Human-Machine Interface, Intelligent User Interface.
Field Engineering
Published In Volume 7, Issue 6, November-December 2025
Published On 2025-12-05
DOI https://doi.org/10.36948/ijfmr.2025.v07i06.62599

Share this