Voice Guided, Gesture Controlled Virtual Mouse

Abstract

The mouse is a prime example of HCI advancement. Although the modern wireless mouse or Bluetooth mouse still requires peripherals like energy cells and cards to connect to the computer, it is not entirely peripheral- free. The suggested AI virtual mouse system addresses the aforementioned issues by capturing hand motions with an external or digital camera, then improving the system's accuracy using voice assistants and hand point detection through object recognition. The system's foundation consists of machine learning techniques. To operate a computer, navigate, and execute actions like left- and right-clicking, digital hand motion can be used instead of a physical mouse. The program employs machine learning for hand identification and Python modules, for voice assistance. The suggested approach eliminates the need for human involvement and computer- controlled equipment in the battle against the spread of COVID-19 by implementing fundamental mouse operations together with brightness, volume control, and the ability to manage noise variations.