Implementation of Hand and Speech based Interaction with Mobile Phone

Abstract

With the ever increasing role of computers in society, Human Mobile Interaction (HMI) has become an increasingly important part of our daily lives.In the recent years new methods of Human Mobile Interaction are being developed. It uses various types of modes for interaction with machines through hand gesture, head, facial expressions, speech, and touch and there are still various current topic of research. Relying on one of them reduces the accuracy of the whole Human Mobile Interaction and is also limiting the options available to users. In proposed system, we uses the fusion of two types of modalities hand gesture and speech. For hand gesture recognition we use Artificial Neural Network (ANN) technique & for speech recognition we use Google search by voice and android SDK. The objective of this system is to use two of the important modes of interaction: hand and speech to control some mobile application.
DOI: 10.17762/ijritcc2321-8169.150819