ISCA Archive Interspeech 2006
ISCA Archive Interspeech 2006

Multi-modal system ICANDO: intellectual computer assistant for disabled operators

Alexey Karpov, Andrey Ronzhin, Alexandre Cadiou

The paper describes a multi-modal system ICANDO (an Intellectual Computer AssistaNt for Disabled Operators) developed by Speech Informatics Group of SPIIRAS and intended for assistance to the persons without hands or with disabilities of their hands or arms in human-computer interaction. This system combines the modules for automatic speech recognition and head tracking in one multi-modal system. The developed system was applied for hands-free work with Graphical User Interface of MS Windows in such tasks as Internet communication and work with text documents. The architecture of the system, the methods for recognition and tracking, information fusion and synchronization, experimental conditions and the obtained results are described in the paper.