ISCA Archive Interspeech 2011
ISCA Archive Interspeech 2011

mtalk - a multimodal browser for mobile services

Michael Johnston, Giuseppe Di Fabbrizio, Simon Urbanek

The mTalk multimodal browser is a tool which enables rapid prototyping for research and development of mobile multimodal interfaces combining natural modalities such as speech, touch, and gesture. mTalk integrates a broad range of open standards for authoring graphical and spoken user interfaces and is supported by a cloud-based multimodal processing architecture. In this paper, we describe mTalk and illustrate its capabilities through examination of a series of sample applications.