ISCA Archive IDS 2002
ISCA Archive IDS 2002

Constraint manipulation and visualization in a multimodal dialogue system

Joakim Gustafson, Linda Bell, Johan Boye, Jens Edlund, Mats Wirén

When interacting with spoken and multimodal dialogue systems, it is often difficult for users to understand and influence how their input is processed by the system. In this paper, we describe how these problems were addressed in the multimodal real-estate dialogue system AdApt. During the course of a dialogue, the user's contraints are translated into symbolic icons that are visualized on the screen and can be manipulated by drag-and-drop operations. Users are thus given a clear picture of how their utterances are understood, and are given a transparent means of controlling the interaction with the system.


Cite as: Gustafson, J., Bell, L., Boye, J., Edlund, J., Wirén, M. (2002) Constraint manipulation and visualization in a multimodal dialogue system. Proc. Multi-Modal Dialogue in Mobile Environments, paper 15

@inproceedings{gustafson02_ids,
  author={Joakim Gustafson and Linda Bell and Johan Boye and Jens Edlund and Mats Wirén},
  title={{Constraint manipulation and visualization in a multimodal dialogue system}},
  year=2002,
  booktitle={Proc. Multi-Modal Dialogue in Mobile Environments},
  pages={paper 15}
}