ISCA Archive DiaPro 1999
ISCA Archive DiaPro 1999

On the use of prosody in automatic dialogue understanding

Elmar Nöth, Anton Batliner, Volker Warnke, J. Haas, M. Boros, J. Buckow, R. Huber, F. Gallwitz, Matthias Nutt, Heinrich Niemann

In this paper, we show how prosodic information can be used in automatic dialogue systems and give some examples of promising new approaches. Most of these examples are taken from our own work in the VERBMOBIL speech-to-speech translation system and the EVAR train timetable dialogue system. In a ‘prosodic orbit’, we first present units, phenomena, annotations and statistical methods from the signal (acoustics) to the dialogue understanding phase. We show then, how prosody can be used together with other knowledge sources for the task of resegmentation and how an integrated approach leads to better results than a sequential use of the different knowledge sources; then we present a hybrid approach which is used to perform a shallow parsing and which uses prosody to guide the parsing; finally, we show how a critical system evaluation can help to improve the overall performance of automatic dialogue systems.

Cite as: Nöth, E., Batliner, A., Warnke, V., Haas, J., Boros, M., Buckow, J., Huber, R., Gallwitz, F., Nutt, M., Niemann, H. (1999) On the use of prosody in automatic dialogue understanding. Proc. ETRW on Dialogue and Prosody, 25-34

  author={Elmar Nöth and Anton Batliner and Volker Warnke and J. Haas and M. Boros and J. Buckow and R. Huber and F. Gallwitz and Matthias Nutt and Heinrich Niemann},
  title={{On the use of prosody in automatic dialogue understanding}},
  booktitle={Proc. ETRW on Dialogue and Prosody},