ISCA Archive Interspeech 2014
ISCA Archive Interspeech 2014

Grounding language models in spatiotemporal context

Brandon C. Roy, Soroush Vosoughi, Deb Roy

Natural language is rich and varied, but also highly structured. The rules of grammar are a primary source of linguistic regularity, but there are many other factors that govern patterns of language use. Language models attempt to capture linguistic regularities, typically by modeling the statistics of word use, thereby folding in some aspects of grammar and style. Spoken language is an important and interesting subset of natural language that is temporally and spatially grounded. While time and space may directly contribute to a speaker's choice of words, they may also serve as indicators for communicative intent or other contextual and situational factors. To investigate the value of spatial and temporal information, we build a series of language models using a large, naturalistic corpus of spatially and temporally coded speech collected from a home environment. We incorporate this extralinguistic information by building spatiotemporal word classifiers that are mixed with traditional unigram and bigram models. Our evaluation shows that both perplexity and word error rate can be significantly improved by incorporating this information in a simple framework. The underlying principles of this work could be applied in a wide range of scenarios in which temporal or spatial information is available.

doi: 10.21437/Interspeech.2014-562

Cite as: Roy, B.C., Vosoughi, S., Roy, D. (2014) Grounding language models in spatiotemporal context. Proc. Interspeech 2014, 2625-2629, doi: 10.21437/Interspeech.2014-562

  author={Brandon C. Roy and Soroush Vosoughi and Deb Roy},
  title={{Grounding language models in spatiotemporal context}},
  booktitle={Proc. Interspeech 2014},