We have developed a multimodal speech behavior corpus in order to clarify fundamental features of speech interaction. We focused on child development because children’s thinking tends to be expressed in their behavior. Utilizing the corpus, we analyzed child development of situation understanding skills focused on ”attention-catching” that has a role as a signal when communicating with other people. We formulated a hypothesis of the mental developmental process based on physical expression skills. The results of the multimodal analysis show that our method is an effective way of in-depth analysis of thinking process in ”attention-catching” behavior.
Index Terms: multimodal analysis, speech behavior corpus, child development, attention-catching