ISCA Archive AVSP 2008
ISCA Archive AVSP 2008

Linguistically valid movement behavior measured non-invasively

Adriano V. Barbosa, Hani C. Yehia, Eric Vatikiotis-Bateson

We use optical flow to extract reliable kinematics from video for motions of the head, face, torso, and hands during speech and musical performance. Unlike dot- and marker- based measures, these markerless measures are non-invasive and require no a priori specification of measurement locations. Reliability is compared with marker tracking data and the methodÂ’s utility is demonstrated for data from Plains Cree, English, and Shona.