In this paper, we propose a system which can associate person names to individual speaker section. For this purpose, the automatic speaker segmentation is carried out utilizing online speaker modeling and speaker verification techniques. Key phrases and person names are also extracted by speech recognition. After this speaker segmentation and speech recognition, the person name is associated to the corresponding speaker sections based on simple rules. This method can be expanded to video clip retrieval by a query specifying both of a person name and topic contents.