In this paper, we discuss what kinds of linguistic knowledge are important and how they contribute to improvement of speech recognition accuracy by analyzing the actual results from a Japanese speech recognition experiment. Linguistic knowledge is categorized into four groups: syntax, semantics, pragmatics and contextual information. Through analysis, qualitative and quantitative evaluation of their abilities are made.