Current ASR systems have to limit its vocabulary size depending on available memory size, expected processing time, and available text data for building a vocabulary and a language model. Although vocabularies of ASR systems are designed to achieve high coverage for expected input data, it can not be avoided that input data includes out-of-vocabulary (OOV) words that is OOV problem. In this paper, we propose dynamic vocabulary expansion using conceptual base and multi-pass speech recognition using the expanded vocabulary. Relevant words to content of input speech are extracted based on a speech recognition result obtained using a reference vocabulary. An expanded vocabulary that includes less OOV words is built by adding the extracted words to the reference vocabulary. The second recognition process is performed using the new vocabulary. The experimental results for broadcast news speech show the proposed method achieves 30% reduction of OOV rate and improve speech recognition accuracy.