In this paper, we describe a new recognition system for 4-digit-strings in Japanese under fluent speech conditions. In particular, we introduce several methods to solve the problems related to the spontaneity of speech: discrimination of speech and background noise, out-of- vocabulary words, pauses between digits, etc. These methods led to an error rate reduction of 76%, compared to a simple start- and end-point detection based recognizer using non-refined models.