In this paper, a developing voice-mail system is described which extracts keywords from continuously spoken mail. In this keyword extraction, a bottom-up approach to hypothesize the keywords and a top-down approach to verify them are integrated. First, a phoneme sequence is recognized in bottom-up mode, then keywords are hypothesized on the phoneme sequence. Finally, keyword candidates are verified by recognizing the consonants in a top-down manner.