We focus in this paper on the named entity recognition task in spoken data. The proposed approach investigates the use of various contexts of the words to improve recognition. Experimental results carried out on speech data from French broadcast news, using conditional random fields (CRF) show that the use of semantic information, generated using symbolic analyzer outperform the classical approach in reference transcriptions, and it is more robust in automatic speech recognition (ASR) output.