Emotion plays an important role in human mental life. It is a conscious mental experience reflecting the personal significance of internal and external events. Music is one of the oldest art forms for human beings to express their thoughts and feelings. And speech is another principal conveyer to express one’s emotion during human social communication. The ability to identify vocal expressions of emotion or attitude in speech is one of the basic cognitive functions of human beings. With the development of artificial intelligence and neurocomputing, Multi-channel EEG provides population measures of neurons that allow us to uncover the complex cognitive processes of emotional information integration and processing. In this talk, first, several novel signal processing methods for investigating the emotional cognitive process are introduced and the brain mechanisms of emotion perception in the music and speech are presented. Then, an enhanced model of emotion recognition inspired by the cognitive principles are shown.