Traditional source-filter model has obvious limitation for speech synthesis in pitch modification due to the lack of spectrum distortion processing. To solve the problem, the paper analyzes the spectrum features of voice source in various F0 ranges and timbres in detail, and generates Muliti-Source (MS) based on analysis results by classifying the voice source into different types. The model enhances the quality of speech synthesis in various speaking mood.