Methods for the evaluation of the efficiency and effectiveness of speech input / output systems are well established. However, user subjective reactions to speech interfaces may well be a more important predictor of real world success. A review of existing subjective measures of speech system usability reveals a number of limitations in the approaches taken. This paper then summarises the work we have conducted in developing a new measure for the subjective assessment of speech system interfaces (SASSI).