Annotation of speech waveforms with phonemic labels and markers defining the position of the labels within the wave-form is desirable for many purposes. In this paper we propose a method for automatic label alignment which can ease the task. The algorithm contists of two stages. The first stage segment the speech waveform into segments which contain acoustically similar speech frames. The second stage use the acoustic segment boundaries as anchor points in a phoneme based HMM type segmentation.