In this paper, we describe new hybrid combinations of neural networks with HMMs. These strategies, based on the inclusion of a probabilistic modelling of the ANN, make the hybrid system more independent from the neural network behavior. Using these methodologies, the hybrid system can now benefit from two distinct sources of improvement such as neural modelling and HMM modelling.