This paper presents methods for adapting models in a data fusionbased speaker verification system. The models that are used in the data fusion system are the neural tree network (NTN), dynamic time warping (DTW), and hidden Markov model (HMM). The models provide information based on discriminant information, distortion measurements, and probabilistic evaluation, respectively. The parameters of these models are updated during the adaptation process using verification data. This allows the models to track changes in the users voice over time and additionally allows the technology to supplement the typically limited data obtained at enrollment. Experiments are performed on voice data collected within landline telephony, wireless telephony, and multimedia environments. Additionally, the adaptation algorithms are evaluated for both cases where the data is known to come from the correct user (supervised) and not known to come from the correct user (unsupervised). For the case where the adaptation data is not known to come from the correct user, threshold criteria is used for determining if the adaptation should occur or not. The adaptation leads to a 20% relative reduction on the equal error rate for the unsupervised scenario and a 40% relative reduction in equal error rate for the supervised scenario.