This paper summarizes the main results from the Speaker Verification (SV) research pursued so far in the CAVE project. Different state-of the art SV algo- rithms were implemented in a common HMM frame- work and compared on two databases : YOHO (of fice environment speech) and SESP (telephone speech). This paper is concerned with the different design issues for LR-HMM-based SV algorithms which emerged from our investigations and which led to our current SV sys- tem, which delivers Equal Error Rates below 0.5 % on a very realistic telephone speech database.