In this paper, we present our system submitted to the Spoofing Aware Speaker Verification Challenge (SASVC) 2022. Our submission focuses on bridging the gap between automatic speaker verification (ASV) and countermeasure (CM) systems. We introduce a general norm-constrained score-level ensemble method that can improve robustness to zero-effort impostors and spoofing attacks by jointly processing the scores extracted from the ASV and CM subsystems. Furthermore, we explore that the ensemble system can provide better performance when both ASV and CM subsystems are optimized. Experimental results show that our primary system yields 0.45% SV-EER, 0.26% SPF-EER, and 0.37% SASV-EER on the SASVC 2022 evaluation set. The relative improvements are 96.08%, 66.67%, and 94.19% over the best official baseline, respectively. All of our code and pre-trained model weights are publicly available and reproducible.