We present VinAI Translate—a system that integrates state-of the-art deep learning technologies in speech and natural language processing to translate speech and text between Vietnamese and English. Experimental results show that our system obtains a state-of-the-art performance for each translation direction, and outperforms Google Translate in both automatic and human evaluations.