This talk presents our research work on three transfer learning approaches Including domain-specific LM pre-training with vocabulary extension, QA model Pre-training with synthetic examples, and QA model pre-training with labeled data augmentation. These approaches are applied incrementally on the Roberta large LM and adapt it to the TechQA task in technical support domain. Substantial improvements of QA performance are observed from leaderboard testing result.