The quality assurance system of physical education teaching in colleges and universities can, to a certain extent, quantify the quality of teaching conditions and management, and guarantee the scientific and innovative physical education teaching in major universities and colleges. This paper is based on the ADDIE model to design an information technology-driven physical education teaching innovation model, and establishes a physical education teaching innovation guarantee system from the five aspects of goals, inputs, processes, effects and mechanisms, and also constructs a QFD-based quality house assessment model for teaching quality measurement and evaluation. In the process of analysis, it was found that the proportion of cultivation plan, teaching implementation, and teaching assessment was 28.71%, 34.04%, and 37.23% respectively. The training program 28.71%, teaching implementation 34.04% and teaching assessment 37.23%, and the top four graduation design 13.07%, practical teaching 12.67%, student achievement 12.67%, and social practice 11.49% are all student-oriented projects with a proportion of 49.9%, which is the key to strengthen the cultivation of students’ practical ability related to the work of meeting the customer’s needs and obtaining a competitive advantage. The key to satisfying customer needs and gaining competitive advantage.