Physical education is the mainstream of physical education in general higher education institutions and is an important part of cultivating talents with comprehensive development. In this paper, to optimize the problem of video acquisition in physical education under multimedia, we adopt the tracking algorithm based on color information - CamShift algorithm to track the teacher’s target so that the teacher’s target is within the field of view of the camera to accomplish a better recording effect. Furthermore, for the problem that the CamShift algorithm is interfered with by class skin color, occlusion, and other problems that cause the algorithm to track incorrectly and the algorithm tracking is not robust, the optical flow tracking algorithm and Kalman filter method are combined to optimize the CamShift algorithm. Finally, a comparison is made between teaching with multimedia technology and previous teaching formats. The results show that three people in the test panel scored above 90 in the final assessment testing, while only one person in the comparison panel, 15 students (65.21%), scored between 85 and 90 in the experimental group, while 9 students (39.13%) scored between 85 and 90 in the control group. The grade point average of students’ theoretical knowledge in the experimental panel was 85.94, which exceeded the grade point average of 81.62 in the control group by 4.32 points; therefore, the optimized media recording effect based on the improved CamShift algorithm improved the teaching experience and the teaching quality of physical education by using multimedia teaching tools, and the research indexes achieved the expected results.