Ethnic traditional sports are forms of physical activity unique to one or more ethnic groups. Effective evaluation of the teaching effectiveness of ethnic traditional sports helps to promote the development of ethnic sports and the transmission of ethnic traditional sports. Currently, the evaluation of ethnic traditional sports is mainly a scoring system, which evaluates students’ performance in ethnic traditional sports through teachers’ scoring, and this evaluation method is difficult to assess the teaching effectiveness of ethnic traditional sports accurately. In this paper, based on the video text generation technology, the 3D residual attention network model is constructed by introducing the attention mechanism into the 3D residual module in the video feature extraction through the encoding-decoding video text description framework and improving the traditional deep residual network for evaluating the teaching effect of ethnic sports. After experimental validation, it is shown that the 3D residual attention network model can more accurately describe the evaluation of ethnic traditional sports teaching effectiveness using natural language.