This paper analyzes the status quo and existing problems of piano teaching in a college through the questionnaire method, and from the aspects of music education goals, piano syllabus and classroom evaluation, adopts the hierarchical analysis method to construct a realistic and targeted evaluation system of teaching effect of piano classroom teachers and learning effect of piano classroom students, so as to achieve the improvement of the teaching effect of the piano course in colleges and universities. The results show that piano teachers in college are generally younger, and most students have a favorite attitude towards piano and music. The evaluation of piano teachers’ teaching effect includes teaching attitude, teaching content, teaching methods and means, and teaching effect, which are expressed as percentages according to the importance of each index: 18%, 36%, 22%, and 24%, respectively. And the evaluation indexes of the students’ learning effect shall be the piano assessment results shall be: performance skills, emotional and affective experience, artistic practice ability, piano theory foundation and usual performance, with the weights of 28%, 35%, 20%, 8.5% and 8.5% respectively.