Virtual reality is an artificial environment generated by computer technology, which users can experience and interact with through visual, auditory, tactile and other sensory channels. This paper focuses on the key concept of virtual learning, develops the research of human-computer interaction technology in virtual reality from the three sensory dimensions of vision, hearing and touch, and applies it to music education in colleges and universities, and finally builds and completes the design of virtual learning environment for music education in colleges and universities. With the help of visual perception, motion control and other human-computer interaction modes, the human-computer interaction scenarios such as three-dimensional roaming, virtual simulation and classroom quiz were designed and realized in PyCharm and other software platforms, and the three-dimensional scenarios were reproduced in the process of traditional music teaching, which verified the system’s immersive performance and interactive performance. The results of the study show that the overall design framework of the virtual learning scenario can effectively promote the formation of the learner’s experience, and the scenario design and development can be based on this framework. At the same time, the design of virtual learning scenarios can also follow a certain process, which provides some experience for the design and development of subsequent virtual learning scenarios that promote the formation of experience.