Applied Mathematics and Nonlinear Sciences
Journal license

Journal

Applied Mathematics and Nonlinear Sciences


Volume
& Issue

Volume 9, Issue 1


Published
on

October 9, 2024


Pages


DOI

Article

Plot Dynamic Adaptation and Character Interaction Design of Artificial Intelligence in Musical Theater Performing Arts


Authors

Yingyueyuan Wang Affiliation:
The Central Academy of Drama, Beijing, 102209, China.


Abstract

In recent years, artificial intelligence technology has received widespread attention in the field of artistic creation. This paper proposes the use of intelligent software to create a musical work that matches the emotions of the audience when they watch a musical performance so as to mobilize the development of the musical plot and to involve the virtual digital man in the performance of the musical to increase the interactivity of the characters. Both the music automatic generation software and the application of the virtual digital person need to match the rhythm of the performance. Accordingly, this paper proposes a multimodal emotion recognition model based on deep learning, which is applied to recognize the audience’s emotions in real time to create music that matches the plot development and reasonable role interaction. Through simulation experiments, the average recognition rate of multimodal based on decision layer fusion is 84.8%, which is slightly higher than the average recognition rate based on feature fusion and much higher than the average recognition rate of single-modal speech emotion (67.5%) and face expression (78.5%). 76% and 73% of the audience members liked the “music” and “character” elements of the musical performance with AI technology, and 62% of the audience members expressed their desire to watch it again.


Keywords

Artificial intelligence, Virtual digital human, Emotion recognition model, Automatic music generation, 68P30


Citation

Wang, Y. (2024). Plot dynamic adaptation and character interaction design of artificial intelligence in musical theater performing arts. Applied Mathematics and Nonlinear Sciences, 9(1). https://doi.org/10.2478/amns-2024-2888

Published by: Engineering Journals

Engineering Journals Logo