Applied Mathematics and Nonlinear Sciences
Journal license

Journal

Applied Mathematics and Nonlinear Sciences


Volume
& Issue

Volume 8, Issue 2


Published
on

December 11, 2023


Pages


DOI

Article

Application of Deep Neural Network and Human-Computer Interaction Technology Based on Multimodal Perception in Art Design

Check for updates


Authors

Yi Tang Affiliation:
School of Arts and Design Department, Communication University of China, Nanjing, Nanjing, Jiangsu, 211112, China.
, Congyao Xu Affiliation:
School of Arts and Design Department, Communication University of China, Nanjing, Nanjing, Jiangsu, 211112, China.
, Fei Xu Affiliation:
School of Arts and Design Department, Communication University of China, Nanjing, Nanjing, Jiangsu, 211112, China.
, Liang Xie Affiliation:
School of Arts and Design Department, Communication University of China, Nanjing, Nanjing, Jiangsu, 211112, China.
, Chutan Zheng Affiliation:
School of Arts and Design Department, Communication University of China, Nanjing, Nanjing, Jiangsu, 211112, China.
, Zhongfei Han Affiliation:
School of Arts and Design Department, Communication University of China, Nanjing, Nanjing, Jiangsu, 211112, China.
and Yifan Xue Affiliation:
School of Arts and Design Department, Communication University of China, Nanjing, Nanjing, Jiangsu, 211112, China.


Abstract

The essence of art design is the process of emotional interaction with humans. In this paper, emotions are classified using multimodal fusion features, and abstract fusion features are obtained by sampling the multimodal matching tensor using average pooling. The matching fusion matrix in the tensor operator is used to convert from two-modal to multi-modal matching. Virtual interaction model in art design controls the design objectives, and the optimized virtual world is constructed by using virtual reality technology, so as to build an immersive art design model. Finally, a study was conducted to examine the impact of the use of emotion perception and interaction technology in art product design with students from the School of Design and Art, University of G. The results show that the liking degree of three-color matching in the cognitive experiment test is 0.307, which is higher than the liking degree of two-color matching of 0.223, indicating that overall three-color matching samples are more popular in art design. This study provides effective evaluation and guidance for designing art products that are emotional and innovative.


Keywords

Multimodal fusion, Matching tensor, Matching fusion matrix, Virtual interaction, Art design, 00A66


Citation

Tang, Y., Xu, C., Xu, F., Xie, L., Zheng, C., Han, Z., & Xue, Y. (2023). Application of deep neural network and human-computer interaction technology based on multimodal perception in art design. Applied Mathematics and Nonlinear Sciences, 8(2). https://doi.org/10.2478/amns.2023.2.01447
2 Total citations
1.26 FWCI
2 Recent citations
(2 years)
7 References
Open Access Yes
View full metrics

Published by: Engineering Journals

Engineering Journals Logo