Applied Mathematics and Nonlinear Sciences
Journal license

Journal

Applied Mathematics and Nonlinear Sciences


Volume
& Issue

Volume 9, Issue 1


Published
on

January 31, 2024


Pages


DOI

Article

A Study on Recognizing and Communicating Metaphors in Picture Book Creation in the Digital Age

Check for updates


Authors

Jia Xie Affiliation:
School of Fine Arts, Sichuan University of Science and Engineering, Zigong, Sichuan, 643000, China.


Abstract

Picture book creation has a rich metaphorical connotation, which is becoming more and more popular along with the development of digitalization. In this paper, the textual metaphors of picture book creation are extracted by combining the textual feature extraction model of the BERT pre-training model and HAN network, the ResNet50 network extracts the illustration metaphors of picture book creation, and the extracted metaphorical features are multimodal fused and recognized with the help of fully connected layer. In addition, a picture book metaphor dataset was constructed, and after analyzing the basic features of picture book metaphors, the effect of the constructed multimodal metaphor recognition was explored, and the recognition and communication of metaphors in picture book creation was studied. The results showed that the recognition accuracy in picture book creation ranged from 0.67 to 0.77, and the high degree of metaphor recognition in picture book creation showed a positive correlation with the average response time of communication, with the regression equation RT=138.45*IdentificationStd+1045.The results of the analysis of the metaphorical picture book creation pictures with textual references showed that the degree of communication comprehension (M=22.38. Std.=3.68), communication liking (M=94.86, Std.=13.58) and reaction time (M=82.44s, Std.=14.15s). Picture books facilitate better interactive communication through their metaphorical expression.


Keywords

BERT pretrained model, HAN network, ResNet50 network, Multimodal fusion, Metaphor recognition, Picture book creation, 93C62


Citation

Xie, J. (2024). A study on recognizing and communicating metaphors in picture book creation in the digital age. Applied Mathematics and Nonlinear Sciences, 9(1). https://doi.org/10.2478/amns-2024-0060

Published by: Engineering Journals

Engineering Journals Logo