Applied Mathematics and Nonlinear Sciences
Journal license

Journal

Applied Mathematics and Nonlinear Sciences


Volume
& Issue

Volume 9, Issue 1


Published
on

November 27, 2024


Pages


DOI

Article

A Study of English Lexical Disambiguation Based on the Transformer Model

Check for updates


Authors

Yubing Wu Affiliation:
Zhengzhou Technology and Business University, Zhengzhou, Henan, 450000, China.


Abstract

Word sense disambiguation is a common problem in the field of English language processing. In this paper, we use the Transformer model and LSTM model to construct a fusion model for word sense disambiguation, which provides a method to solve the problem of low accuracy in English vocabulary disambiguation. This paper first introduces the construction of a Transformer-based context embedding model to achieve word sense disambiguation, which effectively captures semantic and sequential information in the context. On the basis of the Transformer lexical disambiguation model, the fusion model of lexical disambiguation is proposed by integrating the LSTM network, and the efficiency of lexical disambiguation is improved by taking advantage of the long and short-term dependency properties of the LSTM network and the parallel processing mechanism of Transformer network. The average disambiguation accuracy of this model reaches 75.24% in English word disambiguation, and the average disambiguation accuracy increases and decreases by less than 5% in different language scales, and the F1 scores of words with different lexical natures are more than 80. The average disambiguation accuracy of this model is higher than those of the comparative LSTM models in different disambiguation features. The English word disambiguation model’s overall performance in this paper is satisfactory.


Keywords

Transformer model, LSTM model, Context embedding model, Lexical disambiguation., 68T05


Citation

Wu, Y. (2024). A study of english lexical disambiguation based on the transformer model. Applied Mathematics and Nonlinear Sciences, 9(1). https://doi.org/10.2478/amns-2024-3542
0 Total citations
0.00 FWCI
0 Recent citations
(2 years)
23 References
Open Access Yes
View full metrics

Published by: Engineering Journals

Engineering Journals Logo