Applied Mathematics and Nonlinear Sciences
Journal license

Journal

Applied Mathematics and Nonlinear Sciences


Volume
& Issue

Volume 9, Issue 1


Published
on

October 9, 2024


Pages


DOI

Article

Research on deep neural network-based anomaly detection technology in high-dimensional data environment

Check for updates


Authors

Yan Wang Affiliation:
EIT Data Science and Communication College, Zhejiang Yuexiu University, Shaoxing, Zhejiang, 312000, China.


Abstract

With the popularization of information technology, the dramatic growth of data size, the significant rise in data dimensions, the increasing complexity of data types, and the diversity and complexity of the manifestations of anomalies all make anomaly detection more difficult. In this paper, we enhance the structure of the variational self-encoder in deep neural networks to maintain the benefits of anomaly detection technology, which relies on reconstruction error. Utilizing the high reliability of agent supervision to make up for the lack of detection performance of the deep self-encoder when the anomaly data dimension is high, a novel unsupervised anomaly detection model for high-dimensional and high anomaly rate data is proposed. Results from tests on several public datasets show that the UAD-ADC model does better than four other traditional anomaly detection methods in all of the datasets when looking at AUC values. On two datasets, Pendigits and Letter, the method improves by 0.3648 and 0.3004 over the lowest algorithm, and the experimental results confirm its effectiveness.


Keywords

Outlier detection, Deep neural network, Variational self-encoder, Reconstruction error, Agent supervision, 97M50


Citation

Wang, Y. (2024). Research on deep neural network-based anomaly detection technology in high-dimensional data environment. Applied Mathematics and Nonlinear Sciences, 9(1). https://doi.org/10.2478/amns-2024-2906
0 Total citations
0.00 FWCI
0 Recent citations
(2 years)
40 References
Open Access Yes
View full metrics

Published by: Engineering Journals

Engineering Journals Logo