Applied Mathematics and Nonlinear Sciences
Journal license

Journal

Applied Mathematics and Nonlinear Sciences


Volume
& Issue

Volume 7, Issue 1


Published
on

August 22, 2022


Pages

965-974


DOI

Article

Algorithm of overfitting avoidance in CNN based on maximum pooled and weight decay


Authors

Guanzhan Li Affiliation:
Jiangxi University of Engineering, Xinyu, Jiangxi Province, 338000, China
, Xiangcheng Jian Affiliation:
Jiangxi University of Engineering, Xinyu, Jiangxi Province, 338000, China
, Zhicheng Wen Affiliation:
Jiangxi University of Engineering, Xinyu, Jiangxi Province, 338000, China
and Jamal AlSultan Affiliation:
Computer Science, College of Arts & Science, Applied Science University-Bahrain, Bahrain


Abstract

This paper aims to eradicate the poor performance of the convolutional neural network (CNN) for intelligent analysis and detection in samples. Moreover, to avoid overfitting of the CNN model during the training process, an algorithm is proposed for the fusion of maximum pooled and weight decay. Firstly, the maximum pooled method for the pooling layer is explored after mask processing to reduce the number of irrelevant neurons. Secondly, when updating the neuron weight parameters, the weight decay is introduced to further cut down complexity in model training. The experimental comparison shows that the overfitting avoidance algorithm can reduce the detection error rate by more than 10% in image detection than other methods, and it has better generalisation.


Keywords

CNN, weight decay, convolution neural network, overfitting


Citation

Li, G., Jian, X., Wen, Z., & AlSultan, J. (2022). Algorithm of overfitting avoidance in CNN based on maximum pooled and weight decay. Applied Mathematics and Nonlinear Sciences, 7(1), 965–974. https://doi.org/10.2478/amns.2022.1.00011

Published by: Engineering Journals

Engineering Journals Logo