Applied Mathematics and Nonlinear Sciences
Journal license

Journal

Applied Mathematics and Nonlinear Sciences


Volume
& Issue

Volume 9, Issue 1


Published
on

August 5, 2024


Pages


DOI

Article

Research on Collaborative Filtering Algorithm Based on Hadoop Architecture for Matrix Dimension Reduction in E-commerce Environment

Check for updates


Authors

Bing Liang Affiliation:
School of Business, Anyang Institute of Technology, Anyang, Henan, 455000, China.


Abstract

The rapid popularization and expansion of the Internet have catalyzed the growth of diverse e-commerce platforms. To mitigate information overload and enhance consumer shopping experiences, recommender systems have been developed. Our proposed algorithm, grounded in the Hadoop architecture, employs a refined cosine similarity method to calculate the average distance between users and rated items. This method involves the application of the Singular Value Decomposition (SVD) model to reduce the dimensionality of the user-item rating matrix, facilitating the extraction of item feature vectors. Subsequently, these vectors are clustered and segmented using the Matrix Factorization (MF) algorithm, addressing the challenge of data sparsity effectively. Experimental evaluations demonstrate that our enhanced algorithm outperforms five conventional collaborative filtering recommendation algorithms across varying matrix densities (from 0.05 to 0.25) on a public dataset. This results in a significant reduction in prediction error, thereby offering users more precise item recommendations.


Keywords

Hadoop architecture, Collaborative filtering algorithm, Cosine similarity, Matrix decomposition, Dimensionality reduction processing, MF algorithm, 68M01


Citation

Liang, B. (2024). Research on collaborative filtering algorithm based on hadoop architecture for matrix dimension reduction in e-commerce environment. Applied Mathematics and Nonlinear Sciences, 9(1). https://doi.org/10.2478/amns-2024-1956

Published by: Engineering Journals

Engineering Journals Logo