Turkish Journal of Computer and Mathematics Education
Journal license

Journal

Turkish Journal of Computer and Mathematics Education


Volume
& Issue

Volume 15, Issue 3


Published
on


Pages

144-153


DOI

Article

Comprehensive Data Corruption Identification Using Machine Learning Algorithms (PAACDA)

Check for updates


Authors

M. Vanitha Affiliation:
Professor, Department of CSE, Malla Reddy Engineering College for Women, Autonomous, Hyderabad
, K. Maneesha Affiliation:
Student, Department of CSE, Malla Reddy Engineering College for Women, Autonomous, Hyderabad
, K. Uma Renu Sri Affiliation:
Student, Department of CSE, Malla Reddy Engineering College for Women, Autonomous, Hyderabad
and K. Nancy Affiliation:
Student, Department of CSE, Malla Reddy Engineering College for Women, Autonomous, Hyderabad


Abstract

Data and analysis have evolved from being scattered numbers and qualities in spreadsheets to being seen as a means to revolutionize any substantial industry, thanks to the rise of technology. There are many unethical and unlawful ways that data may get corrupted, thus it's important to find a way to effectively detect and highlight all the corrupted data in the dataset. It is not an easy task to detect damaged data or to restore information from a corrupted dataset. This is crucial and could cause issues with data processing using machines or deep learning methods later on if not handled early enough. Rather than focusing on outlier identification, this study introduces its PAACDA: Presence driven Adamic Adar Corruption identification Algorithm and then consolidates the findings. Even though they rely on parameter tuning to achieve high accuracy and remember, current state-of-the-art models like Isolation forest and DBSCAN (which stands for "Density-Based the spatial the process of clustering of the applications with Noise") have a lot of uncertainty when they factor in corrupted data. This study investigates the specific performance problems with several unsupervised learning methods on corrupted linear and clustered datasets. In addition, we provide a new PAACDA technique that achieves a higher precision of 96.35% for cluster data and 99.04% for linear data compared to previous unsupervised training benchmarks on 15 prominent baselines, including as K-means clustering, Isolation forest, and LOF (Local Outlier Factor). From the aforementioned angles, this essay delves deeply into the relevant literature as well. In this study, we identify all the problems with current methods and suggest ways forward for research in this area.


Keywords


Citation

Vanitha, M., Maneesha, K., Sri, K. U. R., & Nancy, K. (2024). Comprehensive data corruption identification using machine learning algorithms (PAACDA). Turkish Journal of Computer and Mathematics Education, 15(3), 144–153. https://doi.org/10.61841/turcomat.v15i3.14785

Published by: Engineering Journals

Engineering Journals Logo