Turkish Journal of Computer and Mathematics Education
Journal license

Journal

Turkish Journal of Computer and Mathematics Education


Volume
& Issue

Volume 12, Issue 2


Published
on

April 5, 2021


Pages

1866-1875


DOI

Article

Fast Frequent Item Mining from Big Data using Map Reduce and Bit Vectors


Authors

S Thirumaran* Affiliation:
Department of Computer Application, Alagappa Government Arts College, Karaikudi, India
and R Nagarajan Affiliation:
Department of Computer and Information Science, Annamalai University, India


Abstract

One of the most important area s that are constantly being focused recently is the big data and mining frequent patterns from them is an interesting vertical which is perpetually being evolved and gained plethora of attention among the research fraternities. Generally, the data is mined with the aid of Apriori based algorithms, tree based algorithm and hash based algorithm but most of these existing algorithms suffer many snags and limitations. This paper proposes a new method that overrides and overcomes the most common problems related to speed, memory consumption and search space. The algorithm named Dual Mine employs binary vector representation and vertical data representations in the map reduce and then discov er the most patterns from the large data sets. The Dual mine algorithm is then compared with some of the existing algorithms to determine the efficiency of the proposed algorithm and from the experimental results it is quite evident that the proposed algorithm “Dual Mine” outscored the other algorithms by a big magnitude with respect to speed and memory.


Keywords

Mining, Big Data, Bit Vectors, Map Reduce, Apriori & Hash Algorithm


Citation

Thirumaran, S. & Nagarajan, R. (2021). Fast frequent item mining from big data using map reduce and bit vectors. Turkish Journal of Computer and Mathematics Education, 12(2), 1866–1875.

Published by: Engineering Journals

Engineering Journals Logo