Fast mining frequent patterns with secondary memory

Kawuu W. Lin, Sheng Hao Chung, Sheng Shiung Huang, Chun-Cheng Lin

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

Data mining technology has been widely studied and applied in recent years. Frequent pattern mining is one important technical field of such research. The frequent pattern mining technique is popular not only in academia but also in the business community. With advances in technology, databases have become so large that data mining is impossible because of memory restrictions. In this study, we propose a novel algorithm called Hybrid Mine (H-Mine) to help improve this situation. H-Mine saves a part of the information that is not stored in the memory, and through the use of mixed hard disk and memory mining we are able to complete data mining with limited memory. The results of empirical evaluation under various simulation conditions show that H-Mine delivers excellent performance in terms of execution efficiency and scalability.

Original languageEnglish
Title of host publicationProceedings of the ASE BigData and SocialInformatics 2015, ASE BD and SI 2015
PublisherAssociation for Computing Machinery
ISBN (Electronic)9781450337359
DOIs
StatePublished - 7 Oct 2015
EventASE BigData and SocialInformatics, ASE BD and SI 2015 - Kaohsiung, Taiwan
Duration: 7 Oct 20159 Oct 2015

Publication series

NameACM International Conference Proceeding Series
Volume07-09-Ocobert-2015

Conference

ConferenceASE BigData and SocialInformatics, ASE BD and SI 2015
CountryTaiwan
CityKaohsiung
Period7/10/159/10/15

Keywords

  • Data mining
  • Disk storage
  • Frequent pattern mining
  • Main memory

Fingerprint Dive into the research topics of 'Fast mining frequent patterns with secondary memory'. Together they form a unique fingerprint.

  • Cite this

    Lin, K. W., Chung, S. H., Huang, S. S., & Lin, C-C. (2015). Fast mining frequent patterns with secondary memory. In Proceedings of the ASE BigData and SocialInformatics 2015, ASE BD and SI 2015 [a43] (ACM International Conference Proceeding Series; Vol. 07-09-Ocobert-2015). Association for Computing Machinery. https://doi.org/10.1145/2818869.2818903