Weighted frequent itemset mining over uncertain databases

Jerry Chun Wei Lin*, Wensheng Gan, Philippe Fournier-Viger, Tzung Pei Hong, Vincent Shin-Mu Tseng

*Corresponding author for this work

Research output: Contribution to journalArticle

34 Scopus citations

Abstract

Frequent itemset mining (FIM) is a fundamental research topic, which consists of discovering useful and meaningful relationships between items in transaction databases. However, FIM suffers from two important limitations. First, it assumes that all items have the same importance. Second, it ignores the fact that data collected in a real-life environment is often inaccurate, imprecise, or incomplete. To address these issues and mine more useful and meaningful knowledge, the problems of weighted and uncertain itemset mining have been respectively proposed, where a user may respectively assign weights to items to specify their relative importance, and specify existential probabilities to represent uncertainty in transactions. However, no work has addressed both of these issues at the same time. In this paper, we address this important research problem by designing a new type of patterns named high expected weighted itemset (HEWI) and the HEWI-Uapriori algorithm to efficiently discover HEWIs. The HEWI-Uapriori finds HEWIs using an Apriori-like two-phase approach. The algorithm introduces a property named high upper-bound expected weighted downward closure (HUBEWDC) to early prune the search space and unpromising itemsets. Substantial experiments on real-life and synthetic datasets are conducted to evaluate the performance of the proposed algorithm in terms of runtime, memory consumption, and number of patterns found. Results show that the proposed algorithm has excellent performance and scalability compared with traditional methods for weighted-itemset mining and uncertain itemset mining.

Original languageEnglish
Pages (from-to)232-250
Number of pages19
JournalApplied Intelligence
Volume44
Issue number1
DOIs
StatePublished - 1 Jan 2016

Keywords

  • Data mining
  • Two-phase
  • Uncertain databases
  • Upper-bound
  • Weighted frequent itemsets

Fingerprint Dive into the research topics of 'Weighted frequent itemset mining over uncertain databases'. Together they form a unique fingerprint.

  • Cite this