Hierarchical hypothesis structure for ensemble learning

Chu En Yu, Chien-Liang Liu, Hsin Lung Hsieh

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

Abstract

One of the goals for the machine learning research is to improve the accuracy of the classification. Many research studies have focused on developing novel algorithms according to problem domains and statistical learning theory to continuously improve classification performance over the past decades. Recently, many researchers have found that performance bottleneck often occurs when only using a single classification algorithm, since each algorithm has its strength, but it also has its weakness. Ensemble learning, which combines several classifiers or hypotheses to become a strong classifier or learner, relies on the combination of various hypotheses rather than using state-of-the-art algorithms. In ensemble learning, hypothesis selection is crucial to performance, and the diversity of the selected hypotheses is an important selection criterion. This work proposes three algorithms focusing on generating a hierarchical hypothesis structure to achieve the goal of hypothesis selection, in which the two hypotheses are combined based on particular criterion. We conduct experiments on 8 data sets, and the experimental results indicate that the proposed method outperforms random forest, which is a state-of-the-art method.

Original languageEnglish
Title of host publicationICNC-FSKD 2017 - 13th International Conference on Natural Computation, Fuzzy Systems and Knowledge Discovery
EditorsLiang Zhao, Lipo Wang, Guoyong Cai, Kenli Li, Yong Liu, Guoqing Xiao
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages1827-1832
Number of pages6
ISBN (Electronic)9781538621653
DOIs
StatePublished - 21 Jun 2018
Event13th International Conference on Natural Computation, Fuzzy Systems and Knowledge Discovery, ICNC-FSKD 2017 - Guilin, Guangxi, China
Duration: 29 Jul 201731 Jul 2017

Publication series

NameICNC-FSKD 2017 - 13th International Conference on Natural Computation, Fuzzy Systems and Knowledge Discovery

Conference

Conference13th International Conference on Natural Computation, Fuzzy Systems and Knowledge Discovery, ICNC-FSKD 2017
CountryChina
CityGuilin, Guangxi
Period29/07/1731/07/17

Keywords

  • Ensemble Learning
  • Hypothesis Divergence
  • Hypothesis Hierarchical Structure
  • Hypothesis Selection

Fingerprint Dive into the research topics of 'Hierarchical hypothesis structure for ensemble learning'. Together they form a unique fingerprint.

Cite this