A Distributed Ensemble Scheme for nonlinear Support Vector Machine

Wei Chih Lai, Po Han Huang, Yuh-Jye Lee, Alvin Chiang

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

1 Scopus citations

Abstract

We propose an ensemble scheme with a parallel computational structure which we call Distributed Ensemble Support Vector Machine (DESVM) to overcome the difficulties of large scale nonlinear Support Vector Machines (SVMs) in practice. The dataset is split into many stratified partitions. Each partition might be still too large to be solved by using conventional SVM solvers. We apply the reduced kernel trick to generate a nonlinear SVM classifier for each partition that can be treated as an approximation model based on the partial dataset. Then, we use a linear SVM classifier to fuse the nonlinear SVM classifiers that are generated from all data partitions. In this linear SVM training model, we treat each nonlinear SVM classifier as an 'attribute' or an 'expert'. In the ensemble phase, DESVM generates a fusion model which is a weighted combination of the nonlinear SVM classifiers. It can be explained as a weighted voting decision made by a group of experts. We test our proposed method on five benchmark datasets. The numerical results show that DESVM is competitive in accuracy and has a high speed-up. Thus, DESVM can be a powerful tool for binary classification problems with large scale not linearly separable datasets.

Original languageEnglish
Title of host publication2015 IEEE 10th International Conference on Intelligent Sensors, Sensor Networks and Information Processing, ISSNIP 2015
PublisherInstitute of Electrical and Electronics Engineers Inc.
ISBN (Electronic)9781479980550
DOIs
StatePublished - 13 May 2015
Event10th IEEE International Conference on Intelligent Sensors, Sensor Networks and Information Processing, ISSNIP 2015 - Singapore, Singapore
Duration: 7 Apr 20159 Apr 2015

Publication series

Name2015 IEEE 10th International Conference on Intelligent Sensors, Sensor Networks and Information Processing, ISSNIP 2015

Conference

Conference10th IEEE International Conference on Intelligent Sensors, Sensor Networks and Information Processing, ISSNIP 2015
CountrySingapore
CitySingapore
Period7/04/159/04/15

Keywords

  • Distributed computing
  • ensemble learning
  • parallel algorithm
  • reduced kernel trick
  • support vector machine

Fingerprint Dive into the research topics of 'A Distributed Ensemble Scheme for nonlinear Support Vector Machine'. Together they form a unique fingerprint.

Cite this