A robust ensemble learning using zero-one loss function

Natsuki Sano, Hideo Suzuki, Masato Koda

Research output: Contribution to journalArticle

Abstract

Classifier is used for pattern recognition in various fields including data mining. Boosting is an ensemble learning method to boost (enhance) an accuracy of single classifier. We propose a new, robust boosting method by using a zero-one step function as a loss function. In deriving the method, the MarginBoost technique is blended with the stochastic gradient approximation algorithm, called Stochastic Noise Reaction (SNR). Based on intensive numerical experiments, we show that the proposed method is actually better than AdaBoost on test error rates in the case of noisy, mislabeled situation.

Original languageEnglish
Pages (from-to)95-110
Number of pages16
JournalJournal of the Operations Research Society of Japan
Volume51
Issue number1
DOIs
Publication statusPublished - 2008 Mar

    Fingerprint

Keywords

  • AdaBoost
  • Data Analysis
  • Data mining
  • Stochastic noise reaction
  • Zero-one loss function

ASJC Scopus subject areas

  • Decision Sciences(all)
  • Management Science and Operations Research

Cite this