Classifier is used for pattern recognition in various fields including data mining. Boosting is an ensemble learning method to boost (enhance) an accuracy of single classifier. We propose a new, robust boosting method by using a zero-one step function as a loss function. In deriving the method, the MarginBoost technique is blended with the stochastic gradient approximation algorithm, called Stochastic Noise Reaction (SNR). Based on intensive numerical experiments, we show that the proposed method is actually better than AdaBoost on test error rates in the case of noisy, mislabeled situation.
|ジャーナル||Journal of the Operations Research Society of Japan|
|出版ステータス||Published - 2008 3月|
ASJC Scopus subject areas
- 経営科学およびオペレーションズ リサーチ