Effects of unlabeled data on classification error in normal discriminant analysis

Keiji Takai, Kenichi Hayashi

Research output: Contribution to journalArticle

2 Citations (Scopus)

Abstract

Semi-supervised learning, i.e., the estimation of parameters based on both labeled and unlabeled data, is widely believed to be effective in constructing a boundary in classification problems. The present paper investigates whether this belief is true in the case of normal discrimination in terms of the classification error for normal and nonnormal data. For this investigation, we use the framework of missing-data analysis because data consisting of labeled and unlabeled individuals can be regarded as missing data. Based on this framework, we introduce two labeling mechanisms: feature-independent labeling and feature-dependent labeling. For each of these labeling mechanisms, we analytically derive the asymptotic relative efficiency based on the labeled data alone and based on both the labeled and unlabeled data. Numerical computations reveal that (i) under the feature-independent labeling mechanism, unlabeled data tend to contribute to the improvement of the classification error even for nonnormal data and (ii) under the feature-dependent labeling mechanism, unlabeled data from both normal and nonnormal distributions are helpful when the labeled data are informative, but unlabeled data can augment the classification error when the labeled data are not informative. Finally, we describe some future areas of research.

Original languageEnglish
Pages (from-to)66-83
Number of pages18
JournalJournal of Statistical Planning and Inference
Volume147
DOIs
Publication statusPublished - 2014 Apr

Keywords

  • Asymptotic relative efficiency
  • Missing data
  • Nonnormal data
  • Normal discrimination
  • Partially labeled data
  • Semi-supervised learning
  • Unlabeled data

ASJC Scopus subject areas

  • Statistics and Probability
  • Statistics, Probability and Uncertainty
  • Applied Mathematics

Fingerprint Dive into the research topics of 'Effects of unlabeled data on classification error in normal discriminant analysis'. Together they form a unique fingerprint.

  • Cite this