Reducing hubness for kernel regression

Kazuo Hara, Ikumi Suzuki, Kei Kobayashi, Kenji Fukumizu, Miloš Radovanović

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

In this paper, we point out that hubness—some samples in a high-dimensional dataset emerge as hubs that are similar to many other samples—influences the performance of kernel regression. Because the dimension of feature spaces induced by kernels is usually very high, hubness occurs, giving rise to the problem of multicollinearity, which is known as a cause of instability of regression results. We propose hubnessreduced kernels for kernel regression as an extension of a previous approach for kNN classification that reduces spatial centrality to eliminate hubness.

Original languageEnglish
Title of host publicationSimilarity Search and Applications - 8th International Conference, SISAP 2015, Proceedings
PublisherSpringer Verlag
Pages339-344
Number of pages6
Volume9371
ISBN (Print)9783319250861
DOIs
Publication statusPublished - 2015
Externally publishedYes
Event8th International Conference on Similarity Search and Applications, SISAP 2015 - Glasgow, United Kingdom
Duration: 2015 Oct 122015 Oct 14

Publication series

NameLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Volume9371
ISSN (Print)03029743
ISSN (Electronic)16113349

Other

Other8th International Conference on Similarity Search and Applications, SISAP 2015
CountryUnited Kingdom
CityGlasgow
Period15/10/1215/10/14

ASJC Scopus subject areas

  • Computer Science(all)
  • Theoretical Computer Science

Fingerprint Dive into the research topics of 'Reducing hubness for kernel regression'. Together they form a unique fingerprint.

  • Cite this

    Hara, K., Suzuki, I., Kobayashi, K., Fukumizu, K., & Radovanović, M. (2015). Reducing hubness for kernel regression. In Similarity Search and Applications - 8th International Conference, SISAP 2015, Proceedings (Vol. 9371, pp. 339-344). (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 9371). Springer Verlag. https://doi.org/10.1007/978-3-319-25087-8_33