TY - JOUR
T1 - Quantum annealing for Dirichlet process mixture models with applications to network clustering
AU - Sato, Issei
AU - Tanaka, Shu
AU - Kurihara, Kenichi
AU - Miyashita, Seiji
AU - Nakagawa, Hiroshi
N1 - Funding Information:
The present work was partially supported by the Mitsubishi Foundation , and also by the Next Generation Super Computer Project, Nanoscience Program from MEXT of Japan . The authors are partially supported by Grand-in-Aid for JSPS Fellows ( 23-7601 ). Numerical calculations were partly performed on supercomputers at the Institute for Solid State Physics, University of Tokyo. This research was funded in part by the Joint Usage/Research Center for Interdisciplinary Large-scale Information Infrastructures in Japan. This work was supported by a JSPS Grant-in-Aid for Young Scientists (B) 24700135 .
PY - 2013/12/9
Y1 - 2013/12/9
N2 - We developed a new quantum annealing (QA) algorithm for Dirichlet process mixture (DPM) models based on the Chinese restaurant process (CRP). QA is a parallelized extension of simulated annealing (SA), i.e., it is a parallel stochastic optimization technique. Existing approaches ( Kurihara et al. 2009 [12] and Sato et al. 2009 [20]) cannot be applied to the CRP because their QA framework is formulated using a fixed number of mixture components. The proposed QA algorithm can handle an unfixed number of classes in mixture models. We applied QA to a DPM model for clustering vertices in a network where a CRP seating arrangement indicates a network partition. A multi core processer was used for running QA in experiments, the results of which show that QA is better than SA, Markov chain Monte Carlo inference, and beam search at finding a maximum a posteriori estimation of a seating arrangement in the CRP. Since our QA algorithm is as easy as to implement the SA algorithm, it is suitable for a wide range of applications.
AB - We developed a new quantum annealing (QA) algorithm for Dirichlet process mixture (DPM) models based on the Chinese restaurant process (CRP). QA is a parallelized extension of simulated annealing (SA), i.e., it is a parallel stochastic optimization technique. Existing approaches ( Kurihara et al. 2009 [12] and Sato et al. 2009 [20]) cannot be applied to the CRP because their QA framework is formulated using a fixed number of mixture components. The proposed QA algorithm can handle an unfixed number of classes in mixture models. We applied QA to a DPM model for clustering vertices in a network where a CRP seating arrangement indicates a network partition. A multi core processer was used for running QA in experiments, the results of which show that QA is better than SA, Markov chain Monte Carlo inference, and beam search at finding a maximum a posteriori estimation of a seating arrangement in the CRP. Since our QA algorithm is as easy as to implement the SA algorithm, it is suitable for a wide range of applications.
KW - Bayesian nonparametrics
KW - Dirichlet process
KW - Maximum a posteriori estimation
KW - Quantum annealing
KW - Stochastic optimization
UR - http://www.scopus.com/inward/record.url?scp=84884144248&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=84884144248&partnerID=8YFLogxK
U2 - 10.1016/j.neucom.2013.05.019
DO - 10.1016/j.neucom.2013.05.019
M3 - Article
AN - SCOPUS:84884144248
SN - 0925-2312
VL - 121
SP - 523
EP - 531
JO - Neurocomputing
JF - Neurocomputing
ER -