TY - JOUR
T1 - Simultaneous multiple-stimulus auditory brain-computer interface with semi-supervised learning and prior probability distribution tuning
AU - Ogino, Mikito
AU - Hamada, Nozomu
AU - Mitsukura, Yasue
N1 - Funding Information:
This research was supported by the Keio Leading-edge Laboratory (KLL) 2021 Ph.D. Program. The authors declare that there are no conflicts of interest regarding the publication of this paper.
Publisher Copyright:
© 2022 IOP Publishing Ltd.
PY - 2022/12/1
Y1 - 2022/12/1
N2 - Objective. Auditory brain-computer interfaces (BCIs) enable users to select commands based on the brain activity elicited by auditory stimuli. However, existing auditory BCI paradigms cannot increase the number of available commands without decreasing the selection speed, because each stimulus needs to be presented independently and sequentially under the standard oddball paradigm. To solve this problem, we propose a double-stimulus paradigm that simultaneously presents multiple auditory stimuli. Approach. For addition to an existing auditory BCI paradigm, the best discriminable sound was chosen following a subjective assessment. The new sound was located on the right-hand side and presented simultaneously with an existing sound from the left-hand side. A total of six sounds were used for implementing the auditory BCI with a 6 × 6 letter matrix. We employ semi-supervised learning (SSL) and prior probability distribution tuning to improve the accuracy of the paradigm. The SSL method involved updating of the classifier weights, and their prior probability distributions were adjusted using the following three types of distributions: uniform, empirical, and extended empirical (e-empirical). The performance was evaluated based on the BCI accuracy and information transfer rate (ITR). Main results. The double-stimulus paradigm resulted in a BCI accuracy of 67.89 ± 11.46% and an ITR of 2.67 ± 1.09 bits min−1, in the absence of SSL and with uniform distribution. The proposed combination of SSL with e-empirical distribution improved the BCI accuracy and ITR to 74.59 ± 12.12% and 3.37 ± 1.27 bits min−1, respectively. The event-related potential analysis revealed that contralateral and right-hemispheric dominances contributed to the BCI performance improvement. Significance. Our study demonstrated that a BCI based on multiple simultaneous auditory stimuli, incorporating SSL and e-empirical prior distribution, can increase the number of commands without sacrificing typing speed beyond the acceptable level of accuracy.
AB - Objective. Auditory brain-computer interfaces (BCIs) enable users to select commands based on the brain activity elicited by auditory stimuli. However, existing auditory BCI paradigms cannot increase the number of available commands without decreasing the selection speed, because each stimulus needs to be presented independently and sequentially under the standard oddball paradigm. To solve this problem, we propose a double-stimulus paradigm that simultaneously presents multiple auditory stimuli. Approach. For addition to an existing auditory BCI paradigm, the best discriminable sound was chosen following a subjective assessment. The new sound was located on the right-hand side and presented simultaneously with an existing sound from the left-hand side. A total of six sounds were used for implementing the auditory BCI with a 6 × 6 letter matrix. We employ semi-supervised learning (SSL) and prior probability distribution tuning to improve the accuracy of the paradigm. The SSL method involved updating of the classifier weights, and their prior probability distributions were adjusted using the following three types of distributions: uniform, empirical, and extended empirical (e-empirical). The performance was evaluated based on the BCI accuracy and information transfer rate (ITR). Main results. The double-stimulus paradigm resulted in a BCI accuracy of 67.89 ± 11.46% and an ITR of 2.67 ± 1.09 bits min−1, in the absence of SSL and with uniform distribution. The proposed combination of SSL with e-empirical distribution improved the BCI accuracy and ITR to 74.59 ± 12.12% and 3.37 ± 1.27 bits min−1, respectively. The event-related potential analysis revealed that contralateral and right-hemispheric dominances contributed to the BCI performance improvement. Significance. Our study demonstrated that a BCI based on multiple simultaneous auditory stimuli, incorporating SSL and e-empirical prior distribution, can increase the number of commands without sacrificing typing speed beyond the acceptable level of accuracy.
KW - P300
KW - auditory stimuli
KW - brain-computer interface
KW - communication
KW - event-related potentials
KW - multiple stimulations
KW - semi-supervised learning
UR - http://www.scopus.com/inward/record.url?scp=85141891391&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=85141891391&partnerID=8YFLogxK
U2 - 10.1088/1741-2552/ac9edd
DO - 10.1088/1741-2552/ac9edd
M3 - Article
C2 - 36317357
AN - SCOPUS:85141891391
SN - 1741-2560
VL - 19
JO - Journal of Neural Engineering
JF - Journal of Neural Engineering
IS - 6
M1 - 066008
ER -