Presentation of an SMR-based BCI using auditory feedback based on pitch

Philemon Roussel, Atsushi Negishi, Yasue Mitsukura

Research output: Chapter in Book/Report/Conference proceedingConference contribution

1 Citation (Scopus)

Abstract

Brain-Computer Interfaces (BCIs) aim to translate the users cerebral activity into a control signal, allowing him to interact with an external device without the use of conventional muscled-based pathways. These alternative communication pathways have already been employed under various forms to allow severely handicapped people to use assistive devices. Given that most of currently developed BCIs only provide a visual feedback to the user, the aim of this study was to observe the result provided by an auditory feedback based on pitch. The BCI developed to this end classifies two different commands using sensorimotor rhythm (SMR) frequency features. The experiment consisted in sessions of trials during which the subjects were asked to perform motor imagery or to rest. Except for the first session, the system provided the subjects with a realtime feedback based on the learning data of the previous sessions. This feedback was generated by a control signal resulting of the classification of the extracted features by a Support Vector Regression (SVR) algorithm. Half of the 16 subjects were given visual feedback, consisting in a cursor movement, and the other half received auditory feedback, consisting in a pitch variation. Although the performance of the visual feedback BCI was superior during the first sessions, the final third session classification rates were 69.7 and 70.3% for respectively visual and auditory conditioning. These results tend to show that there might be no significant difference between the two types of feedback after long enough training. Moreover, this study also demonstrate the usability of a SVR classifier.

Original languageEnglish
Title of host publication2016 11th France-Japan and 9th Europe-Asia Congress on Mechatronics, MECATRONICS 2016 / 17th International Conference on Research and Education in Mechatronics, REM 2016
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages174-177
Number of pages4
ISBN (Electronic)9781509017874
DOIs
Publication statusPublished - 2016 Aug 17
Event11th France-Japan and 9th Europe-Asia Congress on Mechatronics, MECATRONICS 2016 / 17th International Conference on Research and Education in Mechatronics, REM 2016 - Compiegne, France
Duration: 2016 Jun 152016 Jun 17

Other

Other11th France-Japan and 9th Europe-Asia Congress on Mechatronics, MECATRONICS 2016 / 17th International Conference on Research and Education in Mechatronics, REM 2016
CountryFrance
CityCompiegne
Period16/6/1516/6/17

Fingerprint

Brain computer interface
brain
Feedback
Support Vector Regression
Signal Control
Pathway
regression
Presentation
Brain
handicapped
conditioning
Conditioning
Usability
Classifiers
Classify
Classifier
Tend
Real-time
Vision
communication

ASJC Scopus subject areas

  • Mechanical Engineering
  • Modelling and Simulation
  • Education
  • Artificial Intelligence
  • Electrical and Electronic Engineering

Cite this

Roussel, P., Negishi, A., & Mitsukura, Y. (2016). Presentation of an SMR-based BCI using auditory feedback based on pitch. In 2016 11th France-Japan and 9th Europe-Asia Congress on Mechatronics, MECATRONICS 2016 / 17th International Conference on Research and Education in Mechatronics, REM 2016 (pp. 174-177). [7547136] Institute of Electrical and Electronics Engineers Inc.. https://doi.org/10.1109/MECATRONICS.2016.7547136

Presentation of an SMR-based BCI using auditory feedback based on pitch. / Roussel, Philemon; Negishi, Atsushi; Mitsukura, Yasue.

2016 11th France-Japan and 9th Europe-Asia Congress on Mechatronics, MECATRONICS 2016 / 17th International Conference on Research and Education in Mechatronics, REM 2016. Institute of Electrical and Electronics Engineers Inc., 2016. p. 174-177 7547136.

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Roussel, P, Negishi, A & Mitsukura, Y 2016, Presentation of an SMR-based BCI using auditory feedback based on pitch. in 2016 11th France-Japan and 9th Europe-Asia Congress on Mechatronics, MECATRONICS 2016 / 17th International Conference on Research and Education in Mechatronics, REM 2016., 7547136, Institute of Electrical and Electronics Engineers Inc., pp. 174-177, 11th France-Japan and 9th Europe-Asia Congress on Mechatronics, MECATRONICS 2016 / 17th International Conference on Research and Education in Mechatronics, REM 2016, Compiegne, France, 16/6/15. https://doi.org/10.1109/MECATRONICS.2016.7547136
Roussel P, Negishi A, Mitsukura Y. Presentation of an SMR-based BCI using auditory feedback based on pitch. In 2016 11th France-Japan and 9th Europe-Asia Congress on Mechatronics, MECATRONICS 2016 / 17th International Conference on Research and Education in Mechatronics, REM 2016. Institute of Electrical and Electronics Engineers Inc. 2016. p. 174-177. 7547136 https://doi.org/10.1109/MECATRONICS.2016.7547136
Roussel, Philemon ; Negishi, Atsushi ; Mitsukura, Yasue. / Presentation of an SMR-based BCI using auditory feedback based on pitch. 2016 11th France-Japan and 9th Europe-Asia Congress on Mechatronics, MECATRONICS 2016 / 17th International Conference on Research and Education in Mechatronics, REM 2016. Institute of Electrical and Electronics Engineers Inc., 2016. pp. 174-177
@inproceedings{b6b4a677be454d4882075e5e67120649,
title = "Presentation of an SMR-based BCI using auditory feedback based on pitch",
abstract = "Brain-Computer Interfaces (BCIs) aim to translate the users cerebral activity into a control signal, allowing him to interact with an external device without the use of conventional muscled-based pathways. These alternative communication pathways have already been employed under various forms to allow severely handicapped people to use assistive devices. Given that most of currently developed BCIs only provide a visual feedback to the user, the aim of this study was to observe the result provided by an auditory feedback based on pitch. The BCI developed to this end classifies two different commands using sensorimotor rhythm (SMR) frequency features. The experiment consisted in sessions of trials during which the subjects were asked to perform motor imagery or to rest. Except for the first session, the system provided the subjects with a realtime feedback based on the learning data of the previous sessions. This feedback was generated by a control signal resulting of the classification of the extracted features by a Support Vector Regression (SVR) algorithm. Half of the 16 subjects were given visual feedback, consisting in a cursor movement, and the other half received auditory feedback, consisting in a pitch variation. Although the performance of the visual feedback BCI was superior during the first sessions, the final third session classification rates were 69.7 and 70.3{\%} for respectively visual and auditory conditioning. These results tend to show that there might be no significant difference between the two types of feedback after long enough training. Moreover, this study also demonstrate the usability of a SVR classifier.",
author = "Philemon Roussel and Atsushi Negishi and Yasue Mitsukura",
year = "2016",
month = "8",
day = "17",
doi = "10.1109/MECATRONICS.2016.7547136",
language = "English",
pages = "174--177",
booktitle = "2016 11th France-Japan and 9th Europe-Asia Congress on Mechatronics, MECATRONICS 2016 / 17th International Conference on Research and Education in Mechatronics, REM 2016",
publisher = "Institute of Electrical and Electronics Engineers Inc.",

}

TY - GEN

T1 - Presentation of an SMR-based BCI using auditory feedback based on pitch

AU - Roussel, Philemon

AU - Negishi, Atsushi

AU - Mitsukura, Yasue

PY - 2016/8/17

Y1 - 2016/8/17

N2 - Brain-Computer Interfaces (BCIs) aim to translate the users cerebral activity into a control signal, allowing him to interact with an external device without the use of conventional muscled-based pathways. These alternative communication pathways have already been employed under various forms to allow severely handicapped people to use assistive devices. Given that most of currently developed BCIs only provide a visual feedback to the user, the aim of this study was to observe the result provided by an auditory feedback based on pitch. The BCI developed to this end classifies two different commands using sensorimotor rhythm (SMR) frequency features. The experiment consisted in sessions of trials during which the subjects were asked to perform motor imagery or to rest. Except for the first session, the system provided the subjects with a realtime feedback based on the learning data of the previous sessions. This feedback was generated by a control signal resulting of the classification of the extracted features by a Support Vector Regression (SVR) algorithm. Half of the 16 subjects were given visual feedback, consisting in a cursor movement, and the other half received auditory feedback, consisting in a pitch variation. Although the performance of the visual feedback BCI was superior during the first sessions, the final third session classification rates were 69.7 and 70.3% for respectively visual and auditory conditioning. These results tend to show that there might be no significant difference between the two types of feedback after long enough training. Moreover, this study also demonstrate the usability of a SVR classifier.

AB - Brain-Computer Interfaces (BCIs) aim to translate the users cerebral activity into a control signal, allowing him to interact with an external device without the use of conventional muscled-based pathways. These alternative communication pathways have already been employed under various forms to allow severely handicapped people to use assistive devices. Given that most of currently developed BCIs only provide a visual feedback to the user, the aim of this study was to observe the result provided by an auditory feedback based on pitch. The BCI developed to this end classifies two different commands using sensorimotor rhythm (SMR) frequency features. The experiment consisted in sessions of trials during which the subjects were asked to perform motor imagery or to rest. Except for the first session, the system provided the subjects with a realtime feedback based on the learning data of the previous sessions. This feedback was generated by a control signal resulting of the classification of the extracted features by a Support Vector Regression (SVR) algorithm. Half of the 16 subjects were given visual feedback, consisting in a cursor movement, and the other half received auditory feedback, consisting in a pitch variation. Although the performance of the visual feedback BCI was superior during the first sessions, the final third session classification rates were 69.7 and 70.3% for respectively visual and auditory conditioning. These results tend to show that there might be no significant difference between the two types of feedback after long enough training. Moreover, this study also demonstrate the usability of a SVR classifier.

UR - http://www.scopus.com/inward/record.url?scp=84986199810&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84986199810&partnerID=8YFLogxK

U2 - 10.1109/MECATRONICS.2016.7547136

DO - 10.1109/MECATRONICS.2016.7547136

M3 - Conference contribution

AN - SCOPUS:84986199810

SP - 174

EP - 177

BT - 2016 11th France-Japan and 9th Europe-Asia Congress on Mechatronics, MECATRONICS 2016 / 17th International Conference on Research and Education in Mechatronics, REM 2016

PB - Institute of Electrical and Electronics Engineers Inc.

ER -