onNote: Playing printed music scores as a musical instrument

Yusuke Yamamoto, Hideaki Uchiyama, Yasuaki Kakehi

Research output: Chapter in Book/Report/Conference proceedingConference contribution

3 Citations (Scopus)

Abstract

This paper presents a novel musical performance system named onNote that directly utilizes printed music scores as a musical instrument. This system can make users believe that sound is indeed embedded on the music notes in the scores. The users can play music simply by placing, moving and touching the scores under a desk lamp equipped with a camera and a small projector. By varying the movement, the users can control the playing sound and the tempo of the music. To develop this system, we propose an image processing based framework for retrieving music from a music database by capturing printed music scores. From a captured image, we identify the scores by matching them with the reference music scores, and compute the position and pose of the scores with respect to the camera. By using this framework, we can develop novel types of musical interactions.

Original languageEnglish
Title of host publicationUIST'11 - Proceedings of the 24th Annual ACM Symposium on User Interface Software and Technology
Pages413-422
Number of pages10
DOIs
Publication statusPublished - 2011 Nov 14
Event24th Annual ACM Symposium on User Interface Software and Technology, UIST'11 - Santa Barbara, CA, United States
Duration: 2011 Oct 162011 Oct 19

Publication series

NameUIST'11 - Proceedings of the 24th Annual ACM Symposium on User Interface Software and Technology

Other

Other24th Annual ACM Symposium on User Interface Software and Technology, UIST'11
CountryUnited States
CitySanta Barbara, CA
Period11/10/1611/10/19

    Fingerprint

Keywords

  • Image retrieval
  • Musical instrument
  • Tangible interface

ASJC Scopus subject areas

  • Human-Computer Interaction
  • Software

Cite this

Yamamoto, Y., Uchiyama, H., & Kakehi, Y. (2011). onNote: Playing printed music scores as a musical instrument. In UIST'11 - Proceedings of the 24th Annual ACM Symposium on User Interface Software and Technology (pp. 413-422). (UIST'11 - Proceedings of the 24th Annual ACM Symposium on User Interface Software and Technology). https://doi.org/10.1145/2047196.2047249