Smart eyewear for interaction and activity recognition

Shoya Ishimaru, Kai Steven Kunze, Katsuma Tanaka, Yuji Uema, Koichi Kise, Masahiko Inami

Research output: Chapter in Book/Report/Conference proceedingConference contribution

17 Citations (Scopus)

Abstract

Smart glasses and, in general, eyewear are a fairly novel device class with a lot of possibilities for user interaction design and unobtrusive activity tracking. In this paper we show applications using an early prototype of J!NS MEME, smart glasses with integrated electrodes to detect eye movements (Electrooculography, EOG) and motion sensors (accelerometer and gyroscope) to monitor head motions. We present several demonstrations: We show a simple eye movement visualization, detecting left/right eye motion and blink. Additionally, users can play a game, 'Blinky Bird'. They need to help a bird avoid obstacles using eye movements. We implemented online detection of reading and talking behavior using a combination of blink, eye movement and head motion. We can give people a long term view of their reading, talking, and also walking activity over the day. Copyright is held by the author/owner(s).

Original languageEnglish
Title of host publicationConference on Human Factors in Computing Systems - Proceedings
PublisherAssociation for Computing Machinery
Pages307-310
Number of pages4
Volume18
ISBN (Print)9781450331463
DOIs
Publication statusPublished - 2015 Apr 18
Externally publishedYes
Event33rd Annual CHI Conference on Human Factors in Computing Systems, CHI EA 2015 - Seoul, Korea, Republic of
Duration: 2015 Apr 182015 Apr 23

Other

Other33rd Annual CHI Conference on Human Factors in Computing Systems, CHI EA 2015
CountryKorea, Republic of
CitySeoul
Period15/4/1815/4/23

Fingerprint

Eye movements
Birds
Electrooculography
Glass
Gyroscopes
Accelerometers
Demonstrations
Visualization
Electrodes
Sensors

Keywords

  • Activity recognition
  • Electrooculography
  • Eye movement analysis
  • Eye wear
  • Eye wear computing
  • Smart glasses

ASJC Scopus subject areas

  • Human-Computer Interaction
  • Computer Graphics and Computer-Aided Design
  • Software

Cite this

Ishimaru, S., Kunze, K. S., Tanaka, K., Uema, Y., Kise, K., & Inami, M. (2015). Smart eyewear for interaction and activity recognition. In Conference on Human Factors in Computing Systems - Proceedings (Vol. 18, pp. 307-310). Association for Computing Machinery. https://doi.org/10.1145/2702613.2725449

Smart eyewear for interaction and activity recognition. / Ishimaru, Shoya; Kunze, Kai Steven; Tanaka, Katsuma; Uema, Yuji; Kise, Koichi; Inami, Masahiko.

Conference on Human Factors in Computing Systems - Proceedings. Vol. 18 Association for Computing Machinery, 2015. p. 307-310.

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Ishimaru, S, Kunze, KS, Tanaka, K, Uema, Y, Kise, K & Inami, M 2015, Smart eyewear for interaction and activity recognition. in Conference on Human Factors in Computing Systems - Proceedings. vol. 18, Association for Computing Machinery, pp. 307-310, 33rd Annual CHI Conference on Human Factors in Computing Systems, CHI EA 2015, Seoul, Korea, Republic of, 15/4/18. https://doi.org/10.1145/2702613.2725449
Ishimaru S, Kunze KS, Tanaka K, Uema Y, Kise K, Inami M. Smart eyewear for interaction and activity recognition. In Conference on Human Factors in Computing Systems - Proceedings. Vol. 18. Association for Computing Machinery. 2015. p. 307-310 https://doi.org/10.1145/2702613.2725449
Ishimaru, Shoya ; Kunze, Kai Steven ; Tanaka, Katsuma ; Uema, Yuji ; Kise, Koichi ; Inami, Masahiko. / Smart eyewear for interaction and activity recognition. Conference on Human Factors in Computing Systems - Proceedings. Vol. 18 Association for Computing Machinery, 2015. pp. 307-310
@inproceedings{cb2e849870e84368a9e0590f14cce66a,
title = "Smart eyewear for interaction and activity recognition",
abstract = "Smart glasses and, in general, eyewear are a fairly novel device class with a lot of possibilities for user interaction design and unobtrusive activity tracking. In this paper we show applications using an early prototype of J!NS MEME, smart glasses with integrated electrodes to detect eye movements (Electrooculography, EOG) and motion sensors (accelerometer and gyroscope) to monitor head motions. We present several demonstrations: We show a simple eye movement visualization, detecting left/right eye motion and blink. Additionally, users can play a game, 'Blinky Bird'. They need to help a bird avoid obstacles using eye movements. We implemented online detection of reading and talking behavior using a combination of blink, eye movement and head motion. We can give people a long term view of their reading, talking, and also walking activity over the day. Copyright is held by the author/owner(s).",
keywords = "Activity recognition, Electrooculography, Eye movement analysis, Eye wear, Eye wear computing, Smart glasses",
author = "Shoya Ishimaru and Kunze, {Kai Steven} and Katsuma Tanaka and Yuji Uema and Koichi Kise and Masahiko Inami",
year = "2015",
month = "4",
day = "18",
doi = "10.1145/2702613.2725449",
language = "English",
isbn = "9781450331463",
volume = "18",
pages = "307--310",
booktitle = "Conference on Human Factors in Computing Systems - Proceedings",
publisher = "Association for Computing Machinery",

}

TY - GEN

T1 - Smart eyewear for interaction and activity recognition

AU - Ishimaru, Shoya

AU - Kunze, Kai Steven

AU - Tanaka, Katsuma

AU - Uema, Yuji

AU - Kise, Koichi

AU - Inami, Masahiko

PY - 2015/4/18

Y1 - 2015/4/18

N2 - Smart glasses and, in general, eyewear are a fairly novel device class with a lot of possibilities for user interaction design and unobtrusive activity tracking. In this paper we show applications using an early prototype of J!NS MEME, smart glasses with integrated electrodes to detect eye movements (Electrooculography, EOG) and motion sensors (accelerometer and gyroscope) to monitor head motions. We present several demonstrations: We show a simple eye movement visualization, detecting left/right eye motion and blink. Additionally, users can play a game, 'Blinky Bird'. They need to help a bird avoid obstacles using eye movements. We implemented online detection of reading and talking behavior using a combination of blink, eye movement and head motion. We can give people a long term view of their reading, talking, and also walking activity over the day. Copyright is held by the author/owner(s).

AB - Smart glasses and, in general, eyewear are a fairly novel device class with a lot of possibilities for user interaction design and unobtrusive activity tracking. In this paper we show applications using an early prototype of J!NS MEME, smart glasses with integrated electrodes to detect eye movements (Electrooculography, EOG) and motion sensors (accelerometer and gyroscope) to monitor head motions. We present several demonstrations: We show a simple eye movement visualization, detecting left/right eye motion and blink. Additionally, users can play a game, 'Blinky Bird'. They need to help a bird avoid obstacles using eye movements. We implemented online detection of reading and talking behavior using a combination of blink, eye movement and head motion. We can give people a long term view of their reading, talking, and also walking activity over the day. Copyright is held by the author/owner(s).

KW - Activity recognition

KW - Electrooculography

KW - Eye movement analysis

KW - Eye wear

KW - Eye wear computing

KW - Smart glasses

UR - http://www.scopus.com/inward/record.url?scp=84954227923&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84954227923&partnerID=8YFLogxK

U2 - 10.1145/2702613.2725449

DO - 10.1145/2702613.2725449

M3 - Conference contribution

SN - 9781450331463

VL - 18

SP - 307

EP - 310

BT - Conference on Human Factors in Computing Systems - Proceedings

PB - Association for Computing Machinery

ER -