A Thumb Tip Wearable Device Consisting of Multiple Cameras to Measure Thumb Posture

Naoto Ienaga, Wataru Kawai, Koji Fujita, Natsuki Miyata, Yuta Sugiura, Hideo Saito

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

Today, cameras have become smaller and cheaper and can be utilized in various scenes. We took advantage of that to develop a thumb tip wearable device to estimate joint angles of a thumb as measuring human finger postures is important in terms of human-computer interface and to analyze human behavior. The device we developed consists of three small cameras attached at different angles so the cameras can capture the four fingers. We assumed that the appearance of the four fingers would change depending on the joint angles of the thumb. We made a convolutional neural network learn a regression relationship between the joint angles of the thumb and the images taken by the cameras. In this paper, we captured the keypoint positions of the thumb with a USB sensor device and calculated the joint angles to construct a dataset. The root mean squared error of the test data was 6.23° and 4.75° .

Original languageEnglish
Title of host publicationComputer Vision – ACCV 2018 Workshops - 14th Asian Conference on Computer Vision, 2018, Revised Selected Papers
EditorsGustavo Carneiro, Shaodi You
PublisherSpringer Verlag
Pages31-38
Number of pages8
ISBN (Print)9783030210731
DOIs
Publication statusPublished - 2019 Jan 1
Event14th Asian Conference on Computer Vision, ACCV 2018 - Perth, Australia
Duration: 2018 Dec 22018 Dec 6

Publication series

NameLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Volume11367 LNCS
ISSN (Print)0302-9743
ISSN (Electronic)1611-3349

Conference

Conference14th Asian Conference on Computer Vision, ACCV 2018
CountryAustralia
CityPerth
Period18/12/218/12/6

Fingerprint

Camera
Cameras
Angle
Human-computer Interface
Interfaces (computer)
Human Behavior
Mean Squared Error
Neural networks
Regression
Roots
Neural Networks
Sensors
Sensor
Estimate

Keywords

  • Human computer interaction
  • Pose estimation
  • Wearable device

ASJC Scopus subject areas

  • Theoretical Computer Science
  • Computer Science(all)

Cite this

Ienaga, N., Kawai, W., Fujita, K., Miyata, N., Sugiura, Y., & Saito, H. (2019). A Thumb Tip Wearable Device Consisting of Multiple Cameras to Measure Thumb Posture. In G. Carneiro, & S. You (Eds.), Computer Vision – ACCV 2018 Workshops - 14th Asian Conference on Computer Vision, 2018, Revised Selected Papers (pp. 31-38). (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 11367 LNCS). Springer Verlag. https://doi.org/10.1007/978-3-030-21074-8_3

A Thumb Tip Wearable Device Consisting of Multiple Cameras to Measure Thumb Posture. / Ienaga, Naoto; Kawai, Wataru; Fujita, Koji; Miyata, Natsuki; Sugiura, Yuta; Saito, Hideo.

Computer Vision – ACCV 2018 Workshops - 14th Asian Conference on Computer Vision, 2018, Revised Selected Papers. ed. / Gustavo Carneiro; Shaodi You. Springer Verlag, 2019. p. 31-38 (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 11367 LNCS).

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Ienaga, N, Kawai, W, Fujita, K, Miyata, N, Sugiura, Y & Saito, H 2019, A Thumb Tip Wearable Device Consisting of Multiple Cameras to Measure Thumb Posture. in G Carneiro & S You (eds), Computer Vision – ACCV 2018 Workshops - 14th Asian Conference on Computer Vision, 2018, Revised Selected Papers. Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), vol. 11367 LNCS, Springer Verlag, pp. 31-38, 14th Asian Conference on Computer Vision, ACCV 2018, Perth, Australia, 18/12/2. https://doi.org/10.1007/978-3-030-21074-8_3
Ienaga N, Kawai W, Fujita K, Miyata N, Sugiura Y, Saito H. A Thumb Tip Wearable Device Consisting of Multiple Cameras to Measure Thumb Posture. In Carneiro G, You S, editors, Computer Vision – ACCV 2018 Workshops - 14th Asian Conference on Computer Vision, 2018, Revised Selected Papers. Springer Verlag. 2019. p. 31-38. (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)). https://doi.org/10.1007/978-3-030-21074-8_3
Ienaga, Naoto ; Kawai, Wataru ; Fujita, Koji ; Miyata, Natsuki ; Sugiura, Yuta ; Saito, Hideo. / A Thumb Tip Wearable Device Consisting of Multiple Cameras to Measure Thumb Posture. Computer Vision – ACCV 2018 Workshops - 14th Asian Conference on Computer Vision, 2018, Revised Selected Papers. editor / Gustavo Carneiro ; Shaodi You. Springer Verlag, 2019. pp. 31-38 (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)).
@inproceedings{f74633f22206494db549f7e59445e8d8,
title = "A Thumb Tip Wearable Device Consisting of Multiple Cameras to Measure Thumb Posture",
abstract = "Today, cameras have become smaller and cheaper and can be utilized in various scenes. We took advantage of that to develop a thumb tip wearable device to estimate joint angles of a thumb as measuring human finger postures is important in terms of human-computer interface and to analyze human behavior. The device we developed consists of three small cameras attached at different angles so the cameras can capture the four fingers. We assumed that the appearance of the four fingers would change depending on the joint angles of the thumb. We made a convolutional neural network learn a regression relationship between the joint angles of the thumb and the images taken by the cameras. In this paper, we captured the keypoint positions of the thumb with a USB sensor device and calculated the joint angles to construct a dataset. The root mean squared error of the test data was 6.23° and 4.75° .",
keywords = "Human computer interaction, Pose estimation, Wearable device",
author = "Naoto Ienaga and Wataru Kawai and Koji Fujita and Natsuki Miyata and Yuta Sugiura and Hideo Saito",
year = "2019",
month = "1",
day = "1",
doi = "10.1007/978-3-030-21074-8_3",
language = "English",
isbn = "9783030210731",
series = "Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)",
publisher = "Springer Verlag",
pages = "31--38",
editor = "Gustavo Carneiro and Shaodi You",
booktitle = "Computer Vision – ACCV 2018 Workshops - 14th Asian Conference on Computer Vision, 2018, Revised Selected Papers",
address = "Germany",

}

TY - GEN

T1 - A Thumb Tip Wearable Device Consisting of Multiple Cameras to Measure Thumb Posture

AU - Ienaga, Naoto

AU - Kawai, Wataru

AU - Fujita, Koji

AU - Miyata, Natsuki

AU - Sugiura, Yuta

AU - Saito, Hideo

PY - 2019/1/1

Y1 - 2019/1/1

N2 - Today, cameras have become smaller and cheaper and can be utilized in various scenes. We took advantage of that to develop a thumb tip wearable device to estimate joint angles of a thumb as measuring human finger postures is important in terms of human-computer interface and to analyze human behavior. The device we developed consists of three small cameras attached at different angles so the cameras can capture the four fingers. We assumed that the appearance of the four fingers would change depending on the joint angles of the thumb. We made a convolutional neural network learn a regression relationship between the joint angles of the thumb and the images taken by the cameras. In this paper, we captured the keypoint positions of the thumb with a USB sensor device and calculated the joint angles to construct a dataset. The root mean squared error of the test data was 6.23° and 4.75° .

AB - Today, cameras have become smaller and cheaper and can be utilized in various scenes. We took advantage of that to develop a thumb tip wearable device to estimate joint angles of a thumb as measuring human finger postures is important in terms of human-computer interface and to analyze human behavior. The device we developed consists of three small cameras attached at different angles so the cameras can capture the four fingers. We assumed that the appearance of the four fingers would change depending on the joint angles of the thumb. We made a convolutional neural network learn a regression relationship between the joint angles of the thumb and the images taken by the cameras. In this paper, we captured the keypoint positions of the thumb with a USB sensor device and calculated the joint angles to construct a dataset. The root mean squared error of the test data was 6.23° and 4.75° .

KW - Human computer interaction

KW - Pose estimation

KW - Wearable device

UR - http://www.scopus.com/inward/record.url?scp=85068437647&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85068437647&partnerID=8YFLogxK

U2 - 10.1007/978-3-030-21074-8_3

DO - 10.1007/978-3-030-21074-8_3

M3 - Conference contribution

AN - SCOPUS:85068437647

SN - 9783030210731

T3 - Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

SP - 31

EP - 38

BT - Computer Vision – ACCV 2018 Workshops - 14th Asian Conference on Computer Vision, 2018, Revised Selected Papers

A2 - Carneiro, Gustavo

A2 - You, Shaodi

PB - Springer Verlag

ER -