Human state estimation system implemented in an Office Deployable Getaway based on multiple bio information

Sayaka Nakaso, Jörg Güttler, Akira Mita, Thomas Bock

Research output: Chapter in Book/Report/Conference proceedingConference contribution

1 Citation (Scopus)

Abstract

This article is proposing a human state estimation system on the basis of multiple bio information implemented into a movable cover chair called "Office Deployable Getaway". The proposed system consists of 2 sub-systems; the first sub-system analyzes fatigue based on eye movement including blinking rate and eye closure time while the second sub-system analyzes breath frequency. These indicators are detected by applying image processing to IR images, using the Microsoft Kinect sensor. Hardware tests were conducted to determine the proper Microsoft Kinect (Kinect V1 or Kinect V2) and its position inside the chair to efficiently detect eye movement and respiration. The experimental results showed that these bio information could be measured appropriately under the condition that the Kinect V2 was set at the eye level opposite from the user. Based on the result, the implementation of the proposed system into the chair was carried out, installing the Kinect and a personal computer at appropriate positions. Finally, this system was tested in a real environment with test person sitting inside the chair; after the fatigue is analyzed over eye movement, breath frequency is analyzed. The results of these analyzations are indicated in the computer screen. This performance test showed that this system could be feasible for the realistic use. For future development, the authors will focus on audio system that triggers proper music based on estimated human state, which will be implemented into this chair.

Original languageEnglish
Title of host publicationISARC 2016 - 33rd International Symposium on Automation and Robotics in Construction
PublisherInternational Association for Automation and Robotics in Construction I.A.A.R.C)
Pages572-580
Number of pages9
Publication statusPublished - 2016
Event33rd International Symposium on Automation and Robotics in Construction, ISARC 2016 - Auburn, United States
Duration: 2016 Jul 182016 Jul 21

Other

Other33rd International Symposium on Automation and Robotics in Construction, ISARC 2016
CountryUnited States
CityAuburn
Period16/7/1816/7/21

Fingerprint

Eye movements
State estimation
Fatigue of materials
Audio systems
fatigue
Personal computers
Image processing
music
Hardware
image processing
hardware
Sensors
respiration
sensor
test

Keywords

  • Ambient Assisted Living
  • Breath Detection
  • Eye Recognition
  • Fatigue Analyzation
  • Human Mood
  • Human-Machine-Interaction

ASJC Scopus subject areas

  • Artificial Intelligence
  • Civil and Structural Engineering
  • Human-Computer Interaction
  • Geotechnical Engineering and Engineering Geology

Cite this

Nakaso, S., Güttler, J., Mita, A., & Bock, T. (2016). Human state estimation system implemented in an Office Deployable Getaway based on multiple bio information. In ISARC 2016 - 33rd International Symposium on Automation and Robotics in Construction (pp. 572-580). International Association for Automation and Robotics in Construction I.A.A.R.C).

Human state estimation system implemented in an Office Deployable Getaway based on multiple bio information. / Nakaso, Sayaka; Güttler, Jörg; Mita, Akira; Bock, Thomas.

ISARC 2016 - 33rd International Symposium on Automation and Robotics in Construction. International Association for Automation and Robotics in Construction I.A.A.R.C), 2016. p. 572-580.

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Nakaso, S, Güttler, J, Mita, A & Bock, T 2016, Human state estimation system implemented in an Office Deployable Getaway based on multiple bio information. in ISARC 2016 - 33rd International Symposium on Automation and Robotics in Construction. International Association for Automation and Robotics in Construction I.A.A.R.C), pp. 572-580, 33rd International Symposium on Automation and Robotics in Construction, ISARC 2016, Auburn, United States, 16/7/18.
Nakaso S, Güttler J, Mita A, Bock T. Human state estimation system implemented in an Office Deployable Getaway based on multiple bio information. In ISARC 2016 - 33rd International Symposium on Automation and Robotics in Construction. International Association for Automation and Robotics in Construction I.A.A.R.C). 2016. p. 572-580
Nakaso, Sayaka ; Güttler, Jörg ; Mita, Akira ; Bock, Thomas. / Human state estimation system implemented in an Office Deployable Getaway based on multiple bio information. ISARC 2016 - 33rd International Symposium on Automation and Robotics in Construction. International Association for Automation and Robotics in Construction I.A.A.R.C), 2016. pp. 572-580
@inproceedings{ff97bb907ca94f68a7aafb933e8b4f23,
title = "Human state estimation system implemented in an Office Deployable Getaway based on multiple bio information",
abstract = "This article is proposing a human state estimation system on the basis of multiple bio information implemented into a movable cover chair called {"}Office Deployable Getaway{"}. The proposed system consists of 2 sub-systems; the first sub-system analyzes fatigue based on eye movement including blinking rate and eye closure time while the second sub-system analyzes breath frequency. These indicators are detected by applying image processing to IR images, using the Microsoft Kinect sensor. Hardware tests were conducted to determine the proper Microsoft Kinect (Kinect V1 or Kinect V2) and its position inside the chair to efficiently detect eye movement and respiration. The experimental results showed that these bio information could be measured appropriately under the condition that the Kinect V2 was set at the eye level opposite from the user. Based on the result, the implementation of the proposed system into the chair was carried out, installing the Kinect and a personal computer at appropriate positions. Finally, this system was tested in a real environment with test person sitting inside the chair; after the fatigue is analyzed over eye movement, breath frequency is analyzed. The results of these analyzations are indicated in the computer screen. This performance test showed that this system could be feasible for the realistic use. For future development, the authors will focus on audio system that triggers proper music based on estimated human state, which will be implemented into this chair.",
keywords = "Ambient Assisted Living, Breath Detection, Eye Recognition, Fatigue Analyzation, Human Mood, Human-Machine-Interaction",
author = "Sayaka Nakaso and J{\"o}rg G{\"u}ttler and Akira Mita and Thomas Bock",
year = "2016",
language = "English",
pages = "572--580",
booktitle = "ISARC 2016 - 33rd International Symposium on Automation and Robotics in Construction",
publisher = "International Association for Automation and Robotics in Construction I.A.A.R.C)",

}

TY - GEN

T1 - Human state estimation system implemented in an Office Deployable Getaway based on multiple bio information

AU - Nakaso, Sayaka

AU - Güttler, Jörg

AU - Mita, Akira

AU - Bock, Thomas

PY - 2016

Y1 - 2016

N2 - This article is proposing a human state estimation system on the basis of multiple bio information implemented into a movable cover chair called "Office Deployable Getaway". The proposed system consists of 2 sub-systems; the first sub-system analyzes fatigue based on eye movement including blinking rate and eye closure time while the second sub-system analyzes breath frequency. These indicators are detected by applying image processing to IR images, using the Microsoft Kinect sensor. Hardware tests were conducted to determine the proper Microsoft Kinect (Kinect V1 or Kinect V2) and its position inside the chair to efficiently detect eye movement and respiration. The experimental results showed that these bio information could be measured appropriately under the condition that the Kinect V2 was set at the eye level opposite from the user. Based on the result, the implementation of the proposed system into the chair was carried out, installing the Kinect and a personal computer at appropriate positions. Finally, this system was tested in a real environment with test person sitting inside the chair; after the fatigue is analyzed over eye movement, breath frequency is analyzed. The results of these analyzations are indicated in the computer screen. This performance test showed that this system could be feasible for the realistic use. For future development, the authors will focus on audio system that triggers proper music based on estimated human state, which will be implemented into this chair.

AB - This article is proposing a human state estimation system on the basis of multiple bio information implemented into a movable cover chair called "Office Deployable Getaway". The proposed system consists of 2 sub-systems; the first sub-system analyzes fatigue based on eye movement including blinking rate and eye closure time while the second sub-system analyzes breath frequency. These indicators are detected by applying image processing to IR images, using the Microsoft Kinect sensor. Hardware tests were conducted to determine the proper Microsoft Kinect (Kinect V1 or Kinect V2) and its position inside the chair to efficiently detect eye movement and respiration. The experimental results showed that these bio information could be measured appropriately under the condition that the Kinect V2 was set at the eye level opposite from the user. Based on the result, the implementation of the proposed system into the chair was carried out, installing the Kinect and a personal computer at appropriate positions. Finally, this system was tested in a real environment with test person sitting inside the chair; after the fatigue is analyzed over eye movement, breath frequency is analyzed. The results of these analyzations are indicated in the computer screen. This performance test showed that this system could be feasible for the realistic use. For future development, the authors will focus on audio system that triggers proper music based on estimated human state, which will be implemented into this chair.

KW - Ambient Assisted Living

KW - Breath Detection

KW - Eye Recognition

KW - Fatigue Analyzation

KW - Human Mood

KW - Human-Machine-Interaction

UR - http://www.scopus.com/inward/record.url?scp=84994338854&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84994338854&partnerID=8YFLogxK

M3 - Conference contribution

AN - SCOPUS:84994338854

SP - 572

EP - 580

BT - ISARC 2016 - 33rd International Symposium on Automation and Robotics in Construction

PB - International Association for Automation and Robotics in Construction I.A.A.R.C)

ER -