Facial Landmark Activity Features for Depression Screening

Brian Sumali, Yasue Mitsukura, Yuuki Tazawa, Taishiro Kishimoto

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

Depression is the most common mood disorder in the world which is also the leading cause of suicide. Depression might be diagnosed using varying modalities, as it affects many aspects of the patient, not only the patient will appear melancholic, but the patient's sleep quality and life quality might also be disrupted. In this study, we aim to extract facial landmark features unique to depression patients and build a machine learning model to classify the depression severity. The facial landmark activities considered in this study include: speed statistics of the landmarks, the standard deviation of eye pupils, and statistical features of mouth area. We found several facial landmark activity features with significant differences between healthy volunteers and depressed patients. We also successfully built machine learning models for automatic depression severity prediction.

Original languageEnglish
Title of host publication2019 58th Annual Conference of the Society of Instrument and Control Engineers of Japan, SICE 2019
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages1376-1381
Number of pages6
ISBN (Electronic)9784907764678
DOIs
Publication statusPublished - 2019 Sep
Event58th Annual Conference of the Society of Instrument and Control Engineers of Japan, SICE 2019 - Hiroshima, Japan
Duration: 2019 Sep 102019 Sep 13

Publication series

Name2019 58th Annual Conference of the Society of Instrument and Control Engineers of Japan, SICE 2019

Conference

Conference58th Annual Conference of the Society of Instrument and Control Engineers of Japan, SICE 2019
CountryJapan
CityHiroshima
Period19/9/1019/9/13

Fingerprint

landmarks
Landmarks
Screening
Learning systems
screening
machine learning
Statistics
Machine Learning
moods
sleep
Mood
mouth
Sleep
pupils
Standard deviation
Modality
Disorder
standard deviation
Classify
statistics

Keywords

  • Automatic diagnosis
  • Depression
  • Facial features
  • Machine learning

ASJC Scopus subject areas

  • Artificial Intelligence
  • Industrial and Manufacturing Engineering
  • Safety, Risk, Reliability and Quality
  • Control and Optimization
  • Instrumentation

Cite this

Sumali, B., Mitsukura, Y., Tazawa, Y., & Kishimoto, T. (2019). Facial Landmark Activity Features for Depression Screening. In 2019 58th Annual Conference of the Society of Instrument and Control Engineers of Japan, SICE 2019 (pp. 1376-1381). [8859798] (2019 58th Annual Conference of the Society of Instrument and Control Engineers of Japan, SICE 2019). Institute of Electrical and Electronics Engineers Inc.. https://doi.org/10.23919/SICE.2019.8859798

Facial Landmark Activity Features for Depression Screening. / Sumali, Brian; Mitsukura, Yasue; Tazawa, Yuuki; Kishimoto, Taishiro.

2019 58th Annual Conference of the Society of Instrument and Control Engineers of Japan, SICE 2019. Institute of Electrical and Electronics Engineers Inc., 2019. p. 1376-1381 8859798 (2019 58th Annual Conference of the Society of Instrument and Control Engineers of Japan, SICE 2019).

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Sumali, B, Mitsukura, Y, Tazawa, Y & Kishimoto, T 2019, Facial Landmark Activity Features for Depression Screening. in 2019 58th Annual Conference of the Society of Instrument and Control Engineers of Japan, SICE 2019., 8859798, 2019 58th Annual Conference of the Society of Instrument and Control Engineers of Japan, SICE 2019, Institute of Electrical and Electronics Engineers Inc., pp. 1376-1381, 58th Annual Conference of the Society of Instrument and Control Engineers of Japan, SICE 2019, Hiroshima, Japan, 19/9/10. https://doi.org/10.23919/SICE.2019.8859798
Sumali B, Mitsukura Y, Tazawa Y, Kishimoto T. Facial Landmark Activity Features for Depression Screening. In 2019 58th Annual Conference of the Society of Instrument and Control Engineers of Japan, SICE 2019. Institute of Electrical and Electronics Engineers Inc. 2019. p. 1376-1381. 8859798. (2019 58th Annual Conference of the Society of Instrument and Control Engineers of Japan, SICE 2019). https://doi.org/10.23919/SICE.2019.8859798
Sumali, Brian ; Mitsukura, Yasue ; Tazawa, Yuuki ; Kishimoto, Taishiro. / Facial Landmark Activity Features for Depression Screening. 2019 58th Annual Conference of the Society of Instrument and Control Engineers of Japan, SICE 2019. Institute of Electrical and Electronics Engineers Inc., 2019. pp. 1376-1381 (2019 58th Annual Conference of the Society of Instrument and Control Engineers of Japan, SICE 2019).
@inproceedings{c18b3586c1f9431a80388adca02fa7b9,
title = "Facial Landmark Activity Features for Depression Screening",
abstract = "Depression is the most common mood disorder in the world which is also the leading cause of suicide. Depression might be diagnosed using varying modalities, as it affects many aspects of the patient, not only the patient will appear melancholic, but the patient's sleep quality and life quality might also be disrupted. In this study, we aim to extract facial landmark features unique to depression patients and build a machine learning model to classify the depression severity. The facial landmark activities considered in this study include: speed statistics of the landmarks, the standard deviation of eye pupils, and statistical features of mouth area. We found several facial landmark activity features with significant differences between healthy volunteers and depressed patients. We also successfully built machine learning models for automatic depression severity prediction.",
keywords = "Automatic diagnosis, Depression, Facial features, Machine learning",
author = "Brian Sumali and Yasue Mitsukura and Yuuki Tazawa and Taishiro Kishimoto",
year = "2019",
month = "9",
doi = "10.23919/SICE.2019.8859798",
language = "English",
series = "2019 58th Annual Conference of the Society of Instrument and Control Engineers of Japan, SICE 2019",
publisher = "Institute of Electrical and Electronics Engineers Inc.",
pages = "1376--1381",
booktitle = "2019 58th Annual Conference of the Society of Instrument and Control Engineers of Japan, SICE 2019",

}

TY - GEN

T1 - Facial Landmark Activity Features for Depression Screening

AU - Sumali, Brian

AU - Mitsukura, Yasue

AU - Tazawa, Yuuki

AU - Kishimoto, Taishiro

PY - 2019/9

Y1 - 2019/9

N2 - Depression is the most common mood disorder in the world which is also the leading cause of suicide. Depression might be diagnosed using varying modalities, as it affects many aspects of the patient, not only the patient will appear melancholic, but the patient's sleep quality and life quality might also be disrupted. In this study, we aim to extract facial landmark features unique to depression patients and build a machine learning model to classify the depression severity. The facial landmark activities considered in this study include: speed statistics of the landmarks, the standard deviation of eye pupils, and statistical features of mouth area. We found several facial landmark activity features with significant differences between healthy volunteers and depressed patients. We also successfully built machine learning models for automatic depression severity prediction.

AB - Depression is the most common mood disorder in the world which is also the leading cause of suicide. Depression might be diagnosed using varying modalities, as it affects many aspects of the patient, not only the patient will appear melancholic, but the patient's sleep quality and life quality might also be disrupted. In this study, we aim to extract facial landmark features unique to depression patients and build a machine learning model to classify the depression severity. The facial landmark activities considered in this study include: speed statistics of the landmarks, the standard deviation of eye pupils, and statistical features of mouth area. We found several facial landmark activity features with significant differences between healthy volunteers and depressed patients. We also successfully built machine learning models for automatic depression severity prediction.

KW - Automatic diagnosis

KW - Depression

KW - Facial features

KW - Machine learning

UR - http://www.scopus.com/inward/record.url?scp=85073875328&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85073875328&partnerID=8YFLogxK

U2 - 10.23919/SICE.2019.8859798

DO - 10.23919/SICE.2019.8859798

M3 - Conference contribution

AN - SCOPUS:85073875328

T3 - 2019 58th Annual Conference of the Society of Instrument and Control Engineers of Japan, SICE 2019

SP - 1376

EP - 1381

BT - 2019 58th Annual Conference of the Society of Instrument and Control Engineers of Japan, SICE 2019

PB - Institute of Electrical and Electronics Engineers Inc.

ER -