Facial Landmark Activity Features for Depression Screening

Brian Sumali; Yasue Mitsukura; Yuuki Tazawa; Taishiro Kishimoto

doi:10.23919/SICE.2019.8859798

Facial Landmark Activity Features for Depression Screening

Brian Sumali, Yasue Mitsukura, Yuuki Tazawa, Taishiro Kishimoto

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

Abstract

Depression is the most common mood disorder in the world which is also the leading cause of suicide. Depression might be diagnosed using varying modalities, as it affects many aspects of the patient, not only the patient will appear melancholic, but the patient's sleep quality and life quality might also be disrupted. In this study, we aim to extract facial landmark features unique to depression patients and build a machine learning model to classify the depression severity. The facial landmark activities considered in this study include: speed statistics of the landmarks, the standard deviation of eye pupils, and statistical features of mouth area. We found several facial landmark activity features with significant differences between healthy volunteers and depressed patients. We also successfully built machine learning models for automatic depression severity prediction.

Original language	English
Title of host publication	2019 58th Annual Conference of the Society of Instrument and Control Engineers of Japan, SICE 2019
Publisher	Institute of Electrical and Electronics Engineers Inc.
Pages	1376-1381
Number of pages	6
ISBN (Electronic)	9784907764678
DOIs	https://doi.org/10.23919/SICE.2019.8859798
Publication status	Published - 2019 Sep
Event	58th Annual Conference of the Society of Instrument and Control Engineers of Japan, SICE 2019 - Hiroshima, Japan Duration: 2019 Sep 10 → 2019 Sep 13

Publication series

Name	2019 58th Annual Conference of the Society of Instrument and Control Engineers of Japan, SICE 2019

Conference

Conference	58th Annual Conference of the Society of Instrument and Control Engineers of Japan, SICE 2019
Country	Japan
City	Hiroshima
Period	19/9/10 → 19/9/13

Keywords

Automatic diagnosis
Depression
Facial features
Machine learning

ASJC Scopus subject areas

Artificial Intelligence
Industrial and Manufacturing Engineering
Safety, Risk, Reliability and Quality
Control and Optimization
Instrumentation

Access to Document

10.23919/SICE.2019.8859798

Fingerprint Dive into the research topics of 'Facial Landmark Activity Features for Depression Screening'. Together they form a unique fingerprint.

Cite this

Sumali, B., Mitsukura, Y., Tazawa, Y., & Kishimoto, T. (2019). Facial Landmark Activity Features for Depression Screening. In 2019 58th Annual Conference of the Society of Instrument and Control Engineers of Japan, SICE 2019 (pp. 1376-1381). [8859798] (2019 58th Annual Conference of the Society of Instrument and Control Engineers of Japan, SICE 2019). Institute of Electrical and Electronics Engineers Inc.. https://doi.org/10.23919/SICE.2019.8859798

Facial Landmark Activity Features for Depression Screening. / Sumali, Brian; Mitsukura, Yasue; Tazawa, Yuuki; Kishimoto, Taishiro.

2019 58th Annual Conference of the Society of Instrument and Control Engineers of Japan, SICE 2019. Institute of Electrical and Electronics Engineers Inc., 2019. p. 1376-1381 8859798 (2019 58th Annual Conference of the Society of Instrument and Control Engineers of Japan, SICE 2019).

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

Sumali, B, Mitsukura, Y, Tazawa, Y & Kishimoto, T 2019, Facial Landmark Activity Features for Depression Screening. in 2019 58th Annual Conference of the Society of Instrument and Control Engineers of Japan, SICE 2019., 8859798, 2019 58th Annual Conference of the Society of Instrument and Control Engineers of Japan, SICE 2019, Institute of Electrical and Electronics Engineers Inc., pp. 1376-1381, 58th Annual Conference of the Society of Instrument and Control Engineers of Japan, SICE 2019, Hiroshima, Japan, 19/9/10. https://doi.org/10.23919/SICE.2019.8859798

Sumali B, Mitsukura Y, Tazawa Y, Kishimoto T. Facial Landmark Activity Features for Depression Screening. In 2019 58th Annual Conference of the Society of Instrument and Control Engineers of Japan, SICE 2019. Institute of Electrical and Electronics Engineers Inc. 2019. p. 1376-1381. 8859798. (2019 58th Annual Conference of the Society of Instrument and Control Engineers of Japan, SICE 2019). https://doi.org/10.23919/SICE.2019.8859798

Sumali, Brian ; Mitsukura, Yasue ; Tazawa, Yuuki ; Kishimoto, Taishiro. / Facial Landmark Activity Features for Depression Screening. 2019 58th Annual Conference of the Society of Instrument and Control Engineers of Japan, SICE 2019. Institute of Electrical and Electronics Engineers Inc., 2019. pp. 1376-1381 (2019 58th Annual Conference of the Society of Instrument and Control Engineers of Japan, SICE 2019).

@inproceedings{c18b3586c1f9431a80388adca02fa7b9,

title = "Facial Landmark Activity Features for Depression Screening",

abstract = "Depression is the most common mood disorder in the world which is also the leading cause of suicide. Depression might be diagnosed using varying modalities, as it affects many aspects of the patient, not only the patient will appear melancholic, but the patient's sleep quality and life quality might also be disrupted. In this study, we aim to extract facial landmark features unique to depression patients and build a machine learning model to classify the depression severity. The facial landmark activities considered in this study include: speed statistics of the landmarks, the standard deviation of eye pupils, and statistical features of mouth area. We found several facial landmark activity features with significant differences between healthy volunteers and depressed patients. We also successfully built machine learning models for automatic depression severity prediction.",

keywords = "Automatic diagnosis, Depression, Facial features, Machine learning",

author = "Brian Sumali and Yasue Mitsukura and Yuuki Tazawa and Taishiro Kishimoto",

year = "2019",

month = sep,

doi = "10.23919/SICE.2019.8859798",

language = "English",

series = "2019 58th Annual Conference of the Society of Instrument and Control Engineers of Japan, SICE 2019",

publisher = "Institute of Electrical and Electronics Engineers Inc.",

pages = "1376--1381",

booktitle = "2019 58th Annual Conference of the Society of Instrument and Control Engineers of Japan, SICE 2019",

note = "58th Annual Conference of the Society of Instrument and Control Engineers of Japan, SICE 2019 ; Conference date: 10-09-2019 Through 13-09-2019",

}

TY - GEN

T1 - Facial Landmark Activity Features for Depression Screening

AU - Sumali, Brian

AU - Mitsukura, Yasue

AU - Tazawa, Yuuki

AU - Kishimoto, Taishiro

PY - 2019/9

Y1 - 2019/9

N2 - Depression is the most common mood disorder in the world which is also the leading cause of suicide. Depression might be diagnosed using varying modalities, as it affects many aspects of the patient, not only the patient will appear melancholic, but the patient's sleep quality and life quality might also be disrupted. In this study, we aim to extract facial landmark features unique to depression patients and build a machine learning model to classify the depression severity. The facial landmark activities considered in this study include: speed statistics of the landmarks, the standard deviation of eye pupils, and statistical features of mouth area. We found several facial landmark activity features with significant differences between healthy volunteers and depressed patients. We also successfully built machine learning models for automatic depression severity prediction.

AB - Depression is the most common mood disorder in the world which is also the leading cause of suicide. Depression might be diagnosed using varying modalities, as it affects many aspects of the patient, not only the patient will appear melancholic, but the patient's sleep quality and life quality might also be disrupted. In this study, we aim to extract facial landmark features unique to depression patients and build a machine learning model to classify the depression severity. The facial landmark activities considered in this study include: speed statistics of the landmarks, the standard deviation of eye pupils, and statistical features of mouth area. We found several facial landmark activity features with significant differences between healthy volunteers and depressed patients. We also successfully built machine learning models for automatic depression severity prediction.

KW - Automatic diagnosis

KW - Depression

KW - Facial features

KW - Machine learning

UR - http://www.scopus.com/inward/record.url?scp=85073875328&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85073875328&partnerID=8YFLogxK

U2 - 10.23919/SICE.2019.8859798

DO - 10.23919/SICE.2019.8859798

M3 - Conference contribution

AN - SCOPUS:85073875328

T3 - 2019 58th Annual Conference of the Society of Instrument and Control Engineers of Japan, SICE 2019

SP - 1376

EP - 1381

BT - 2019 58th Annual Conference of the Society of Instrument and Control Engineers of Japan, SICE 2019

PB - Institute of Electrical and Electronics Engineers Inc.

T2 - 58th Annual Conference of the Society of Instrument and Control Engineers of Japan, SICE 2019

Y2 - 10 September 2019 through 13 September 2019

ER -