Audio-Visual Hybrid Approach for Filling Mass Estimation

Reina Ishikawa; Yuichi Nagao; Ryo Hachiuma; Hideo Saito

doi:10.1007/978-3-030-68793-9_32

Audio-Visual Hybrid Approach for Filling Mass Estimation

Reina Ishikawa, Yuichi Nagao, Ryo Hachiuma, Hideo Saito

情報工学科

研究成果: Conference contribution

抄録

Object handover is a fundamental and essential capability for robots interacting with humans in many applications such as household chores. In this challenge, we estimate the physical properties of a variety of containers with different fillings such as container capacity and the type and percentage of the content to achieve collaborative physical handover between humans and robots. We introduce multi-modal prediction models using audio-visual-datasets of people interacting with containers distributed by CORSMAL.

本文言語	English
ホスト出版物のタイトル	Pattern Recognition. ICPR International Workshops and Challenges, 2021, Proceedings
編集者	Alberto Del Bimbo, Rita Cucchiara, Stan Sclaroff, Giovanni Maria Farinella, Tao Mei, Marco Bertini, Hugo Jair Escalante, Roberto Vezzani
出版社	Springer Science and Business Media Deutschland GmbH
ページ	437-450
ページ数	14
ISBN（印刷版）	9783030687922
DOI	https://doi.org/10.1007/978-3-030-68793-9_32
出版ステータス	Published - 2021
イベント	25th International Conference on Pattern Recognition Workshops, ICPR 2020 - Milan, Italy 継続期間: 2021 1 10 → 2021 1 11

出版物シリーズ

名前	Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
巻	12668 LNCS
ISSN（印刷版）	0302-9743
ISSN（電子版）	1611-3349

Conference

Conference	25th International Conference on Pattern Recognition Workshops, ICPR 2020
国/地域	Italy
City	Milan
Period	21/1/10 → 21/1/11

ASJC Scopus subject areas

理論的コンピュータサイエンス
コンピュータサイエンス（全般）

文献へのアクセス

10.1007/978-3-030-68793-9_32

他のファイルとリンク

引用スタイル

Ishikawa, R., Nagao, Y., Hachiuma, R., & Saito, H. (2021). Audio-Visual Hybrid Approach for Filling Mass Estimation. In A. Del Bimbo, R. Cucchiara, S. Sclaroff, G. M. Farinella, T. Mei, M. Bertini, H. J. Escalante, & R. Vezzani (Eds.), Pattern Recognition. ICPR International Workshops and Challenges, 2021, Proceedings (pp. 437-450). (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 12668 LNCS). Springer Science and Business Media Deutschland GmbH. https://doi.org/10.1007/978-3-030-68793-9_32

Audio-Visual Hybrid Approach for Filling Mass Estimation. / Ishikawa, Reina; Nagao, Yuichi; Hachiuma, Ryo; Saito, Hideo.

Pattern Recognition. ICPR International Workshops and Challenges, 2021, Proceedings. ed. / Alberto Del Bimbo; Rita Cucchiara; Stan Sclaroff; Giovanni Maria Farinella; Tao Mei; Marco Bertini; Hugo Jair Escalante; Roberto Vezzani. Springer Science and Business Media Deutschland GmbH, 2021. p. 437-450 (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 12668 LNCS).

研究成果: Conference contribution

Ishikawa, R, Nagao, Y, Hachiuma, R & Saito, H 2021, Audio-Visual Hybrid Approach for Filling Mass Estimation. in A Del Bimbo, R Cucchiara, S Sclaroff, GM Farinella, T Mei, M Bertini, HJ Escalante & R Vezzani (eds), Pattern Recognition. ICPR International Workshops and Challenges, 2021, Proceedings. Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), vol. 12668 LNCS, Springer Science and Business Media Deutschland GmbH, pp. 437-450, 25th International Conference on Pattern Recognition Workshops, ICPR 2020, Milan, Italy, 21/1/10. https://doi.org/10.1007/978-3-030-68793-9_32

Ishikawa R, Nagao Y, Hachiuma R, Saito H. Audio-Visual Hybrid Approach for Filling Mass Estimation. In Del Bimbo A, Cucchiara R, Sclaroff S, Farinella GM, Mei T, Bertini M, Escalante HJ, Vezzani R, editors, Pattern Recognition. ICPR International Workshops and Challenges, 2021, Proceedings. Springer Science and Business Media Deutschland GmbH. 2021. p. 437-450. (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)). https://doi.org/10.1007/978-3-030-68793-9_32

Ishikawa, Reina ; Nagao, Yuichi ; Hachiuma, Ryo ; Saito, Hideo. / Audio-Visual Hybrid Approach for Filling Mass Estimation. Pattern Recognition. ICPR International Workshops and Challenges, 2021, Proceedings. editor / Alberto Del Bimbo ; Rita Cucchiara ; Stan Sclaroff ; Giovanni Maria Farinella ; Tao Mei ; Marco Bertini ; Hugo Jair Escalante ; Roberto Vezzani. Springer Science and Business Media Deutschland GmbH, 2021. pp. 437-450 (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)).

@inproceedings{14b6463c4588403db6128e78fbc3f113,

title = "Audio-Visual Hybrid Approach for Filling Mass Estimation",

abstract = "Object handover is a fundamental and essential capability for robots interacting with humans in many applications such as household chores. In this challenge, we estimate the physical properties of a variety of containers with different fillings such as container capacity and the type and percentage of the content to achieve collaborative physical handover between humans and robots. We introduce multi-modal prediction models using audio-visual-datasets of people interacting with containers distributed by CORSMAL.",

keywords = "Audio classification, Log-Mel spectrogram, Mass estimation",

author = "Reina Ishikawa and Yuichi Nagao and Ryo Hachiuma and Hideo Saito",

note = "Publisher Copyright: {\textcopyright} 2021, Springer Nature Switzerland AG.; 25th International Conference on Pattern Recognition Workshops, ICPR 2020 ; Conference date: 10-01-2021 Through 11-01-2021",

year = "2021",

doi = "10.1007/978-3-030-68793-9_32",

language = "English",

isbn = "9783030687922",

series = "Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)",

publisher = "Springer Science and Business Media Deutschland GmbH",

pages = "437--450",

editor = "{Del Bimbo}, Alberto and Rita Cucchiara and Stan Sclaroff and Farinella, {Giovanni Maria} and Tao Mei and Marco Bertini and Escalante, {Hugo Jair} and Roberto Vezzani",

booktitle = "Pattern Recognition. ICPR International Workshops and Challenges, 2021, Proceedings",

}

TY - GEN

T1 - Audio-Visual Hybrid Approach for Filling Mass Estimation

AU - Ishikawa, Reina

AU - Nagao, Yuichi

AU - Hachiuma, Ryo

AU - Saito, Hideo

PY - 2021

Y1 - 2021

N2 - Object handover is a fundamental and essential capability for robots interacting with humans in many applications such as household chores. In this challenge, we estimate the physical properties of a variety of containers with different fillings such as container capacity and the type and percentage of the content to achieve collaborative physical handover between humans and robots. We introduce multi-modal prediction models using audio-visual-datasets of people interacting with containers distributed by CORSMAL.

AB - Object handover is a fundamental and essential capability for robots interacting with humans in many applications such as household chores. In this challenge, we estimate the physical properties of a variety of containers with different fillings such as container capacity and the type and percentage of the content to achieve collaborative physical handover between humans and robots. We introduce multi-modal prediction models using audio-visual-datasets of people interacting with containers distributed by CORSMAL.

KW - Audio classification

KW - Log-Mel spectrogram

KW - Mass estimation

UR - http://www.scopus.com/inward/record.url?scp=85104415770&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85104415770&partnerID=8YFLogxK

U2 - 10.1007/978-3-030-68793-9_32

DO - 10.1007/978-3-030-68793-9_32

M3 - Conference contribution

AN - SCOPUS:85104415770

SN - 9783030687922

T3 - Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

SP - 437

EP - 450

BT - Pattern Recognition. ICPR International Workshops and Challenges, 2021, Proceedings

A2 - Del Bimbo, Alberto

A2 - Cucchiara, Rita

A2 - Sclaroff, Stan

A2 - Farinella, Giovanni Maria

A2 - Mei, Tao

A2 - Bertini, Marco

A2 - Escalante, Hugo Jair

A2 - Vezzani, Roberto

PB - Springer Science and Business Media Deutschland GmbH

T2 - 25th International Conference on Pattern Recognition Workshops, ICPR 2020

Y2 - 10 January 2021 through 11 January 2021

ER -

Audio-Visual Hybrid Approach for Filling Mass Estimation

抄録

出版物シリーズ

Conference

ASJC Scopus subject areas

文献へのアクセス

他のファイルとリンク

フィンガープリント

引用スタイル