Visually Analyzing Universal Quantifiers in Photograph Captions

Yuri Sato, Koji Mineshima

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

Universal quantifiers have been the subject of much work in symbolic and diagrammatic logic. However, little attention is paid to the question of how they can be visually grounded, that is, depicted in real images such as photographs. To investigate this question, we focus on universal quantifiers such as “all” and “every” used in an image captioning dataset and present a qualitative analysis of these expressions. The analysis revealed that although the use of universal quantifiers in image captions is rare, there are interesting patterns in their usage in terms of the semantics of visual representations. We distinguish two ways in which universal quantifiers are used in image captions. One is object-based quantification, which involves quantification over multiple discrete objects in a definite domain. The other is region-based quantification, where some property is ascribed to a salient continuous region in an image. We compare these two ways of visually representing universal quantification with two major representation systems studied in diagrammatic logic.

Original languageEnglish
Title of host publicationDiagrammatic Representation and Inference - 13th International Conference, Diagrams 2022, Proceedings
EditorsValeria Giardino, Sven Linker, Richard Burns, Francesco Bellucci, Jean-Michel Boucheix, Petrucio Viana
PublisherSpringer Science and Business Media Deutschland GmbH
Pages373-377
Number of pages5
ISBN (Print)9783031151453
DOIs
Publication statusPublished - 2022
Event13th International Conference on Theory and Application of Diagrams, Diagrams 2022, co-located with the IEEE Symposium on Visual Languages and Human-Centric Computing, VL/HCC 2022 - Rome, Italy
Duration: 2022 Sep 132022 Sep 17

Publication series

NameLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Volume13462 LNAI
ISSN (Print)0302-9743
ISSN (Electronic)1611-3349

Conference

Conference13th International Conference on Theory and Application of Diagrams, Diagrams 2022, co-located with the IEEE Symposium on Visual Languages and Human-Centric Computing, VL/HCC 2022
Country/TerritoryItaly
CityRome
Period22/9/1322/9/17

Keywords

  • Grounding
  • Image caption
  • Object
  • Photograph
  • Region
  • Universal quantifier
  • Visual representation

ASJC Scopus subject areas

  • Theoretical Computer Science
  • Computer Science(all)

Fingerprint

Dive into the research topics of 'Visually Analyzing Universal Quantifiers in Photograph Captions'. Together they form a unique fingerprint.

Cite this