One-Shot Wayfinding Method for Blind People via OCR and Arrow Analysis with a 360-Degree Smartphone Camera

Yutaro Yamanaka, Seita Kayukawa, Hironobu Takagi, Yuichi Nagaoka, Yoshimune Hiratsuka, Satoshi Kurihara

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

We present a wayfinding method that assists blind people in determining the correct direction to a destination by taking a one-shot image. Signage is standard in public buildings and used to help visitors, but has little benefit for blind people. Our one-shot wayfinding method recognizes surrounding signage in all directions from an equirectangular image captured using a 360-degree smartphone camera. The method analyzes the relationship between detected text and arrows on signage and estimates the correct direction toward the user’s destination. In other words, the method enables wayfinding for the blind without requiring either environmental modifications (e.g. Bluetooth beacons) or preparation of map data. In a user study, we compared our method with a baseline method: a signage reader using a smartphone camera with a standard field of view. We found that our method enabled the participants to decide directions more efficiently than with the baseline method.

Original languageEnglish
Title of host publicationMobile and Ubiquitous Systems
Subtitle of host publicationComputing, Networking and Services
EditorsTakahiro Hara, Hirozumi Yamaguchi
PublisherSpringer Science and Business Media Deutschland GmbH
Pages150-168
Number of pages19
ISBN (Print)9783030948214
DOIs
Publication statusPublished - 2022
Event18th EAI International Conference on Mobile and Ubiquitous Systems: Computing, Networking and Services, MobiQuitous 2021 - Virtual, Online
Duration: 2021 Nov 82021 Nov 11

Publication series

NameLecture Notes of the Institute for Computer Sciences, Social-Informatics and Telecommunications Engineering, LNICST
Volume419 LNICST
ISSN (Print)1867-8211
ISSN (Electronic)1867-822X

Conference

Conference18th EAI International Conference on Mobile and Ubiquitous Systems: Computing, Networking and Services, MobiQuitous 2021
CityVirtual, Online
Period21/11/821/11/11

Keywords

  • Arrow detection
  • OCR
  • Signage
  • Visual impairment

ASJC Scopus subject areas

  • Computer Networks and Communications

Fingerprint

Dive into the research topics of 'One-Shot Wayfinding Method for Blind People via OCR and Arrow Analysis with a 360-Degree Smartphone Camera'. Together they form a unique fingerprint.

Cite this