Color image modification based on visual saliency for guiding visual attention

Tatsuhiko Kokui, Hironori Takimoto, Yasue Mitsukura, Mitsuyoshi Kishihara, Kensuke Okubo

Research output: Chapter in Book/Report/Conference proceedingConference contribution

6 Citations (Scopus)

Abstract

In this paper, we propose a modification method of color image, for a given region in the image, to obtain the image in which the region shows the highest saliency. Generally, it is thought that the most important part of an information system that assists human activities is a natural interface with human. In addition, eye-gaze information strongly reflects the human interest or their attention. Therefore, a gaze-based interface is promising for future practical applications. In particular, if we can smoothly guide the user's visual attention toward a target without interrupting their current visual attention, the usefulness of the gaze-based interface will be highly enhanced. In order to realize a novel interface based on visual attention, we propose a modification method for color image based on visual saliency map. The proposed method iteratively modifies the intensity and color so that the saliency inside the specified region increases while that outside the region decreases. This iteration is carried out until we obtain the image in which the specified region is most salient over the entire image. With the image obtained in this way, we can smoothly attract the user's visual attention to the specified region, without any interruption to the user's gaze. We evaluated the proposed method by a gaze measurement system and subjective experiments. As a result, we confirmed that the user's visual attention is indeed attracted toward our specified region without uncomfortable feeling.

Original languageEnglish
Title of host publicationProceedings - IEEE International Workshop on Robot and Human Interactive Communication
Pages467-472
Number of pages6
DOIs
Publication statusPublished - 2013
Event22nd IEEE International Symposium on Robot and Human Interactive Communication: "Living Together, Enjoying Together, and Working Together with Robots!", IEEE RO-MAN 2013 - Gyeongju, Korea, Republic of
Duration: 2013 Aug 262013 Aug 29

Other

Other22nd IEEE International Symposium on Robot and Human Interactive Communication: "Living Together, Enjoying Together, and Working Together with Robots!", IEEE RO-MAN 2013
CountryKorea, Republic of
CityGyeongju
Period13/8/2613/8/29

Fingerprint

Color
Information systems
Experiments

ASJC Scopus subject areas

  • Software
  • Artificial Intelligence
  • Human-Computer Interaction

Cite this

Kokui, T., Takimoto, H., Mitsukura, Y., Kishihara, M., & Okubo, K. (2013). Color image modification based on visual saliency for guiding visual attention. In Proceedings - IEEE International Workshop on Robot and Human Interactive Communication (pp. 467-472). [6628548] https://doi.org/10.1109/ROMAN.2013.6628548

Color image modification based on visual saliency for guiding visual attention. / Kokui, Tatsuhiko; Takimoto, Hironori; Mitsukura, Yasue; Kishihara, Mitsuyoshi; Okubo, Kensuke.

Proceedings - IEEE International Workshop on Robot and Human Interactive Communication. 2013. p. 467-472 6628548.

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Kokui, T, Takimoto, H, Mitsukura, Y, Kishihara, M & Okubo, K 2013, Color image modification based on visual saliency for guiding visual attention. in Proceedings - IEEE International Workshop on Robot and Human Interactive Communication., 6628548, pp. 467-472, 22nd IEEE International Symposium on Robot and Human Interactive Communication: "Living Together, Enjoying Together, and Working Together with Robots!", IEEE RO-MAN 2013, Gyeongju, Korea, Republic of, 13/8/26. https://doi.org/10.1109/ROMAN.2013.6628548
Kokui T, Takimoto H, Mitsukura Y, Kishihara M, Okubo K. Color image modification based on visual saliency for guiding visual attention. In Proceedings - IEEE International Workshop on Robot and Human Interactive Communication. 2013. p. 467-472. 6628548 https://doi.org/10.1109/ROMAN.2013.6628548
Kokui, Tatsuhiko ; Takimoto, Hironori ; Mitsukura, Yasue ; Kishihara, Mitsuyoshi ; Okubo, Kensuke. / Color image modification based on visual saliency for guiding visual attention. Proceedings - IEEE International Workshop on Robot and Human Interactive Communication. 2013. pp. 467-472
@inproceedings{b09e09f974f946b68b37d9e08d972f58,
title = "Color image modification based on visual saliency for guiding visual attention",
abstract = "In this paper, we propose a modification method of color image, for a given region in the image, to obtain the image in which the region shows the highest saliency. Generally, it is thought that the most important part of an information system that assists human activities is a natural interface with human. In addition, eye-gaze information strongly reflects the human interest or their attention. Therefore, a gaze-based interface is promising for future practical applications. In particular, if we can smoothly guide the user's visual attention toward a target without interrupting their current visual attention, the usefulness of the gaze-based interface will be highly enhanced. In order to realize a novel interface based on visual attention, we propose a modification method for color image based on visual saliency map. The proposed method iteratively modifies the intensity and color so that the saliency inside the specified region increases while that outside the region decreases. This iteration is carried out until we obtain the image in which the specified region is most salient over the entire image. With the image obtained in this way, we can smoothly attract the user's visual attention to the specified region, without any interruption to the user's gaze. We evaluated the proposed method by a gaze measurement system and subjective experiments. As a result, we confirmed that the user's visual attention is indeed attracted toward our specified region without uncomfortable feeling.",
author = "Tatsuhiko Kokui and Hironori Takimoto and Yasue Mitsukura and Mitsuyoshi Kishihara and Kensuke Okubo",
year = "2013",
doi = "10.1109/ROMAN.2013.6628548",
language = "English",
isbn = "9781479905072",
pages = "467--472",
booktitle = "Proceedings - IEEE International Workshop on Robot and Human Interactive Communication",

}

TY - GEN

T1 - Color image modification based on visual saliency for guiding visual attention

AU - Kokui, Tatsuhiko

AU - Takimoto, Hironori

AU - Mitsukura, Yasue

AU - Kishihara, Mitsuyoshi

AU - Okubo, Kensuke

PY - 2013

Y1 - 2013

N2 - In this paper, we propose a modification method of color image, for a given region in the image, to obtain the image in which the region shows the highest saliency. Generally, it is thought that the most important part of an information system that assists human activities is a natural interface with human. In addition, eye-gaze information strongly reflects the human interest or their attention. Therefore, a gaze-based interface is promising for future practical applications. In particular, if we can smoothly guide the user's visual attention toward a target without interrupting their current visual attention, the usefulness of the gaze-based interface will be highly enhanced. In order to realize a novel interface based on visual attention, we propose a modification method for color image based on visual saliency map. The proposed method iteratively modifies the intensity and color so that the saliency inside the specified region increases while that outside the region decreases. This iteration is carried out until we obtain the image in which the specified region is most salient over the entire image. With the image obtained in this way, we can smoothly attract the user's visual attention to the specified region, without any interruption to the user's gaze. We evaluated the proposed method by a gaze measurement system and subjective experiments. As a result, we confirmed that the user's visual attention is indeed attracted toward our specified region without uncomfortable feeling.

AB - In this paper, we propose a modification method of color image, for a given region in the image, to obtain the image in which the region shows the highest saliency. Generally, it is thought that the most important part of an information system that assists human activities is a natural interface with human. In addition, eye-gaze information strongly reflects the human interest or their attention. Therefore, a gaze-based interface is promising for future practical applications. In particular, if we can smoothly guide the user's visual attention toward a target without interrupting their current visual attention, the usefulness of the gaze-based interface will be highly enhanced. In order to realize a novel interface based on visual attention, we propose a modification method for color image based on visual saliency map. The proposed method iteratively modifies the intensity and color so that the saliency inside the specified region increases while that outside the region decreases. This iteration is carried out until we obtain the image in which the specified region is most salient over the entire image. With the image obtained in this way, we can smoothly attract the user's visual attention to the specified region, without any interruption to the user's gaze. We evaluated the proposed method by a gaze measurement system and subjective experiments. As a result, we confirmed that the user's visual attention is indeed attracted toward our specified region without uncomfortable feeling.

UR - http://www.scopus.com/inward/record.url?scp=84889560468&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84889560468&partnerID=8YFLogxK

U2 - 10.1109/ROMAN.2013.6628548

DO - 10.1109/ROMAN.2013.6628548

M3 - Conference contribution

AN - SCOPUS:84889560468

SN - 9781479905072

SP - 467

EP - 472

BT - Proceedings - IEEE International Workshop on Robot and Human Interactive Communication

ER -