Attention and engagement-awareness in the wild: A large-scale study with adaptive notifications

Tadashi Okoshi, Kota Tsubouchi, Masaya Taji, Takanori Ichikawa, Hideyuki Tokuda

Research output: Chapter in Book/Report/Conference proceedingConference contribution

35 Citations (Scopus)

Abstract

In today's advancing ubiquitous computing age, with its ever-increasing amount of information from various applications and services available for consumption, the management of people's attention has become very important. In particular, the high volume of notifications on mobile devices has become a major cause of interruption of users. There has been much research aimed at detecting the opportune moment to present such information to users with in a way that lowers the cognitive load or frustration. However, evaluation of such systems in the real-world production environment with real users and notifications, and evaluation on user's engagement to the presented notification beyond simple responsiveness have not been adequately studied. To the best of our knowledge, this study is the first to investigate user interruptibility and engagement using a real-world large-scale mobile application and real-world notifications consisting of actual news content. We equipped the Yahoo! JAPAN Android app, one of the most popular applications on the national market, with our mobile-sensing and machine-learning-based interruptibility estimation logic. We conducted a large-scale in-the-wild user study with more than 680,000 users for three weeks. The results show that in most cases delaying the notification delivery until an interruptible moment is detected is beneficial to users and results in significant reduction of user response time (49.7%) compared to delivering the notifications immediately. We also observed a higher number of notifications opened in our system as well as constant improvement in user engagement levels throughout the entire study period.

Original languageEnglish
Title of host publication2017 IEEE International Conference on Pervasive Computing and Communications, PerCom 2017
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages100-110
Number of pages11
ISBN (Electronic)9781509043279
DOIs
Publication statusPublished - 2017 May 2
Event2017 IEEE International Conference on Pervasive Computing and Communications, PerCom 2017 - Big Island, United States
Duration: 2017 Mar 132017 Mar 17

Other

Other2017 IEEE International Conference on Pervasive Computing and Communications, PerCom 2017
CountryUnited States
CityBig Island
Period17/3/1317/3/17

ASJC Scopus subject areas

  • Computer Science Applications
  • Communication
  • Computer Networks and Communications

Fingerprint Dive into the research topics of 'Attention and engagement-awareness in the wild: A large-scale study with adaptive notifications'. Together they form a unique fingerprint.

  • Cite this

    Okoshi, T., Tsubouchi, K., Taji, M., Ichikawa, T., & Tokuda, H. (2017). Attention and engagement-awareness in the wild: A large-scale study with adaptive notifications. In 2017 IEEE International Conference on Pervasive Computing and Communications, PerCom 2017 (pp. 100-110). [7917856] Institute of Electrical and Electronics Engineers Inc.. https://doi.org/10.1109/PERCOM.2017.7917856