Relationships between ignoring instructions and response bias when completing questionnaires

Shinya Masuda, Takayuki Sakagami, Kazuyo Kitaoka, Megumi Sasaki

Research output: Contribution to journalArticle

Abstract

Certain participants are insincere, or careless when they respond to questionnaires. To identify such participants, we included three items in a questionnaire that instructed participants to choose a particular response category. Nurses (N = 1,000) responded to this questionnaire in a Web survey. One-hundred-twenty participants failed to follow the instructions for at least one item (non-followers). Analyzing their responses indicated the following: (a) non-followers were more likely to give identical, or midpoint responses; (b) the correlations between their responses to regular and reversed items were low or positive, and their responses to scales containing reversed items tended to show lower internal consistency; and finally, (c) the mean scores of non-followers were closer to the midpoint of the scale, regardless of whether the scale included reversed items. One reason that including reversed items lead to lower internal consistency could be because participants occasionally missed responding to these items. However, the results suggested that non-followers were not diligent in responding to regular items, and merely deleting reversed items from scales will be insufficient to ensure accurate results.

Original languageEnglish
Pages (from-to)354-363
Number of pages10
JournalShinrigaku Kenkyu
Volume87
Issue number4
DOIs
Publication statusPublished - 2016

Fingerprint

Nurses
Surveys and Questionnaires

Keywords

  • Midpoint response
  • Response instruction
  • Reversed item
  • Straight line response
  • Web survey

ASJC Scopus subject areas

  • Medicine(all)
  • Psychology(all)

Cite this

Relationships between ignoring instructions and response bias when completing questionnaires. / Masuda, Shinya; Sakagami, Takayuki; Kitaoka, Kazuyo; Sasaki, Megumi.

In: Shinrigaku Kenkyu, Vol. 87, No. 4, 2016, p. 354-363.

Research output: Contribution to journalArticle

Masuda, Shinya ; Sakagami, Takayuki ; Kitaoka, Kazuyo ; Sasaki, Megumi. / Relationships between ignoring instructions and response bias when completing questionnaires. In: Shinrigaku Kenkyu. 2016 ; Vol. 87, No. 4. pp. 354-363.
@article{d96d4a3389594a4fa84f17dbd117ccd9,
title = "Relationships between ignoring instructions and response bias when completing questionnaires",
abstract = "Certain participants are insincere, or careless when they respond to questionnaires. To identify such participants, we included three items in a questionnaire that instructed participants to choose a particular response category. Nurses (N = 1,000) responded to this questionnaire in a Web survey. One-hundred-twenty participants failed to follow the instructions for at least one item (non-followers). Analyzing their responses indicated the following: (a) non-followers were more likely to give identical, or midpoint responses; (b) the correlations between their responses to regular and reversed items were low or positive, and their responses to scales containing reversed items tended to show lower internal consistency; and finally, (c) the mean scores of non-followers were closer to the midpoint of the scale, regardless of whether the scale included reversed items. One reason that including reversed items lead to lower internal consistency could be because participants occasionally missed responding to these items. However, the results suggested that non-followers were not diligent in responding to regular items, and merely deleting reversed items from scales will be insufficient to ensure accurate results.",
keywords = "Midpoint response, Response instruction, Reversed item, Straight line response, Web survey",
author = "Shinya Masuda and Takayuki Sakagami and Kazuyo Kitaoka and Megumi Sasaki",
year = "2016",
doi = "10.4992/jjpsy.87.15034",
language = "English",
volume = "87",
pages = "354--363",
journal = "Shinrigaku Kenkyu",
issn = "0021-5236",
publisher = "Japanese Psychological Association",
number = "4",

}

TY - JOUR

T1 - Relationships between ignoring instructions and response bias when completing questionnaires

AU - Masuda, Shinya

AU - Sakagami, Takayuki

AU - Kitaoka, Kazuyo

AU - Sasaki, Megumi

PY - 2016

Y1 - 2016

N2 - Certain participants are insincere, or careless when they respond to questionnaires. To identify such participants, we included three items in a questionnaire that instructed participants to choose a particular response category. Nurses (N = 1,000) responded to this questionnaire in a Web survey. One-hundred-twenty participants failed to follow the instructions for at least one item (non-followers). Analyzing their responses indicated the following: (a) non-followers were more likely to give identical, or midpoint responses; (b) the correlations between their responses to regular and reversed items were low or positive, and their responses to scales containing reversed items tended to show lower internal consistency; and finally, (c) the mean scores of non-followers were closer to the midpoint of the scale, regardless of whether the scale included reversed items. One reason that including reversed items lead to lower internal consistency could be because participants occasionally missed responding to these items. However, the results suggested that non-followers were not diligent in responding to regular items, and merely deleting reversed items from scales will be insufficient to ensure accurate results.

AB - Certain participants are insincere, or careless when they respond to questionnaires. To identify such participants, we included three items in a questionnaire that instructed participants to choose a particular response category. Nurses (N = 1,000) responded to this questionnaire in a Web survey. One-hundred-twenty participants failed to follow the instructions for at least one item (non-followers). Analyzing their responses indicated the following: (a) non-followers were more likely to give identical, or midpoint responses; (b) the correlations between their responses to regular and reversed items were low or positive, and their responses to scales containing reversed items tended to show lower internal consistency; and finally, (c) the mean scores of non-followers were closer to the midpoint of the scale, regardless of whether the scale included reversed items. One reason that including reversed items lead to lower internal consistency could be because participants occasionally missed responding to these items. However, the results suggested that non-followers were not diligent in responding to regular items, and merely deleting reversed items from scales will be insufficient to ensure accurate results.

KW - Midpoint response

KW - Response instruction

KW - Reversed item

KW - Straight line response

KW - Web survey

UR - http://www.scopus.com/inward/record.url?scp=84992533305&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84992533305&partnerID=8YFLogxK

U2 - 10.4992/jjpsy.87.15034

DO - 10.4992/jjpsy.87.15034

M3 - Article

VL - 87

SP - 354

EP - 363

JO - Shinrigaku Kenkyu

JF - Shinrigaku Kenkyu

SN - 0021-5236

IS - 4

ER -