A runs-test algorithm: contingent reinforcement and response run structures.

Yosuke Hachiga, Takayuki Sakagami

Research output: Contribution to journalArticle

1 Citation (Scopus)

Abstract

Four rats' choices between two levers were differentially reinforced using a runs-test algorithm. On each trial, a runs-test score was calculated based on the last 20 choices. In Experiment 1, the onset of stimulus lights cued when the runs score was smaller than criterion. Following cuing, the correct choice was occasionally reinforced with food, and the incorrect choice resulted in a blackout. Results indicated that this contingency reduced sequential dependencies among successive choice responses. With one exception, subjects' choice rule was well described as biased coin flipping. In Experiment 2, cuing was removed and the reinforcement criterion was changed to a percentile score based on the last 20 reinforced responses. The results replicated those of Experiment 1 in successfully eliminating first-order dependencies in all subjects. For 2 subjects, choice allocation was approximately consistent with nonbiased coin flipping. These results suggest that sequential dependencies may be a function of reinforcement contingency.

Original languageEnglish
Pages (from-to)61-80
Number of pages20
JournalJournal of the Experimental Analysis of Behavior
Volume93
Issue number1
Publication statusPublished - 2010 Jan
Externally publishedYes

Fingerprint

Numismatics
Light
Food

ASJC Scopus subject areas

  • Experimental and Cognitive Psychology
  • Behavioral Neuroscience

Cite this

A runs-test algorithm : contingent reinforcement and response run structures. / Hachiga, Yosuke; Sakagami, Takayuki.

In: Journal of the Experimental Analysis of Behavior, Vol. 93, No. 1, 01.2010, p. 61-80.

Research output: Contribution to journalArticle

@article{c28f16060ee74a4887490f0a9f14fcc5,
title = "A runs-test algorithm: contingent reinforcement and response run structures.",
abstract = "Four rats' choices between two levers were differentially reinforced using a runs-test algorithm. On each trial, a runs-test score was calculated based on the last 20 choices. In Experiment 1, the onset of stimulus lights cued when the runs score was smaller than criterion. Following cuing, the correct choice was occasionally reinforced with food, and the incorrect choice resulted in a blackout. Results indicated that this contingency reduced sequential dependencies among successive choice responses. With one exception, subjects' choice rule was well described as biased coin flipping. In Experiment 2, cuing was removed and the reinforcement criterion was changed to a percentile score based on the last 20 reinforced responses. The results replicated those of Experiment 1 in successfully eliminating first-order dependencies in all subjects. For 2 subjects, choice allocation was approximately consistent with nonbiased coin flipping. These results suggest that sequential dependencies may be a function of reinforcement contingency.",
author = "Yosuke Hachiga and Takayuki Sakagami",
year = "2010",
month = "1",
language = "English",
volume = "93",
pages = "61--80",
journal = "Journal of the Experimental Analysis of Behavior",
issn = "0022-5002",
publisher = "Society for the Experimental Analysis of Behavior Inc.",
number = "1",

}

TY - JOUR

T1 - A runs-test algorithm

T2 - contingent reinforcement and response run structures.

AU - Hachiga, Yosuke

AU - Sakagami, Takayuki

PY - 2010/1

Y1 - 2010/1

N2 - Four rats' choices between two levers were differentially reinforced using a runs-test algorithm. On each trial, a runs-test score was calculated based on the last 20 choices. In Experiment 1, the onset of stimulus lights cued when the runs score was smaller than criterion. Following cuing, the correct choice was occasionally reinforced with food, and the incorrect choice resulted in a blackout. Results indicated that this contingency reduced sequential dependencies among successive choice responses. With one exception, subjects' choice rule was well described as biased coin flipping. In Experiment 2, cuing was removed and the reinforcement criterion was changed to a percentile score based on the last 20 reinforced responses. The results replicated those of Experiment 1 in successfully eliminating first-order dependencies in all subjects. For 2 subjects, choice allocation was approximately consistent with nonbiased coin flipping. These results suggest that sequential dependencies may be a function of reinforcement contingency.

AB - Four rats' choices between two levers were differentially reinforced using a runs-test algorithm. On each trial, a runs-test score was calculated based on the last 20 choices. In Experiment 1, the onset of stimulus lights cued when the runs score was smaller than criterion. Following cuing, the correct choice was occasionally reinforced with food, and the incorrect choice resulted in a blackout. Results indicated that this contingency reduced sequential dependencies among successive choice responses. With one exception, subjects' choice rule was well described as biased coin flipping. In Experiment 2, cuing was removed and the reinforcement criterion was changed to a percentile score based on the last 20 reinforced responses. The results replicated those of Experiment 1 in successfully eliminating first-order dependencies in all subjects. For 2 subjects, choice allocation was approximately consistent with nonbiased coin flipping. These results suggest that sequential dependencies may be a function of reinforcement contingency.

UR - http://www.scopus.com/inward/record.url?scp=78149481951&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=78149481951&partnerID=8YFLogxK

M3 - Article

C2 - 20676268

AN - SCOPUS:78149481951

VL - 93

SP - 61

EP - 80

JO - Journal of the Experimental Analysis of Behavior

JF - Journal of the Experimental Analysis of Behavior

SN - 0022-5002

IS - 1

ER -