Discrimination of variable schedules is controlled by interresponse times proximal to reinforcement

Takayuki Tanno, Alan Silberberg, Takayuki Sakagami

Research output: Contribution to journalArticle

3 Citations (Scopus)

Abstract

In Experiment 1, food-deprived rats responded to one of two schedules that were, with equal probability, associated with a sample lever. One schedule was always variable ratio, while the other schedule, depending on the trial within a session, was: (a) a variable-interval schedule; (b) a tandem variable-interval, differential-reinforcement-of-low-rate schedule; or (c) a tandem variable-interval, differential-reinforcement-of-high-rate schedule. Completion of a sample-lever schedule, which took approximately the same time regardless of schedule, presented two comparison levers, one associated with each sample-lever schedule. Pressing the comparison lever associated with the schedule just presented produced food, while pressing the other produced a blackout. Conditional-discrimination accuracy was related to the size of the difference in reinforced interresponse times and those that preceded it (predecessor interresponse times) between the variable-ratio and other comparison schedules. In Experiment 2, control by predecessor interresponse times was accentuated by requiring rats to discriminate between a variable-ratio schedule and a tandem schedule that required emission of a sequence of a long, then a short interresponse time in the tandem's terminal schedule. These discrimination data are compatible with the copyist model from Tanno and Silberberg (2012) in which response rates are determined by the succession of interresponse times between reinforcers weighted so that each interresponse time's role in rate determination diminishes exponentially as a function of its distance from reinforcement.

Original languageEnglish
Pages (from-to)341-354
Number of pages14
JournalJournal of the Experimental Analysis of Behavior
Volume98
Issue number3
DOIs
Publication statusPublished - 2012 Nov

Fingerprint

Appointments and Schedules
Food

Keywords

  • Copyist model
  • Lever press
  • Rats
  • Schedule discrimination
  • Variable interval
  • Variable ratio

ASJC Scopus subject areas

  • Experimental and Cognitive Psychology
  • Behavioral Neuroscience

Cite this

Discrimination of variable schedules is controlled by interresponse times proximal to reinforcement. / Tanno, Takayuki; Silberberg, Alan; Sakagami, Takayuki.

In: Journal of the Experimental Analysis of Behavior, Vol. 98, No. 3, 11.2012, p. 341-354.

Research output: Contribution to journalArticle

Tanno, Takayuki ; Silberberg, Alan ; Sakagami, Takayuki. / Discrimination of variable schedules is controlled by interresponse times proximal to reinforcement. In: Journal of the Experimental Analysis of Behavior. 2012 ; Vol. 98, No. 3. pp. 341-354.
@article{99ddcc268f744802a7b3a82c86cf6548,
title = "Discrimination of variable schedules is controlled by interresponse times proximal to reinforcement",
abstract = "In Experiment 1, food-deprived rats responded to one of two schedules that were, with equal probability, associated with a sample lever. One schedule was always variable ratio, while the other schedule, depending on the trial within a session, was: (a) a variable-interval schedule; (b) a tandem variable-interval, differential-reinforcement-of-low-rate schedule; or (c) a tandem variable-interval, differential-reinforcement-of-high-rate schedule. Completion of a sample-lever schedule, which took approximately the same time regardless of schedule, presented two comparison levers, one associated with each sample-lever schedule. Pressing the comparison lever associated with the schedule just presented produced food, while pressing the other produced a blackout. Conditional-discrimination accuracy was related to the size of the difference in reinforced interresponse times and those that preceded it (predecessor interresponse times) between the variable-ratio and other comparison schedules. In Experiment 2, control by predecessor interresponse times was accentuated by requiring rats to discriminate between a variable-ratio schedule and a tandem schedule that required emission of a sequence of a long, then a short interresponse time in the tandem's terminal schedule. These discrimination data are compatible with the copyist model from Tanno and Silberberg (2012) in which response rates are determined by the succession of interresponse times between reinforcers weighted so that each interresponse time's role in rate determination diminishes exponentially as a function of its distance from reinforcement.",
keywords = "Copyist model, Lever press, Rats, Schedule discrimination, Variable interval, Variable ratio",
author = "Takayuki Tanno and Alan Silberberg and Takayuki Sakagami",
year = "2012",
month = "11",
doi = "10.1901/jeab.2012.98-341",
language = "English",
volume = "98",
pages = "341--354",
journal = "Journal of the Experimental Analysis of Behavior",
issn = "0022-5002",
publisher = "Society for the Experimental Analysis of Behavior Inc.",
number = "3",

}

TY - JOUR

T1 - Discrimination of variable schedules is controlled by interresponse times proximal to reinforcement

AU - Tanno, Takayuki

AU - Silberberg, Alan

AU - Sakagami, Takayuki

PY - 2012/11

Y1 - 2012/11

N2 - In Experiment 1, food-deprived rats responded to one of two schedules that were, with equal probability, associated with a sample lever. One schedule was always variable ratio, while the other schedule, depending on the trial within a session, was: (a) a variable-interval schedule; (b) a tandem variable-interval, differential-reinforcement-of-low-rate schedule; or (c) a tandem variable-interval, differential-reinforcement-of-high-rate schedule. Completion of a sample-lever schedule, which took approximately the same time regardless of schedule, presented two comparison levers, one associated with each sample-lever schedule. Pressing the comparison lever associated with the schedule just presented produced food, while pressing the other produced a blackout. Conditional-discrimination accuracy was related to the size of the difference in reinforced interresponse times and those that preceded it (predecessor interresponse times) between the variable-ratio and other comparison schedules. In Experiment 2, control by predecessor interresponse times was accentuated by requiring rats to discriminate between a variable-ratio schedule and a tandem schedule that required emission of a sequence of a long, then a short interresponse time in the tandem's terminal schedule. These discrimination data are compatible with the copyist model from Tanno and Silberberg (2012) in which response rates are determined by the succession of interresponse times between reinforcers weighted so that each interresponse time's role in rate determination diminishes exponentially as a function of its distance from reinforcement.

AB - In Experiment 1, food-deprived rats responded to one of two schedules that were, with equal probability, associated with a sample lever. One schedule was always variable ratio, while the other schedule, depending on the trial within a session, was: (a) a variable-interval schedule; (b) a tandem variable-interval, differential-reinforcement-of-low-rate schedule; or (c) a tandem variable-interval, differential-reinforcement-of-high-rate schedule. Completion of a sample-lever schedule, which took approximately the same time regardless of schedule, presented two comparison levers, one associated with each sample-lever schedule. Pressing the comparison lever associated with the schedule just presented produced food, while pressing the other produced a blackout. Conditional-discrimination accuracy was related to the size of the difference in reinforced interresponse times and those that preceded it (predecessor interresponse times) between the variable-ratio and other comparison schedules. In Experiment 2, control by predecessor interresponse times was accentuated by requiring rats to discriminate between a variable-ratio schedule and a tandem schedule that required emission of a sequence of a long, then a short interresponse time in the tandem's terminal schedule. These discrimination data are compatible with the copyist model from Tanno and Silberberg (2012) in which response rates are determined by the succession of interresponse times between reinforcers weighted so that each interresponse time's role in rate determination diminishes exponentially as a function of its distance from reinforcement.

KW - Copyist model

KW - Lever press

KW - Rats

KW - Schedule discrimination

KW - Variable interval

KW - Variable ratio

UR - http://www.scopus.com/inward/record.url?scp=84876317212&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84876317212&partnerID=8YFLogxK

U2 - 10.1901/jeab.2012.98-341

DO - 10.1901/jeab.2012.98-341

M3 - Article

C2 - 23144509

AN - SCOPUS:84876317212

VL - 98

SP - 341

EP - 354

JO - Journal of the Experimental Analysis of Behavior

JF - Journal of the Experimental Analysis of Behavior

SN - 0022-5002

IS - 3

ER -