Modeling bout–pause response patterns in variable-ratio and variable-interval schedules using hierarchical Bayesian methodology

Hiroshi Matsui, Kota Yamada, Takayuki Sakagami, Takayuki Tanno

Research output: Contribution to journalArticle

1 Citation (Scopus)

Abstract

Streams of operant responses are arranged in bouts separated by pauses and differences in performance in reinforcement schedules with identical inter-reinforcement intervals (IRIs) are primarily due to differences in within–bout response rate, not in bout–initiation rate. The present study used hierarchical Bayesian modeling as a new method to quantify the properties of the response bout. A Bernoulli distribution was utilized to express the probability to stay in bout/pause, while a Poisson distribution was utilized to quantify the within–bout response rates. We compared bout/pause patterns between variable–ratio (VR) and variable–interval (VI) schedules across IRIs. The model estimation revealed no difference in within-bout staying probability between schedules. However, response rates of within–bout responses were higher in VR than VI across IRIs. These results are consistent with previous analyses using a log–survivor plot to describe within–bout responses and bouts–initiation responses. In addition, a simulation study was performed to examine how sensitively the model estimate the parameters according to different bout initiation rates. These result showed that the within–bout staying probability was affected by changes in between–bout while within–bout response rate parameters were not. This suggests model estimation robustness of the model estimation to dissociate within–bout and between–bout parameters during different reinforcement schedules.

Original languageEnglish
JournalBehavioural Processes
DOIs
Publication statusAccepted/In press - 2018 Jan 1

Fingerprint

Reinforcement Schedule
Appointments and Schedules
Binomial Distribution
Poisson Distribution
methodology
Reinforcement (Psychology)

Keywords

  • Bayesian modeling
  • Bout
  • Response rate
  • Variable interval
  • Variable ratio

ASJC Scopus subject areas

  • Animal Science and Zoology
  • Behavioral Neuroscience

Cite this

Modeling bout–pause response patterns in variable-ratio and variable-interval schedules using hierarchical Bayesian methodology. / Matsui, Hiroshi; Yamada, Kota; Sakagami, Takayuki; Tanno, Takayuki.

In: Behavioural Processes, 01.01.2018.

Research output: Contribution to journalArticle

@article{bd9ce8be653f45818de478d04125df41,
title = "Modeling bout–pause response patterns in variable-ratio and variable-interval schedules using hierarchical Bayesian methodology",
abstract = "Streams of operant responses are arranged in bouts separated by pauses and differences in performance in reinforcement schedules with identical inter-reinforcement intervals (IRIs) are primarily due to differences in within–bout response rate, not in bout–initiation rate. The present study used hierarchical Bayesian modeling as a new method to quantify the properties of the response bout. A Bernoulli distribution was utilized to express the probability to stay in bout/pause, while a Poisson distribution was utilized to quantify the within–bout response rates. We compared bout/pause patterns between variable–ratio (VR) and variable–interval (VI) schedules across IRIs. The model estimation revealed no difference in within-bout staying probability between schedules. However, response rates of within–bout responses were higher in VR than VI across IRIs. These results are consistent with previous analyses using a log–survivor plot to describe within–bout responses and bouts–initiation responses. In addition, a simulation study was performed to examine how sensitively the model estimate the parameters according to different bout initiation rates. These result showed that the within–bout staying probability was affected by changes in between–bout while within–bout response rate parameters were not. This suggests model estimation robustness of the model estimation to dissociate within–bout and between–bout parameters during different reinforcement schedules.",
keywords = "Bayesian modeling, Bout, Response rate, Variable interval, Variable ratio",
author = "Hiroshi Matsui and Kota Yamada and Takayuki Sakagami and Takayuki Tanno",
year = "2018",
month = "1",
day = "1",
doi = "10.1016/j.beproc.2018.07.014",
language = "English",
journal = "Behavioural Processes",
issn = "0376-6357",
publisher = "Elsevier",

}

TY - JOUR

T1 - Modeling bout–pause response patterns in variable-ratio and variable-interval schedules using hierarchical Bayesian methodology

AU - Matsui, Hiroshi

AU - Yamada, Kota

AU - Sakagami, Takayuki

AU - Tanno, Takayuki

PY - 2018/1/1

Y1 - 2018/1/1

N2 - Streams of operant responses are arranged in bouts separated by pauses and differences in performance in reinforcement schedules with identical inter-reinforcement intervals (IRIs) are primarily due to differences in within–bout response rate, not in bout–initiation rate. The present study used hierarchical Bayesian modeling as a new method to quantify the properties of the response bout. A Bernoulli distribution was utilized to express the probability to stay in bout/pause, while a Poisson distribution was utilized to quantify the within–bout response rates. We compared bout/pause patterns between variable–ratio (VR) and variable–interval (VI) schedules across IRIs. The model estimation revealed no difference in within-bout staying probability between schedules. However, response rates of within–bout responses were higher in VR than VI across IRIs. These results are consistent with previous analyses using a log–survivor plot to describe within–bout responses and bouts–initiation responses. In addition, a simulation study was performed to examine how sensitively the model estimate the parameters according to different bout initiation rates. These result showed that the within–bout staying probability was affected by changes in between–bout while within–bout response rate parameters were not. This suggests model estimation robustness of the model estimation to dissociate within–bout and between–bout parameters during different reinforcement schedules.

AB - Streams of operant responses are arranged in bouts separated by pauses and differences in performance in reinforcement schedules with identical inter-reinforcement intervals (IRIs) are primarily due to differences in within–bout response rate, not in bout–initiation rate. The present study used hierarchical Bayesian modeling as a new method to quantify the properties of the response bout. A Bernoulli distribution was utilized to express the probability to stay in bout/pause, while a Poisson distribution was utilized to quantify the within–bout response rates. We compared bout/pause patterns between variable–ratio (VR) and variable–interval (VI) schedules across IRIs. The model estimation revealed no difference in within-bout staying probability between schedules. However, response rates of within–bout responses were higher in VR than VI across IRIs. These results are consistent with previous analyses using a log–survivor plot to describe within–bout responses and bouts–initiation responses. In addition, a simulation study was performed to examine how sensitively the model estimate the parameters according to different bout initiation rates. These result showed that the within–bout staying probability was affected by changes in between–bout while within–bout response rate parameters were not. This suggests model estimation robustness of the model estimation to dissociate within–bout and between–bout parameters during different reinforcement schedules.

KW - Bayesian modeling

KW - Bout

KW - Response rate

KW - Variable interval

KW - Variable ratio

UR - http://www.scopus.com/inward/record.url?scp=85051070804&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85051070804&partnerID=8YFLogxK

U2 - 10.1016/j.beproc.2018.07.014

DO - 10.1016/j.beproc.2018.07.014

M3 - Article

JO - Behavioural Processes

JF - Behavioural Processes

SN - 0376-6357

ER -