Advanced search
1 file | 5.36 MB Add to list

Adaptive variability in humans, pigeons, and rats

Janne Reynders (UGent) , Tom Verguts (UGent) and Senne Braem (UGent)
Author
Organization
Project
Abstract
Adaptively variable behavior can be advantageous in various fields such as sports (unpredictability), art (creativity), science (innovation), and problem solving (thinking outside the box). Although previous studies identified experimental conditions under which humans and nonhuman animals show increased variable decision making, we have only a limited understanding of its underlying cognitive mechanisms. Using a reinforcement learning model, we simulate three different theorized strategies in an adversarial reward learning environment that requires very high variability. These mechanisms are (a) relying on a stochastic generator, (b) increasing one's learning rate, or (c) upvaluing unchosen actions. A systematic parameter search and a policy gradient metalearning algorithm both show that agents can adaptively increase variability with each of those strategies. Next, we fitted our model on existing data sets with humans, pigeons, and rats as subjects in adversarial environments. While all three species can engage in highly variable behavior, we find that only humans upvalue unchosen actions as a strategy to achieve variability.
Keywords
decision making, reinforcement learning, computational modeling, variability, BEHAVIORAL VARIABILITY, OPERANT VARIABILITY, RANDOM GENERATION, EPISODIC MEMORY, REINFORCEMENT, CHOICE, SEQUENCES, MODEL, MIND

Downloads

  • (...).pdf
    • full text (Published version)
    • |
    • UGent only
    • |
    • PDF
    • |
    • 5.36 MB

Citation

Please use this url to cite or link to this publication:

MLA
Reynders, Janne, et al. “Adaptive Variability in Humans, Pigeons, and Rats.” PSYCHOLOGICAL REVIEW, 2026, doi:10.1037/rev0000620.
APA
Reynders, J., Verguts, T., & Braem, S. (2026). Adaptive variability in humans, pigeons, and rats. PSYCHOLOGICAL REVIEW. https://doi.org/10.1037/rev0000620
Chicago author-date
Reynders, Janne, Tom Verguts, and Senne Braem. 2026. “Adaptive Variability in Humans, Pigeons, and Rats.” PSYCHOLOGICAL REVIEW. https://doi.org/10.1037/rev0000620.
Chicago author-date (all authors)
Reynders, Janne, Tom Verguts, and Senne Braem. 2026. “Adaptive Variability in Humans, Pigeons, and Rats.” PSYCHOLOGICAL REVIEW. doi:10.1037/rev0000620.
Vancouver
1.
Reynders J, Verguts T, Braem S. Adaptive variability in humans, pigeons, and rats. PSYCHOLOGICAL REVIEW. 2026;
IEEE
[1]
J. Reynders, T. Verguts, and S. Braem, “Adaptive variability in humans, pigeons, and rats,” PSYCHOLOGICAL REVIEW, 2026.
@article{01KV83S6DP6FSHAGKX6NSSZ3PB,
  abstract     = {{Adaptively variable behavior can be advantageous in various fields such as sports (unpredictability), art (creativity), science (innovation), and problem solving (thinking outside the box). Although previous studies identified experimental conditions under which humans and nonhuman animals show increased variable decision making, we have only a limited understanding of its underlying cognitive mechanisms. Using a reinforcement learning model, we simulate three different theorized strategies in an adversarial reward learning environment that requires very high variability. These mechanisms are (a) relying on a stochastic generator, (b) increasing one's learning rate, or (c) upvaluing unchosen actions. A systematic parameter search and a policy gradient metalearning algorithm both show that agents can adaptively increase variability with each of those strategies. Next, we fitted our model on existing data sets with humans, pigeons, and rats as subjects in adversarial environments. While all three species can engage in highly variable behavior, we find that only humans upvalue unchosen actions as a strategy to achieve variability.}},
  author       = {{Reynders, Janne and Verguts, Tom and Braem, Senne}},
  issn         = {{0033-295X}},
  journal      = {{PSYCHOLOGICAL REVIEW}},
  keywords     = {{decision making,reinforcement learning,computational modeling,variability,BEHAVIORAL VARIABILITY,OPERANT VARIABILITY,RANDOM GENERATION,EPISODIC MEMORY,REINFORCEMENT,CHOICE,SEQUENCES,MODEL,MIND}},
  language     = {{eng}},
  pages        = {{27}},
  title        = {{Adaptive variability in humans, pigeons, and rats}},
  url          = {{http://doi.org/10.1037/rev0000620}},
  year         = {{2026}},
}

Altmetric
View in Altmetric
Web of Science
Times cited: