- Author
- Janne Reynders (UGent) , Tom Verguts (UGent) and Senne Braem (UGent)
- Organization
- Project
- Abstract
- Adaptively variable behavior can be advantageous in various fields such as sports (unpredictability), art (creativity), science (innovation), and problem solving (thinking outside the box). Although previous studies identified experimental conditions under which humans and nonhuman animals show increased variable decision making, we have only a limited understanding of its underlying cognitive mechanisms. Using a reinforcement learning model, we simulate three different theorized strategies in an adversarial reward learning environment that requires very high variability. These mechanisms are (a) relying on a stochastic generator, (b) increasing one's learning rate, or (c) upvaluing unchosen actions. A systematic parameter search and a policy gradient metalearning algorithm both show that agents can adaptively increase variability with each of those strategies. Next, we fitted our model on existing data sets with humans, pigeons, and rats as subjects in adversarial environments. While all three species can engage in highly variable behavior, we find that only humans upvalue unchosen actions as a strategy to achieve variability.
- Keywords
- decision making, reinforcement learning, computational modeling, variability, BEHAVIORAL VARIABILITY, OPERANT VARIABILITY, RANDOM GENERATION, EPISODIC MEMORY, REINFORCEMENT, CHOICE, SEQUENCES, MODEL, MIND
Downloads
-
(...).pdf
- full text (Published version)
- |
- UGent only
- |
- |
- 5.36 MB
Citation
Please use this url to cite or link to this publication: http://hdl.handle.net/1854/LU-01KV83S6DP6FSHAGKX6NSSZ3PB
- MLA
- Reynders, Janne, et al. “Adaptive Variability in Humans, Pigeons, and Rats.” PSYCHOLOGICAL REVIEW, 2026, doi:10.1037/rev0000620.
- APA
- Reynders, J., Verguts, T., & Braem, S. (2026). Adaptive variability in humans, pigeons, and rats. PSYCHOLOGICAL REVIEW. https://doi.org/10.1037/rev0000620
- Chicago author-date
- Reynders, Janne, Tom Verguts, and Senne Braem. 2026. “Adaptive Variability in Humans, Pigeons, and Rats.” PSYCHOLOGICAL REVIEW. https://doi.org/10.1037/rev0000620.
- Chicago author-date (all authors)
- Reynders, Janne, Tom Verguts, and Senne Braem. 2026. “Adaptive Variability in Humans, Pigeons, and Rats.” PSYCHOLOGICAL REVIEW. doi:10.1037/rev0000620.
- Vancouver
- 1.Reynders J, Verguts T, Braem S. Adaptive variability in humans, pigeons, and rats. PSYCHOLOGICAL REVIEW. 2026;
- IEEE
- [1]J. Reynders, T. Verguts, and S. Braem, “Adaptive variability in humans, pigeons, and rats,” PSYCHOLOGICAL REVIEW, 2026.
@article{01KV83S6DP6FSHAGKX6NSSZ3PB,
abstract = {{Adaptively variable behavior can be advantageous in various fields such as sports (unpredictability), art (creativity), science (innovation), and problem solving (thinking outside the box). Although previous studies identified experimental conditions under which humans and nonhuman animals show increased variable decision making, we have only a limited understanding of its underlying cognitive mechanisms. Using a reinforcement learning model, we simulate three different theorized strategies in an adversarial reward learning environment that requires very high variability. These mechanisms are (a) relying on a stochastic generator, (b) increasing one's learning rate, or (c) upvaluing unchosen actions. A systematic parameter search and a policy gradient metalearning algorithm both show that agents can adaptively increase variability with each of those strategies. Next, we fitted our model on existing data sets with humans, pigeons, and rats as subjects in adversarial environments. While all three species can engage in highly variable behavior, we find that only humans upvalue unchosen actions as a strategy to achieve variability.}},
author = {{Reynders, Janne and Verguts, Tom and Braem, Senne}},
issn = {{0033-295X}},
journal = {{PSYCHOLOGICAL REVIEW}},
keywords = {{decision making,reinforcement learning,computational modeling,variability,BEHAVIORAL VARIABILITY,OPERANT VARIABILITY,RANDOM GENERATION,EPISODIC MEMORY,REINFORCEMENT,CHOICE,SEQUENCES,MODEL,MIND}},
language = {{eng}},
pages = {{27}},
title = {{Adaptive variability in humans, pigeons, and rats}},
url = {{http://doi.org/10.1037/rev0000620}},
year = {{2026}},
}
- Altmetric
- View in Altmetric
- Web of Science
- Times cited: