Learning to be confident : how agents learn confidence based on prediction errors
- Author
- Pierre Le Denmat, Kobe Desender and Tom Verguts (UGent)
- Organization
- Abstract
- Decision confidence should normatively reflect the posterior probability of making a correct choice, conditional on relevant information. However, how individuals learn to calibrate their sense of confidence to that probability remains unknown. The standard approach to estimate any quantity is to use trial-by trial samples of that quantity to train a function approximator (such as a neural network) based on the prediction errors (quantity minus prediction of the quantity). We tested whether humans learn about confidence using this principle in a perceptual decision-making experiment where participants repeatedly alternated between two manipulated feedback regimes (negative vs positive) every few blocks of trials. As anticipated, confidence ratings tracked feedback, with confidence gradually increasing when participants received overall positive feedback (and thus positive prediction errors), and decreasing when receiving negative feedback (and thus negative prediction errors). These feedback-induced dynamic changes were specific to confidence, as objective performance was unaffected by the manipulation. We propose a single-layer neural network model for confidence which updates the computation of confidence based on trial-level prediction errors, and demonstrate that it better fits the behavioral data compared to a purely valence-based model. Taken together, these results show that the computation of confidence is dynamic: humans constantly update how they compute confidence based on prediction errors (feedback minus prediction), in a statistically efficient manner.
- Keywords
- Confidence, Learning, Computational modelling, Drift diffusion model, Metacognition
Downloads
-
(...).pdf
- full text (Published version)
- |
- UGent only
- |
- |
- 5.87 MB
-
(...).pdf
- full text (Accepted manuscript)
- |
- UGent only (changes to open access on 2026-09-25)
- |
- |
- 956.36 KB
Citation
Please use this url to cite or link to this publication: http://hdl.handle.net/1854/LU-01K6E1FVB0CDQS110SBTW7B30P
- MLA
- Le Denmat, Pierre, et al. “Learning to Be Confident : How Agents Learn Confidence Based on Prediction Errors.” COGNITION, vol. 266, 2026, doi:10.1016/j.cognition.2025.106332.
- APA
- Le Denmat, P., Desender, K., & Verguts, T. (2026). Learning to be confident : how agents learn confidence based on prediction errors. COGNITION, 266. https://doi.org/10.1016/j.cognition.2025.106332
- Chicago author-date
- Le Denmat, Pierre, Kobe Desender, and Tom Verguts. 2026. “Learning to Be Confident : How Agents Learn Confidence Based on Prediction Errors.” COGNITION 266. https://doi.org/10.1016/j.cognition.2025.106332.
- Chicago author-date (all authors)
- Le Denmat, Pierre, Kobe Desender, and Tom Verguts. 2026. “Learning to Be Confident : How Agents Learn Confidence Based on Prediction Errors.” COGNITION 266. doi:10.1016/j.cognition.2025.106332.
- Vancouver
- 1.Le Denmat P, Desender K, Verguts T. Learning to be confident : how agents learn confidence based on prediction errors. COGNITION. 2026;266.
- IEEE
- [1]P. Le Denmat, K. Desender, and T. Verguts, “Learning to be confident : how agents learn confidence based on prediction errors,” COGNITION, vol. 266, 2026.
@article{01K6E1FVB0CDQS110SBTW7B30P,
abstract = {{Decision confidence should normatively reflect the posterior probability of making a correct choice, conditional on relevant information. However, how individuals learn to calibrate their sense of confidence to that probability remains unknown. The standard approach to estimate any quantity is to use trial-by trial samples of that quantity to train a function approximator (such as a neural network) based on the prediction errors (quantity minus prediction of the quantity). We tested whether humans learn about confidence using this principle in a perceptual decision-making experiment where participants repeatedly alternated between two manipulated feedback regimes (negative vs positive) every few blocks of trials. As anticipated, confidence ratings tracked feedback, with confidence gradually increasing when participants received overall positive feedback (and thus positive prediction errors), and decreasing when receiving negative feedback (and thus negative prediction errors). These feedback-induced dynamic changes were specific to confidence, as objective performance was unaffected by the manipulation. We propose a single-layer neural network model for confidence which updates the computation of confidence based on trial-level prediction errors, and demonstrate that it better fits the behavioral data compared to a purely valence-based model. Taken together, these results show that the computation of confidence is dynamic: humans constantly update how they compute confidence based on prediction errors (feedback minus prediction), in a statistically efficient manner.}},
articleno = {{106332}},
author = {{Le Denmat, Pierre and Desender, Kobe and Verguts, Tom}},
issn = {{0010-0277}},
journal = {{COGNITION}},
keywords = {{Confidence,Learning,Computational modelling,Drift diffusion model,Metacognition}},
language = {{eng}},
pages = {{11}},
title = {{Learning to be confident : how agents learn confidence based on prediction errors}},
url = {{http://doi.org/10.1016/j.cognition.2025.106332}},
volume = {{266}},
year = {{2026}},
}
- Altmetric
- View in Altmetric
- Web of Science
- Times cited: