Abstract
When facing uncertainty, adaptive behavioral strategies demand that the brain performs probabilistic computations. In this probabilistic framework, the notion of certainty and confidence would appear to be closely related, so much so that it is tempting to conclude that these two concepts are one and the same. We argue that there are computational reasons to distinguish between these two concepts. Specifically, we propose that confidence should be defined as the probability that a decision or a proposition, overt or covert, is correct given the evidence, a critical quantity in complex sequential decisions. We suggest that the term certainty should be reserved to refer to the encoding of all other probability distributions over sensory and cognitive variables. We also discuss strategies for studying the neural codes for confidence and certainty and argue that clear definitions of neural codes are essential to understanding the relative contributions of various cortical areas to decision making.
This is a preview of subscription content, access via your institution
Access options
Subscribe to this journal
Receive 12 print issues and online access
$209.00 per year
only $17.42 per issue
Buy this article
- Purchase on SpringerLink
- Instant access to full article PDF
Prices may be subject to local taxes which are calculated during checkout
![](http://media.springernature.com/m312/springer-static/image/art%3A10.1038%2Fnn.4240/MediaObjects/41593_2016_Article_BFnn4240_Fig1_HTML.jpg)
![](http://media.springernature.com/m312/springer-static/image/art%3A10.1038%2Fnn.4240/MediaObjects/41593_2016_Article_BFnn4240_Fig2_HTML.jpg)
![](http://media.springernature.com/m312/springer-static/image/art%3A10.1038%2Fnn.4240/MediaObjects/41593_2016_Article_BFnn4240_Fig3_HTML.jpg)
![](http://media.springernature.com/m312/springer-static/image/art%3A10.1038%2Fnn.4240/MediaObjects/41593_2016_Article_BFnn4240_Fig4_HTML.jpg)
Similar content being viewed by others
References
Kepecs, A. & Mainen, Z.F. A computational framework for the study of confidence in humans and animals. Phil. Trans. R. oc. Lond. B 367, 1322–1337 (2012).
Meyniel, F., Sigman, M. & Mainen, Z.F. Confidence as Bayesian probability: from neural origins to behavior. Neuron 88, 78–92 (2015).
Grimaldi, P., Lau, H. & Basso, M.A. There are things that we know that we know, and there are things that we do not know we do not know: Confidence in decision-making. Neurosci. Biobehav. Rev. 55, 88–97 (2015).
Vickers, D. Decision Processes in Visual Perception (Academic Press, New York, 1979).
Wei, Z. & Wang, X.J. Confidence estimation as a stochastic process in a neurodynamical system of decision making. J. Neurophysiol. 114, 99–113 (2015).
Insabato, A., Pannunzi, M., Rolls, E.T. & Deco, G. Confidence-related decision making. J. Neurophysiol. 104, 539–547 (2010).
Pleskac, T.J. & Busemeyer, J.R. Two-stage dynamic signal detection: a theory of choice, decision time and confidence. Psychol. Rev. 117, 864–901 (2010).
Bayes, T. An essay towards solving a problem in the doctrine of chances. Philos. Trans. R. Soc. Lond. 53, 370–418 (1763).
Pouget, A., Beck, J.M., Ma, W.J. & Latham, P.E. Probabilistic brains: knowns and unknowns. Nat. Neurosci. 16, 1170–1178 (2013).
Drugowitsch, J., DeAngelis, G.C., Klier, E.M., Angelaki, D.E. & Pouget, A. Optimal multisensory decision-making in a reaction-time task. eLife 3, e030005 (2014).
Fetsch, C.R., Turner, A.H., DeAngelis, G.C. & Angelaki, D.E. Dynamic reweighting of visual and vestibular cues during self-motion perception. J Neurosci. 29, 15601–15612 (2009).
Clarke, F.R., Birdsall, T.G. & Tanner, W.P. Two types of ROC curves and definitions of parameters. J. Acoust. Soc. Am. 31, 629–630 (1959).
Galvin, S.J., Podd, J.V., Drga, V. & Whitmore, J. Type 2 tasks in the theory of signal detectability: discrimination between correct and incorrect decisions. Psychon. Bull. Rev. 10, 843–876 (2003).
Barthelmé, S. & Mamassian, P. Flexible mechanisms underlie the evaluation of visual confidence. Proc. Natl. Acad. Sci. USA 107, 20834–20839 (2010).
Hangya, B., Sanders, J.I. & Kepecs, A. A mathematical framework for statistical decision confidence. Preprint at http://biorxiv.org/content/early/2016/01/01/017400 (2015).
Drugowitsch, J., Moreno-Bote, R. & Pouget, A. Relation between belief and performance in perceptual decision making. PLoS One 9, e96511 (2014).
Lichtenstein, S., Fischhoff, B. & Phillips, L.D. Calibration of probabilities: the state of the art to 1980. in Judgment Under Uncertainty: Heuristics and Biases. (eds. Kahneman D., Slovic P. & Tversky A.,) 306–334 (Cambridge University Press, Cambridge, 1982).
Kiani, R., Corthell, L. & Shadlen, M.N. Choice certainty is informed by both evidence and decision time. Neuron 84, 1329–1342 (2014).
Ma, W.J. & Jazayeri, M. Neural coding of uncertainty and probability. Annu. Rev. Neurosci. 37, 205–220 (2014).
Aitchison, L., Bang, D., Bahrami, B. & Latham, P.E. Doubly Bayesian analysis of confidence in perceptual decision-making. PLoS Comput. Biol. 11, e1004519 (2015).
Sanders, J.I., Hangya, B. & Kepecs, A. Signatures of a statistical computation in the human sense of confidence. Neuron (in press).
Kepecs, A., Uchida, N., Zariwala, H.A. & Mainen, Z.F. Neural correlates, computation and behavioural impact of decision confidence. Nature 455, 227–231 (2008).
Kiani, R. & Shadlen, M.N. Representation of confidence associated with a decision by neurons in the parietal cortex. Science 324, 759–764 (2009).
Lau, H. & Maniscalco, B. Neuroscience. Should confidence be trusted? Science 329, 1478–1479 (2010).
Fleming, S.M., Weil, R.S., Nagy, Z., Dolan, R.J. & Rees, G. Relating introspective accuracy to individual differences in brain structure. Science 329, 1541–1543 (2010).
Kneissler, J., Stalph, P.O., Drugowitsch, J. & Butz, M.V. Filtering sensory information with XCSF: improving learning robustness and robot arm control performance. Evol. Comput. 22, 139–158 (2014).
Teichert, T., Yu, D. & Ferrera, V.P. Performance monitoring in monkey frontal eye field. J. Neurosci. 34, 1657–1671 (2014).
Komura, Y., Nikkuni, A., Hirashima, N., Uetake, T. & Miyamoto, A. Responses of pulvinar neurons reflect a subject's confidence in visual categorization. Nat. Neurosci. 16, 749–755 (2013).
Persaud, N., McLeod, P. & Cowey, A. Post-decision wagering objectively measures awareness. Nat. Neurosci. 10, 257–261 (2007).
Vo, V.A., Li, R., Kornell, N., Pouget, A. & Cantlon, J.F. Young children bet on their numerical skills: metacognition in the numerical domain. Psychol. Sci. 25, 1712–1721 (2014).
Middlebrooks, P.G. & Sommer, M.A. Neuronal correlates of metacognition in primate frontal cortex. Neuron 75, 517–530 (2012).
Konstantinidis, E. & Shanks, D.R. Don't bet on it! Wagering as a measure of awareness in decision making under uncertainty. J. Exp. Psychol. Gen. 143, 2111–2134 (2014).
Clifford, C.W., Arabzadeh, E. & Harris, J.A. Getting technical about awareness. Trends Cogn. Sci. 12, 54–58 (2008).
Lak, A. et al. Orbitofrontal cortex is required for optimal waiting based on decision confidence. Neuron 84, 190–201 (2014).
Bang, D. et al. Does interaction matter? Testing whether a confidence heuristic can replace interaction in collective decision-making. Conscious. Cogn. 26, 13–23 (2014).
Zylberberg, A., Barttfeld, P. & Sigman, M. The construction of confidence in a perceptual decision. Front. Integr. Nuerosci. 6, 79 (2012).
Sutton, R.S. Gain adaptation beats least squares? Proceedings of the Seventh Yale Workshop on Adaptive and Learning Systems 161–166 (1992).
MacKay, D.J.C. Model comparison and Occam's Razor. in Information Theory, Inference and Learning Algorithms 343–355 (Cambridge University Press, Cambridge, 2003).
Meyniel, F., Schlunegger, D. & Dehaene, S. The sense of confidence during probabilistic learning: a normative account. PLoS Comput. Biol. 11, e1004305 (2015).
Yeung, N. & Summerfield, C. Metacognition in human decision-making: confidence and error monitoring. Phil. Trans. R. Soc. Lond. B 367, 1310–1321 (2012).
De Martino, B., Fleming, S.M., Garrett, N. & Dolan, R.J. Confidence in value-based choice. Nat. Neurosci. 16, 105–110 (2013).
Fleming, S.M. & Dolan, R.J. The neural basis of metacognitive ability. Phil. Trans. R. Soc. Lond. B 367, 1338–1349 (2012).
Fleming, S.M., Ryu, J., Golfinos, J.G. & Blackmon, K.E. Domain-specific impairment in metacognitive accuracy following anterior prefrontal lesions. Brain 137, 2811–2822 (2014).
de Gardelle, V. & Mamassian, P. Does confidence use a common currency across two visual tasks? Psychol. Sci. 25, 1286–1288 (2014).
Ma, W.J., Beck, J.M., Latham, P.E. & Pouget, A. Bayesian inference with probabilistic population codes. Nat. Neurosci. 9, 1432–1438 (2006).
van Beers, R.J., Sittig, A.C. & Gon, J.J. Integration of proprioceptive and visual position-information: an experimentally supported model. J. Neurophysiol. 81, 1355–1364 (1999).
Jacobs, R.A. Optimal integration of texture and motion cues to depth. Vis. Res. 117, 3621–3629 (1999).
Fetsch, C.R., Pouget, A., DeAngelis, G.C. & Angelaki, D.E. Neural correlates of reliability-based cue weighting during multisensory integration. Nat. Neurosci. 15, 146–154 (2012).
Gold, J.I. & Shadlen, M.N. Neural computations that underlie decisions about sensory stimuli. Trends Cogn. Sci. 5, 10–16 (2001).
Beck, J. et al. Bayesian decision making with probabilistic population codes. Neuron 60, 1142–1152 (2008).
Beck, J.M., Ma, W.J., Pitkow, X., Latham, P.E. & Pouget, A. Not noisy, just wrong: the role of suboptimal inference in behavioral variability. Neuron 74, 30–39 (2012).
Juslin, P. & Olsson, H. Thurstonian and Brunswikian origins of uncertainty in judgment: a sampling model of confidence in sensory discrimination. Psychol. Rev. 104, 344–366 (1997).
Rutishauser, U. et al. Representation of retrieval confidence by single neurons in the human medial temporal lobe. Nat. Neurosci. 18, 1041–1050 (2015).
Lebreton, M., Abitbol, R., Daunizeau, J. & Pessiglione, M. Automatic integration of confidence in the brain valuation signal. Nat. Neurosci. 18, 1159–1167 (2015).
Hubel, D.H. & Wiesel, T.N. Receptive fields, binocular interaction and functional architecture in the cat's visual cortex. J. Physiol. (Lond.) 160, 106–154 (1962).
Maunsell, J.H. & Newsome, W.T. Visual processing in monkey extrastriate cortex. Annu. Rev. Neurosci. 10, 363–401 (1987).
Maunsell, J.H. & Van Essen, D.C. Functional properties of neurons in middle temporal visual area of the macaque monkey. II. Binocular interactions and sensitivity to binocular disparity. J. Neurophysiol. 49, 1148–1167 (1983).
Maunsell, J.H. & Van Essen, D.C. Functional properties of neurons in middle temporal visual area of the macaque monkey. I. Selectivity for stimulus direction, speed, and orientation. J. Neurophysiol. 49, 1127–1147 (1983).
Saleem, A.B., Carandini, M. & Harris, K. Spatial decisions in the hippocampus. Cosyne Abstracts T-14 (2015).
Foldiak, P. The ideal homunculus': statistical inference from neural population responses. in Computation and Neural Systems (eds. Eeckman, F. & Bower, J.) 55–60 (Kluwer Academic Publishers, 1993).
Sanger, T.D. Probability density estimation for the interpretation of neural population codes. J. Neurophysiol. 76, 2790–2793 (1996).
Fiser, J., Berkes, P., Orbán, G. & Lengyel, M. Statistically optimal perception and learning: from behavior to neural representations. Trends Cogn. Sci. 14, 119–130 (2010).
Poggio, T. A theory of how the brain might work. Cold Spring Harb. Symp. Quant. Biol. 55, 899–910 (1990).
Pouget, A. & Sejnowski, T.J. Spatial representations in the parietal cortex may use basis functions. in Advances in Neural Information Processing Systems, Vol. 7 (eds. Tesauro, G., Touretzky D.S. & Leen, T.K.) 157–164 (MIT Press, 1995).
Salinas, E. & Abbott, L.F. Transfer of coded information from sensory to motor networks. J. Neurosci. 15, 6461–6474 (1995).
DiCarlo, J.J. & Cox, D.D. Untangling invariant object recognition. Trends Cogn. Sci. 11, 333–341 (2007).
Rescorla, R.A. & Wagner, A.R. A theory of Pavlovian conditioning: the effectiveness of reinforcement and non-reinforcement. in Classical Conditioning II: Current Research and Theory (eds. Black A.H. & Prokasy W.F.) 64–69 (Appleton-Century-Crofts, New York, 1972).
Pouget, A. & Snyder, L.H. Computational approaches to sensorimotor transformations. Nat. Neurosci. 3 (suppl. 3), 1192–1198 (2000).
Gold, J.I. & Shadlen, M.N. The neural basis of decision making. Annu. Rev. Neurosci. 30, 535–574 (2007).
Camerer, C. & Lovallo, D. Overconfidence and excess entry: an experimental approach. Am. Econ. Rev. 89, 306–318 (1999).
Baranski, J.V. & Petrusic, W.M. The calibration and resolution of confidence in perceptual judgments. Percept. Psychophys. 55, 412–428 (1994).
Moore, D.A. & Healy, P.J. The trouble with overconfidence. Psychol. Rev. 115, 502–517 (2008).
Olsson, H. & Winman, A. Underconfidence in sensory discrimination: the interaction between experimental setting and response strategies. Percept. Psychophys. 58, 374–382 (1996).
Dayan, P., Kakade, S. & Montague, P.R. Learning and selective attention. Nat. Neurosci. 3 (suppl. 3), 1218–1223 (2000).
Beck, J.M., Latham, P.E. & Pouget, A. Marginalization in neural circuits with divisive normalization. J. Neurosci. 31, 15310–15319 (2011).
Acknowledgements
The authors would like to thank Z. Mainen, R. Kiani, P. Latham, P. Dayan, J. Sanders and B. Hangya for stimulating discussions about the definition and utility of the concept of confidence and A. Urai and P. Masset for comments on the manuscript. This work was supported by grants from the Simons Global Brain Initiative (A.P.) and the US National Institutes of Health (R01MH097061) to A.K.
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Competing interests
The authors declare no competing financial interests.
Rights and permissions
About this article
Cite this article
Pouget, A., Drugowitsch, J. & Kepecs, A. Confidence and certainty: distinct probabilistic quantities for different goals. Nat Neurosci 19, 366–374 (2016). https://doi.org/10.1038/nn.4240
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1038/nn.4240
This article is cited by
-
Distinct basal ganglia contributions to learning from implicit and explicit value signals in perceptual decision-making
Nature Communications (2024)
-
Curiosity: primate neural circuits for novelty and information seeking
Nature Reviews Neuroscience (2024)
-
Influence of age and cognitive demand on motor decision making under uncertainty: a study on goal directed reaching movements
Scientific Reports (2024)
-
The expression of decision and learning variables in movement patterns related to decision actions
Experimental Brain Research (2024)
-
Prior information differentially affects discrimination decisions and subjective confidence reports
Nature Communications (2023)