Note to users. If you're seeing this message, it means that your browser cannot find this page's style/presentation instructions -- or possibly that you are using a browser that does not support current Web standards. Find out more about why this message is appearing, and what you can do to make your experience of our site the best it can be.
Subscribe

Logo for

Science 318 (5856): 1642-1645

Copyright © 2007 by the American Association for the Advancement of Science

Genetically Determined Differences in Learning from Errors

Tilmann A. Klein,1* Jane Neumann,1 Martin Reuter,2 Jürgen Hennig,3 D. Yves von Cramon,1,4 Markus Ullsperger1,4*

Abstract: The role of dopamine in monitoring negative action outcomes and feedback-based learning was tested in a neuroimaging study in humans grouped according to the dopamine D2 receptor gene polymorphism DRD2-TAQ-IA. In a probabilistic learning task, A1-allele carriers with reduced dopamine D2 receptor densities learned to avoid actions with negative consequences less efficiently. Their posterior medial frontal cortex (pMFC), involved in feedback monitoring, responded less to negative feedback than others' did. Dynamically changing interactions between pMFC and hippocampus found to underlie feedback-based learning were reduced in A1-allele carriers. This demonstrates that learning from errors requires dopaminergic signaling. Dopamine D2 receptor reduction seems to decrease sensitivity to negative action consequences, which may explain an increased risk of developing addictive behaviors in A1-allele carriers.

1 Max Planck Institute for Human Cognitive and Brain Sciences, Leipzig, Germany.
2 University of Bonn, Bonn, Germany.
3 University of Giessen, Giessen, Germany.
4 Max Planck Institute for Neurological Research, Cologne, Germany.

* To whom correspondence should be addressed. E-mail: tklein{at}cbs.mpg.de (T.A.K.); ullsperger{at}nf.mpg.de (M.U.)

THIS ARTICLE HAS BEEN CITED BY OTHER ARTICLES:
Dopaminergic Control of Motivation and Reinforcement Learning: A Closed-Circuit Account for Reward-Oriented Behavior.
K. Morita, M. Morishima, K. Sakai, and Y. Kawaguchi (2013)
J. Neurosci. 33, 8866-8890
   Abstract »    Full Text »    PDF »
Rapid Brain Responses Independently Predict Gain Maximization and Loss Minimization during Economic Decision Making.
R. San Martin, L. G. Appelbaum, J. M. Pearson, S. A. Huettel, and M. G. Woldorff (2013)
J. Neurosci. 33, 7011-7019
   Abstract »    Full Text »    PDF »
Dopamine and performance in a reinforcement learning task: evidence from Parkinson's disease.
T. Shiner, B. Seymour, K. Wunderlich, C. Hill, K. P. Bhatia, P. Dayan, and R. J. Dolan (2012)
Brain 135, 1871-1883
   Abstract »    Full Text »    PDF »
Striatum-Medial Prefrontal Cortex Connectivity Predicts Developmental Changes in Reinforcement Learning.
W. van den Bos, M. X. Cohen, T. Kahnt, and E. A. Crone (2012)
Cereb Cortex 22, 1247-1255
   Abstract »    Full Text »    PDF »
Functional specialization within the striatum along both the dorsal/ventral and anterior/posterior axes during associative learning via reward and punishment.
A. T. Mattfeld, M. A. Gluck, and C. E. L. Stark (2011)
Learn. Mem. 18, 703-711
   Abstract »    Full Text »    PDF »
Distinct Roles of Three Frontal Cortical Areas in Reward-Guided Behavior.
M. P. Noonan, R. B. Mars, and M. F. S. Rushworth (2011)
J. Neurosci. 31, 14399-14412
   Abstract »    Full Text »    PDF »
Dopaminergic Genes Predict Individual Differences in Susceptibility to Confirmation Bias.
B. B. Doll, K. E. Hutchison, and M. J. Frank (2011)
J. Neurosci. 31, 6188-6198
   Abstract »    Full Text »    PDF »
Dopamine-Mediated Reinforcement Learning Signals in the Striatum and Ventromedial Prefrontal Cortex Underlie Value-Based Choices.
G. Jocham, T. A. Klein, and M. Ullsperger (2011)
J. Neurosci. 31, 1606-1613
   Abstract »    Full Text »    PDF »
Interaction Effect of Functional Variants of the BDNF and DRD2/ANKK1 Gene Is Associated With Alexithymia in Healthy Human Subjects.
N. T. Walter, C. Montag, S. A. Markett, and M. Reuter (2011)
Psychosom Med 73, 23-28
   Abstract »    Full Text »    PDF »
Punishing an Error Improves Learning: The Influence of Punishment Magnitude on Error-Related Neural Activity and Subsequent Learning.
R. Hester, K. Murphy, F. L. Brown, and A. J. Skilleter (2010)
J. Neurosci. 30, 15600-15607
   Abstract »    Full Text »    PDF »
Drug-induced deactivation of inhibitory networks predicts pathological gambling in PD.
T. van Eimeren, G. Pellecchia, R. Cilia, B. Ballanger, T. D. L. Steeves, S. Houle, J. M. Miyasaki, M. Zurowski, A. E. Lang, and A. P. Strafella (2010)
Neurology 75, 1711-1716
   Abstract »    Full Text »    PDF »
Frontostriatal Involvement in Task Switching Depends on Genetic Differences in D2 Receptor Density.
C. Stelzel, U. Basten, C. Montag, M. Reuter, and C. J. Fiebach (2010)
J. Neurosci. 30, 14205-14212
   Abstract »    Full Text »    PDF »
Acute tryptophan depletion selectively attenuates cardiac slowing in an Eriksen flanker task.
F. Van der Veen, E. Evers, G. Mies, E. Vuurman, and J. Jolles (2010)
J Psychopharmacol 24, 1455-1463
   Abstract »    PDF »
The Role of the BDNF Val66Met Polymorphism for the Synchronization of Error-Specific Neural Networks.
C. Beste, V. Kolev, J. Yordanova, K. Domschke, M. Falkenstein, B. T. Baune, and C. Konrad (2010)
J. Neurosci. 30, 10727-10733
   Abstract »    Full Text »    PDF »
The Effects of COMT (Val108/158Met) and DRD4 (SNP -521) Dopamine Genotypes on Brain Activations Related to Valence and Magnitude of Rewards.
E. Camara, U. M. Kramer, T. Cunillera, J. Marco-Pallares, D. Cucurell, W. Nager, A. Mestres-Misse, P. Bauer, R. Schule, L. Schols, et al. (2010)
Cereb Cortex 20, 1985-1996
   Abstract »    Full Text »    PDF »
The Importance of Failure: Feedback-Related Negativity Predicts Motor Learning Efficiency.
J. van der Helden, M. A. S. Boksem, and J. H. G. Blom (2010)
Cereb Cortex 20, 1596-1603
   Abstract »    Full Text »    PDF »
Prefrontal cortex mediation of cognitive enhancement in rewarding motivational contexts.
K. Jimura, H. S. Locke, and T. S. Braver (2010)
PNAS 107, 8871-8876
   Abstract »    Full Text »    PDF »
Genetically Determined Differences in Brain Response to a Primary Food Reward.
J. A. Felsted, X. Ren, F. Chouinard-Decorte, and D. M. Small (2010)
J. Neurosci. 30, 2428-2432
   Abstract »    Full Text »    PDF »
Genetic variation in dopaminergic neuromodulation influences the ability to rapidly and flexibly adapt decisions.
L. K. Krugel, G. Biele, P. N. C. Mohr, S.-C. Li, and H. R. Heekeren (2009)
PNAS 106, 17951-17956
   Abstract »    Full Text »    PDF »
When Errors Are Rewarding.
E. R. A. de Bruijn, F. P. de Lange, D. Y. von Cramon, and M. Ullsperger (2009)
J. Neurosci. 29, 12183-12186
   Abstract »    Full Text »    PDF »
Adaptive Coding of Action Values in the Human Rostral Cingulate Zone.
G. Jocham, J. Neumann, T. A. Klein, C. Danielmeier, and M. Ullsperger (2009)
J. Neurosci. 29, 7489-7496
   Abstract »    Full Text »    PDF »
Learning from Errors: Error-Related Neural Activity Predicts Improvements in Future Inhibitory Control Performance.
R. Hester, J. Madeley, K. Murphy, and J. B. Mattingley (2009)
J. Neurosci. 29, 7158-7165
   Abstract »    Full Text »    PDF »
Dopamine DRD2 Polymorphism Alters Reversal Learning and Associated Neural Activity.
G. Jocham, T. A. Klein, J. Neumann, D. Y. von Cramon, M. Reuter, and M. Ullsperger (2009)
J. Neurosci. 29, 3695-3704
   Abstract »    Full Text »    PDF »
CNTRICS Final Task Selection: Long-Term Memory.
J. D. Ragland, R. Cools, M. Frank, D. A. Pizzagalli, A. Preston, C. Ranganath, and A. D. Wagner (2009)
Schizophr Bull 35, 197-212
   Abstract »    Full Text »    PDF »
Schizophrenia: A Computational Reinforcement Learning Perspective.
M. J. Frank (2008)
Schizophr Bull 34, 1008-1011
   Full Text »    PDF »
Social Predictors of Psychotic Experiences: Specificity and Psychological Mechanisms.
R. P. Bentall and C. Fernyhough (2008)
Schizophr Bull 34, 1012-1020
   Abstract »    Full Text »    PDF »
Acute effects of cocaine on the neurobiology of cognitive control.
H. Garavan, J. N Kaufman, and R. Hester (2008)
Phil Trans R Soc B 363, 3267-3276
   Abstract »    Full Text »    PDF »
Response monitoring, repetitive behaviour and anterior cingulate abnormalities in autism spectrum disorders (ASD).
K. N. Thakkar, F. E. Polli, R. M. Joseph, D. S. Tuch, N. Hadjikhani, J. J.S. Barton, and D. S. Manoach (2008)
Brain 131, 2464-2478
   Abstract »    Full Text »    PDF »
Perspectives on Neuroscience and Behavior.
(2008)
Neuroscientist 14, 309-310
   PDF »
Role of Dopamine in the Motivational and Cognitive Control of Behavior.
R. Cools (2008)
Neuroscientist 14, 381-395
   Abstract »    PDF »
Comment on "Genetically Determined Differences in Learning from Errors".
M. Lucht and D. Rosskopf (2008)
Science 321, 200a
   Abstract »    Full Text »    PDF »
Response to Comment on "Genetically Determined Differences in Learning from Errors".
T. A. Klein, M. Reuter, D. Y. von Cramon, and M. Ullsperger (2008)
Science 321, 200b
   Abstract »    Full Text »    PDF »
Serotonin is necessary for place memory in Drosophila.
D. Sitaraman, M. Zars, H. LaFerriere, Y.-C. Chen, A. Sable-Smith, T. Kitamoto, G. E. Rottinghaus, and T. Zars (2008)
PNAS 105, 5579-5584
   Abstract »    Full Text »    PDF »

To Advertise     Find Products

Science Signaling. ISSN 1937-9145 (online), 1945-0877 (print). Pre-2008: Science's STKE. ISSN 1525-8882