Animals learn trajectories to rewards in both spatial, navigational contexts and relational, non-navigational contexts. Synchronous reactivation of hippocampal activity is thought to be critical for recall and evaluation of trajectories for learning. Do hippocampal representations differentially contribute to experience-dependent learning of trajectories across spatial and relational contexts? In this study, we trained mice to navigate to a hidden target in a physical arena or manipulate a joystick to a virtual target to collect delayed rewards. In a navigational context, calcium imaging in freely moving mice revealed that synchronous CA1 reactivation was retrospective and important for evaluation of prior navigational trajectories. In a non-navigational context, reactivation was prospective and important for initiation of joystick trajectories, even in the same animals trained in both contexts. Adaptation of trajectories to a new target was well-explained by a common learning algorithm in which hippocampal activity makes dissociable contributions to reinforcement learning computations depending upon spatial context.

Optogenetic reagents allow for depolarization and hyperpolarization of cells with light. This provides unprecedented spatial and temporal resolution to the control of neuronal activity both in vitro and in vivo. In the intact animal this requires strategies to deliver light deep into the highly scattering tissue of the brain. A general approach that we describe here is to implant optical fibers just above brain regions targeted for light delivery. In part due to the fact that expression of optogenetic proteins is accomplished by techniques with inherent variability (e.g., viral expression levels), it also requires strategies to measure and calibrate the effect of stimulation. Here we describe general procedures that allow one to simultaneously stimulate neurons and use photometry with genetically encoded activity indicators to precisely calibrate stimulation.

Responses to threat-related stimuli are influenced by conscious and unconscious processes, but the neural systems underlying these processes and their relationship to anxiety have not been clearly delineated. Using fMRI, we investigated the neural responses associated with the conscious and unconscious (backwardly masked) perception of fearful faces in healthy volunteers who varied in threat sensitivity (Spielberger trait anxiety scale). Unconscious processing modulated activity only in the basolateral subregion of the amygdala, while conscious processing modulated activity only in the dorsal amygdala (containing the central nucleus). Whereas activation of the dorsal amygdala by conscious stimuli was consistent across subjects and independent of trait anxiety, activity in the basolateral amygdala to unconscious stimuli, and subjects’ reaction times, were predicted by individual differences in trait anxiety. These findings provide a biological basis for the unconscious emotional vigilance characteristic of anxiety and a means for investigating the mechanisms and efficacy of treatments for anxiety.

The basal ganglia play a critical role in the regulation of voluntary action in vertebrates. Our understanding of the function of the basal ganglia relies heavily upon anatomical information, but continued progress will require an understanding of the specific functional roles played by diverse cell types and their connectivity. An increasing number of mouse lines allow extensive identification, characterization, and manipulation of specified cell types in the basal ganglia. Despite the promise of genetically modified mice for elucidating the functional roles of diverse cell types, there is relatively little anatomical data obtained directly in the mouse. Here we have characterized the retrograde labeling obtained from a series of tracer injections throughout the dorsal striatum of adult mice. We found systematic variations in input along both the medial-lateral and anterior-posterior neuraxes in close agreement with canonical features of basal ganglia anatomy in the rat. In addition to the canonical features we have provided experimental support for the importance of non-canonical inputs to the striatum from the raphe nuclei and the amygdala. To look for organization at a finer scale we have analyzed the correlation structure of labeling intensity across our entire dataset. Using this analysis we found substantial local heterogeneity within the large-scale order. From this analysis we conclude that individual striatal sites receive varied combinations of cortical and thalamic input from multiple functional areas, consistent with some earlier studies in the rat that have suggested the presence of a combinatorial map.

The nervous system evolved to enable navigation throughout the environment in the pursuit of resources. Evolutionarily newer structures allowed increasingly complex adaptations but necessarily added redundancy. A dominant view of movement neuroscientists is that there is a one-to-one mapping between brain region and function. However, recent experimental data is hard to reconcile with the most conservative interpretation of this framework, suggesting a degree of functional redundancy during the performance of well-learned, constrained behaviors. This apparent redundancy likely stems from the bidirectional interactions between the various cortical and subcortical structures involved in motor control. We posit that these bidirectional connections enable flexible interactions across structures that change depending upon behavioral demands, such as during acquisition, execution or adaptation of a skill. Observing the system across both multiple actions and behavioral timescales can help isolate the functional contributions of individual structures, leading to an integrated understanding of the neural control of movement.

Dopamine (DA) receptor-mediated signal transduction and gene expression play a central role in many brain disorders from schizophrenia to Parkinson’s disease to addiction. While trying to evaluate the role of L-type Ca2+ channels in dopamine D1 receptor-mediated phosphorylation of the transcription factor cyclic AMP response element-binding protein (CREB), we found that activation of dopamine D1 receptors alters the properties of L-type Ca2+ channel inhibitors and turns them into facilitators of Ca2+ influx. In D1 receptor-stimulated neurons, L-type Ca2+ channel blockers promote cytosolic Ca2+ accumulation. This leads to the activation of a molecular signal transduction pathway and CREB phosphorylation. In the absence of dopamine receptor stimulation, L-type Ca2+ channel blockers inhibit CREB phosphorylation. The effect of dopamine on L-type Ca2+ channel blockers is dependent on protein kinase A (PKA), suggesting that protein phosphorylation plays a role in this phenomenon. Because of the adverse effect of activated dopamine receptors on L-type Ca2+ channel blocker action, the role of L-type Ca2+ channels in the dopamine D1 receptor signal transduction pathway cannot be assessed with pharmacological tools. However, with antisense technology, we demonstrate that L-type Ca2+ channels contribute to D1 receptor-mediated CREB phosphorylation. We conclude that the D1 receptor signal transduction pathway depends on L-type Ca2+ channels to mediate CREB phosphorylation.

Animals infer when and where a reward is available from experience with informative sensory stimuli and their own actions. In vertebrates, this is thought to depend upon the release of dopamine from midbrain dopaminergic neurons. Studies of the role of dopamine have focused almost exclusively on their encoding of informative sensory stimuli; however, many dopaminergic neurons are active just prior to movement initiation, even in the absence of sensory stimuli. How should current frameworks for understanding the role of dopamine incorporate these observations? To address this question, we review recent anatomical and functional evidence for action-related dopamine signaling. We conclude by proposing a framework in which dopaminergic neurons encode subjective signals of action initiation to solve an internal credit assignment problem.

Persistent neural activity that outlasts an initial stimulus is thought to provide a mechanism for the transient storage of memory. In this issue of Neuron, Fransén et al. identify important principles for a cell-autonomous mechanism of graded persistent firing using an elegant combination of experimental and computational approaches.

Ligand-gated ion channels involved in the modulation of synaptic strength are the AMPA, kainate, and NMDA glutamate receptors. Small molecules that potentiate AMPA receptor currents relieve cognitive deficits caused by neurodegenerative diseases such as Alzheimer’s disease and show promise in the treatment of depression. Previously, there has been limited understanding of the molecular mechanism of action for AMPA receptor potentiators. Here we present cocrystal structures of the glutamate receptor GluR2 S1S2 ligand-binding domain in complex with aniracetam [1-(4-methoxybenzoyl)-2-pyrrolidinone] or CX614 (pyrrolidino-1,3-oxazino benzo-1,4-dioxan-10-one), two AMPA receptor potentiators that preferentially slow AMPA receptor deactivation. Both potentiators bind within the dimer interface of the nondesensitized receptor at a common site located on the twofold axis of molecular symmetry. Importantly, the potentiator binding site is adjacent to the "hinge" in the ligand-binding core "clamshell" that undergoes conformational rearrangement after glutamate binding. Using rapid solution exchange, patch-clamp electrophysiology experiments, we show that point mutations of residues that interact with potentiators in the cocrystal disrupt potentiator function. We suggest that the potentiators slow deactivation by stabilizing the clamshell in its closed-cleft, glutamate-bound conformation.

Recent success in training artificial agents and robots derives from a combination of direct learning of behavioral policies and indirect learning via value functions. Policy learning and value learning employ distinct algorithms that optimize behavioral performance and reward prediction, respectively. In animals, behavioral learning and the role of mesolimbic dopamine signaling have been extensively evaluated with respect to reward prediction; however, to date there has been little consideration of how direct policy learning might inform our understanding. Here we used a comprehensive dataset of orofacial and body movements to understand how behavioral policies evolve as naive, head-restrained mice learned a trace conditioning paradigm. Individual differences in initial dopaminergic reward responses correlated with the emergence of learned behavioral policy, but not the emergence of putative value encoding for a predictive cue. Likewise, physiologically-calibrated manipulations of mesolimbic dopamine produced multiple effects inconsistent with value learning but predicted by a neural network-based model that used dopamine signals to set an adaptive rate, not an error signal, for behavioral policy learning. This work provides strong evidence that phasic dopamine activity can regulate direct learning of behavioral policies, expanding the explanatory power of reinforcement learning models for animal learning.