An animal's ability to learn and to form memories is essential for its survival. The fruit fly has proven to be a valuable model system for studies of learning and memory. One learned behavior in fruit flies is courtship conditioning. In Drosophila courtship conditioning, male flies learn not to court females during training with an unreceptive female. He retains a memory of this training and for several hours decreases courtship when subsequently paired with any female. Courtship conditioning is a unique learning paradigm; it uses a positive-valence stimulus, a female fly, to teach a male to decrease an innate behavior, courtship of the female. As such, courtship conditioning is not clearly categorized as either appetitive or aversive conditioning. The mushroom body (MB) region in the fruit fly brain is important for several types of memory; however, the precise subsets of intrinsic and extrinsic MB neurons necessary for courtship conditioning are unknown. Here, we disrupted synaptic signaling by driving a shibirets effector in precise subsets of MB neurons, defined by a collection of split-GAL4 drivers. Out of 75 lines tested, 32 showed defects in courtship conditioning memory. Surprisingly, we did not have any hits in the γ lobe Kenyon cells, a region previously implicated in courtship conditioning memory. We did find that several γ lobe extrinsic neurons were necessary for courtship conditioning memory. Overall, our memory hits in the dopaminergic neurons (DANs) and the mushroom body output neurons were more consistent with results from appetitive memory assays than aversive memory assays. For example, protocerebral anterior medial DANs were necessary for courtship memory, similar to appetitive memory, while protocerebral posterior lateral 1 (PPL1) DANs, important for aversive memory, were not needed. Overall, our results indicate that the MB circuits necessary for courtship conditioning memory coincide with circuits necessary for appetitive memory.

Rats repeatedly ran through a sequence of spatial receptive fields of hippocampal CA1 place cells in a fixed temporal order. A novel combinatorial decoding method reveals that these neurons repeatedly fired in precisely this order in long sequences involving four or more cells during slow wave sleep (SWS) immediately following, but not preceding, the experience. The SWS sequences occurred intermittently in brief ( approximately 100 ms) bursts, each compressing the behavioral sequence in time by approximately 20-fold. This rapid encoding of sequential experience is consistent with evidence that the hippocampus is crucial for spatial learning in rodents and the formation of long-term memories of events in time in humans.

The dilemma that neurotheorists face is that (1) detailed biophysical models that can be constrained by direct measurements, while being of great importance, offer no immediate insights into cognitive processes in the brain, and (2) high-level abstract cognitive models, on the other hand, while relevant for understanding behavior, are largely detached from neuronal processes and typically have many free, experimentally unconstrained parameters that have to be tuned to a particular data set and, hence, cannot be readily generalized to other experimental paradigms. In this contribution, we propose a set of "first principles" for neurally inspired cognitive modeling of memory retrieval that has no biologically unconstrained parameters and can be analyzed mathematically both at neuronal and cognitive levels. We apply this framework to the classical cognitive paradigm of free recall. We show that the resulting model accounts well for puzzling behavioral data on human participants and makes predictions that could potentially be tested with neurophysiological recording techniques.

The hippocampus is critical for recollecting and imagining experiences. This is believed to involve voluntarily drawing from hippocampal memory representations of people, events, and places, including the hippocampus’ map-like representations of familiar environments. However, whether the representations in such “cognitive maps” can be volitionally and selectively accessed is unknown. We developed a brain-machine interface to test if rats could control their hippocampal activity in a flexible, goal-directed, model-based manner. We show that rats can efficiently navigate or direct objects to arbitrary goal locations within a virtual reality arena solely by activating and sustaining appropriate hippocampal representations of remote places. This should provide insight into the mechanisms underlying episodic memory recall, mental simulation/planning, and imagination, and open up possibilities for high-level neural prosthetics utilizing hippocampal representations.

Recent success in training artificial agents and robots derives from a combination of direct learning of behavioral policies and indirect learning via value functions. Policy learning and value learning employ distinct algorithms that optimize behavioral performance and reward prediction, respectively. In animals, behavioral learning and the role of mesolimbic dopamine signaling have been extensively evaluated with respect to reward prediction; however, to date there has been little consideration of how direct policy learning might inform our understanding. Here we used a comprehensive dataset of orofacial and body movements to understand how behavioral policies evolve as naive, head-restrained mice learned a trace conditioning paradigm. Individual differences in initial dopaminergic reward responses correlated with the emergence of learned behavioral policy, but not the emergence of putative value encoding for a predictive cue. Likewise, physiologically-calibrated manipulations of mesolimbic dopamine produced multiple effects inconsistent with value learning but predicted by a neural network-based model that used dopamine signals to set an adaptive rate, not an error signal, for behavioral policy learning. This work provides strong evidence that phasic dopamine activity can regulate direct learning of behavioral policies, expanding the explanatory power of reinforcement learning models for animal learning.

Recent success in training artificial agents and robots derives from a combination of direct learning of behavioural policies and indirect learning through value functions. Policy learning and value learning use distinct algorithms that optimize behavioural performance and reward prediction, respectively. In animals, behavioural learning and the role of mesolimbic dopamine signalling have been extensively evaluated with respect to reward prediction; however, so far there has been little consideration of how direct policy learning might inform our understanding. Here we used a comprehensive dataset of orofacial and body movements to understand how behavioural policies evolved as naive, head-restrained mice learned a trace conditioning paradigm. Individual differences in initial dopaminergic reward responses correlated with the emergence of learned behavioural policy, but not the emergence of putative value encoding for a predictive cue. Likewise, physiologically calibrated manipulations of mesolimbic dopamine produced several effects inconsistent with value learning but predicted by a neural-network-based model that used dopamine signals to set an adaptive rate, not an error signal, for behavioural policy learning. This work provides strong evidence that phasic dopamine activity can regulate direct learning of behavioural policies, expanding the explanatory power of reinforcement learning models for animal learning.

Pioneer transcription factors (PTFs) possess the unique capability to access closed chromatin regions and initiate cell fate changes, yet the underlying mechanisms remain elusive. Here, we characterized the single-molecule dynamics of PTFs targeting chromatin in living cells, revealing a notable 'confined target search' mechanism. PTFs such as FOXA1, FOXA2, SOX2, OCT4 and KLF4 sampled chromatin more frequently than non-PTF MYC, alternating between fast free diffusion in the nucleus and slower confined diffusion within mesoscale zones. Super-resolved microscopy showed closed chromatin organized as mesoscale nucleosome-dense domains, confining FOXA2 diffusion locally and enriching its binding. We pinpointed specific histone-interacting disordered regions, distinct from DNA-binding domains, crucial for confined target search kinetics and pioneer activity within closed chromatin. Fusion to other factors enhanced pioneer activity. Kinetic simulations suggested that transient confinement could increase target association rate by shortening search time and binding repeatedly. Our findings illuminate how PTFs recognize and exploit closed chromatin organization to access targets, revealing a pivotal aspect of gene regulation.

Seconds-scale network states, affecting many neurons within a network, modulate neural activity by complementing fast integration of neuron-specific inputs that arrive in the milliseconds before spiking. Non-rhythmic subthreshold dynamics at intermediate timescales, however, are less well-characterized. We found, using automated whole cell patch clamping in vivo, that spikes recorded in CA1 and barrel cortex in awake mice are often preceded not only by monotonic voltage rises lasting milliseconds, but also by more gradual (lasting 10s-100s of ms) depolarizations. The latter exert a gating function on spiking, in a fashion that depends on the gradual rise duration: the probability of spiking was higher for longer gradual rises, even controlling for the amplitude of the gradual rises. Barrel cortex double-autopatch recordings show that gradual rises are shared across some but not all neurons. The gradual rises may represent a new kind of state, intermediate both in timescale and in proportion of neurons participating, which gates a neuron's ability to respond to subsequent inputs.

The Drosophila Methoprene-tolerant (Met) and Germ cell-expressed (Gce) bHLH-PAS transcription factors are products of two paralogous genes. Both proteins potentially mediate the effect of juvenile hormone (JH) as candidate JH receptors. Here we report that Met and Gce are partially redundant in transducing JH action. Both Met and gce null single mutants are fully viable, but the Met gce double mutant, Met(27) gce(2.5k), dies during the larval-pupal transition. Precocious and enhanced caspase-dependent programmed cell death (PCD) appears in fat body cells of Met(27) gce(2.5k) during the early larval stages. Expression of Kr-h1, a JH response gene that inhibits 20-hydroxyecdysone (20E)-induced broad (br) expression, is abolished in Met(27) gce(2.5k) during larval molts. Consequently, expression of br occurs precociously in Met(27) gce(2.5k), which may cause precocious caspase-dependent PCD during the early larval stages. Defective phenotypes and gene expression changes in Met(27) gce(2.5k) double mutants are similar to those found in JH-deficient animals. Importantly, exogenous application of JH agonists rescued the JH-deficient animals but not the Met(27) gce(2.5k) mutants. Our data suggest a model in which Drosophila Met and Gce redundantly transduce JH action to prevent 20E-induced caspase-dependent PCD during larval molts by induction of Kr-h1 expression and inhibition of br expression.