Successful neurological rehabilitation depends on accurate diagnosis, effective treatment, and quantitative evaluation. Neural coding, a technology for interpretation of functional and structural information of the nervous system, has contributed to the advancements in neuroimaging, brain-machine interface (BMI), and design of training devices for rehabilitation purposes. In this review, we summarized the latest breakthroughs in neuroimaging from microscale to macroscale levels with potential diagnostic applications for rehabilitation. We also reviewed the achievements in electrocorticography (ECoG) coding with both animal models and human beings for BMI design, electromyography (EMG) interpretation for interaction with external robotic systems, and robot-assisted quantitative evaluation on the progress of rehabilitation programs. Future rehabilitation would be more home-based, automatic, and self-served by patients. Further investigations and breakthroughs are mainly needed in aspects of improving the computational efficiency in neuroimaging and multichannel ECoG by selection of localized neuroinformatics, validation of the effectiveness in BMI guided rehabilitation programs, and simplification of the system operation in training devices.

Animals seek out relevant information by moving through a dynamic world, but sensory systems are usually studied under highly constrained and passive conditions that may not probe important dimensions of the neural code. Here, we explored neural coding in the barrel cortex of head-fixed mice that tracked walls with their whiskers in tactile virtual reality. Optogenetic manipulations revealed that barrel cortex plays a role in wall-tracking. Closed-loop optogenetic control of layer 4 neurons can substitute for whisker-object contact to guide behavior resembling wall tracking. We measured neural activity using two-photon calcium imaging and extracellular recordings. Neurons were tuned to the distance between the animal snout and the contralateral wall, with monotonic, unimodal, and multimodal tuning curves. This rich representation of object location in the barrel cortex could not be predicted based on simple stimulus-response relationships involving individual whiskers and likely emerges within cortical circuits.

Animals flexibly switch between different actions by changing neural activity patterns for motor control. Courting Drosophila melanogaster males produce two different acoustic signals, pulse and sine song, each of which can be promoted by artificial activation of distinct neurons. However, how the activity of these neurons implements flexible song production is unknown. Here, we developed an assay to record neuronal calcium signals in the ventral nerve cord, which contains the song motor circuit, in singing flies. We found that sine-promoting neurons, but not pulse-promoting neurons, show strong activation during sine song. In contrast, both pulse- and sine-promoting neurons are active during pulse song. Furthermore, population calcium imaging in the song circuit suggests that sine song involves activation of a subset of neurons that are also active during pulse song. Thus, differential activation of overlapping, rather than distinct, neural populations underlies flexible motor actions during acoustic communication in D. melanogaster.

Stimulus intensity is a fundamental perceptual feature in all sensory systems. In olfaction, perceived odor intensity depends on at least two variables: odor concentration; and duration of the odor exposure or adaptation. To examine how neural activity at early stages of the olfactory system represents features relevant to intensity perception, we studied the responses of mitral/tufted cells (MTCs) while manipulating odor concentration and exposure duration. Temporal profiles of MTC responses to odors changed both as a function of concentration and with adaptation. However, despite the complexity of these responses, adaptation and concentration dependencies behaved similarly. These similarities were visualized by principal component analysis of average population responses and were quantified by discriminant analysis in a trial-by-trial manner. The qualitative functional dependencies of neuronal responses paralleled psychophysics results in humans. We suggest that temporal patterns of MTC responses in the olfactory bulb contribute to an internal perceptual variable: odor intensity.

In the natural world, animals make decisions on an ongoing basis, continuously selecting which action to undertake next. In the lab, however, the neural bases of decision processes have mostly been studied using artificial trial structures. New experimental tools based on the genetic toolkit of model organisms now make it experimentally feasible to monitor and manipulate neural activity in small subsets of neurons during naturalistic behaviors. We thus propose a new approach to investigating decision processes, termed reverse neuroethology. In this approach, experimenters select animal models based on experimental accessibility and then utilize cutting-edge tools such as connectomes and genetically encoded reagents to analyze the flow of information through an animal's nervous system during naturalistic choice behaviors. We describe how the reverse neuroethology strategy has been applied to understand the neural underpinnings of innate, rapid decision making, with a focus on defensive behavioral choices in the vinegar fly Drosophila melanogaster.

The ability of animals to accumulate sensory information across time is fundamental to decision-making. Using a mouse behavioral paradigm where navigational decisions are based on accumulating pulses of visual cues, I compared neural activity in primary visual (V1) to secondary visual and retrosplenial cortices. Even in V1, only a small fraction of neurons had sensory-like responses to cues. Instead, all areas were grossly similar in how neural populations contained a large variety of task-related information from sensory to cognitive, including cue timings, accumulated counts, place/time, decision and reward outcome. Across-trial influences were prevalent, possibly relevant to how animal behavior incorporates past contexts. Intriguingly, all these variables also modulated the amplitudes of sensory responses. While previous work often modeled the accumulation process as integration, the observed scaling of sensory responses by accumulated counts instead suggests a recursive process where sensory responses are gradually amplified. I show that such a multiplicative feedback-loop algorithm better explains psychophysical data than integration, particularly in how the performance transitions into following Weber-Fechner's Law only at high counts.

Studies of perceptual decision-making have often assumed that the main role of sensory cortices is to provide sensory input to downstream processes that accumulate and drive behavioral decisions. We performed a systematic comparison of neural activity in primary visual (V1) to secondary visual and retrosplenial cortices, as mice performed a task where they should accumulate pulsatile visual cues through time to inform a navigational decision. Even in V1, only a small fraction of neurons had sensory-like responses to cues. Instead, in all areas neurons were sequentially active, and contained information ranging from sensory to cognitive, including cue timings, evidence, place/time, decision and reward outcome. Per-cue sensory responses were amplitude-modulated by various cognitive quantities, notably accumulated evidence. This inspired a multiplicative feedback-loop circuit hypothesis that proposes a more intricate role of sensory areas in the accumulation process, and furthermore explains a surprising observation that perceptual discrimination deviates from Weber-Fechner Law.Highlights / eTOC BlurbMice made navigational decisions based on accumulating pulsatile visual cuesThe bulk of neural activity in visual cortices was sequential and beyond-sensoryAccumulated pulse-counts modulated sensory (cue) responses, suggesting feedbackA feedback-loop neural circuit explains behavioral deviations from Weber’s LawHighlights / eTOC BlurbIn a task where navigation was informed by accumulated pulsatile visual evidence, neural activity in visual cortices predominantly coded for cognitive variables across multiple timescales, including outside of a visual processing context. Even sensory responses to visual pulses were amplitude-modulated by accumulated pulse counts and other variables, inspiring a multiplicative feedback-loop circuit hypothesis that in turn explained behavioral deviations from Weber-Fechner Law.

When the contrast of an image flickers as it moves, humans perceive an illusory reversal in the direction of motion. This classic illusion, called reverse-phi motion, has been well-characterized using psychophysics, and several models have been proposed to account for its effects. Here, we show that Drosophila melanogaster also respond behaviorally to the reverse-phi illusion and that the illusion is present in dendritic calcium signals of motion-sensitive neurons in the fly lobula plate. These results closely match the predictions of the predominant model of fly motion detection. However, high flicker rates cause an inversion of the reverse-phi behavioral response that is also present in calcium signals of lobula plate tangential cell dendrites but not predicted by the model. The fly’s behavioral and neural responses to the reverse-phi illusion reveal unexpected interactions between motion and flicker signals in the fly visual system and suggest that a similar correlation-based mechanism underlies visual motion detection across the animal kingdom.

Many animals navigate using a combination of visual landmarks and path integration. In mammalian brains, head direction cells integrate these two streams of information by representing an animal's heading relative to landmarks, yet maintaining their directional tuning in darkness based on self-motion cues. Here we use two-photon calcium imaging in head-fixed Drosophila melanogaster walking on a ball in a virtual reality arena to demonstrate that landmark-based orientation and angular path integration are combined in the population responses of neurons whose dendrites tile the ellipsoid body, a toroidal structure in the centre of the fly brain. The neural population encodes the fly's azimuth relative to its environment, tracking visual landmarks when available and relying on self-motion cues in darkness. When both visual and self-motion cues are absent, a representation of the animal's orientation is maintained in this network through persistent activity, a potential substrate for short-term memory. Several features of the population dynamics of these neurons and their circular anatomical arrangement are suggestive of ring attractors, network structures that have been proposed to support the function of navigational brain circuits.