We present the "spatial transcriptomics imaging framework" (STIM), an imaging-based computational framework focused on visualizing and aligning high-throughput spatial sequencing datasets. STIM is built on the powerful, scalable ImgLib2 and BigDataViewer (BDV) image data frameworks and thus enables novel development or transfer of existing computer vision techniques to the sequencing domain characterized by datasets with irregular measurement-spacing and arbitrary spatial resolution, such as spatial transcriptomics data generated by multiplexed targeted hybridization or spatial sequencing technologies. We illustrate STIM's capabilities by representing, interactively visualizing, 3D rendering, automatically registering, and segmenting publicly available spatial sequencing data from 13 serial sections of mouse brain tissue and from 19 sections of a human metastatic lymph node. We demonstrate that the simplest alignment mode of STIM achieves human-level accuracy.

Preprint: www.biorxiv.org/content/early/2024/10/07/2021.12.07.471629

It is well known that light-sheet illumination can enable optically sectioned wide-field imaging of macroscopic samples. However, the optical sectioning capacity of a light-sheet macroscope is undermined by sample-induced scattering or aberrations that broaden the thickness of the sheet illumination. We present a technique to enhance the optical sectioning capacity of a scanning light-sheet microscope by out-of-focus background rejection. The technique, called HiLo microscopy, makes use of two images sequentially acquired with uniform and structured sheet illumination. An optically sectioned image is then synthesized by fusing high and low spatial frequency information from both images. The benefits of combining light-sheet macroscopy and HiLo background rejection are demonstrated in optically cleared whole mouse brain samples, using both green fluorescent protein (GFP)-fluorescence and dark-field scattered light contrast.

Neural circuits, governed by a complex interplay between excitatory and inhibitory neurons, are the substrate for information processing, and the organization of synaptic connectivity in neural network is an important determinant of circuit function. Here, we analyzed the fine structure of connectivity in hippocampal CA1 excitatory and inhibitory neurons innervated by Schaffer collaterals (SCs) using mGRASP in male mice. Our previous study revealed spatially structured synaptic connectivity between CA3-CA1 pyramidal cells (PCs). Surprisingly, parvalbumin-positive interneurons (PVs) showed a significantly more random pattern spatial structure. Notably, application of Peters' Rule for synapse prediction by random overlap between axons and dendrites enhanced structured connectivity in PCs, but, by contrast, made the connectivity pattern in PVs more random. In addition, PCs in a deep sublayer of striatum pyramidale appeared more highly structured than PCs in superficial layers, and little or no sublayer specificity was found in PVs. Our results show that CA1 excitatory PCs and inhibitory PVs innervated by the same SC inputs follow different connectivity rules. The different organizations of fine scale structured connectivity in hippocampal excitatory and inhibitory neurons provide important insights into the development and functions of neural networks.Understanding how neural circuits generate behavior is one of the central goals of neuroscience. An important component of this endeavor is the mapping of fine-scale connection patterns that underlie, and help us infer, signal processing in the brain. Here, using our recently developed synapse detection technology (mGRASP and neuTube), we provide detailed profiles of synaptic connectivity in excitatory (CA1 pyramidal) and inhibitory (CA1 parvalbumin-positive) neurons innervated by the same presynaptic inputs (CA3 Schaffer collaterals). Our results reveal that these two types of CA1 neurons follow different connectivity patterns. Our new evidence for differently structured connectivity at a fine scale in hippocampal excitatory and inhibitory neurons provides a better understanding of hippocampal networks and will guide theoretical and experimental studies.

Decades of iteration on scientific imaging hardware and software has yielded an explosion in not only the size, complexity, and heterogeneity of image datasets but also in the tooling used to analyze this data. This wealth of image analysis tools, spanning different programming languages, frameworks, and data structures, is itself a problem for data analysts who must adapt to new technologies and integrate established routines to solve increasingly complex problems. While many “bridge” layers exist to unify pairs of popular tools, there exists a need for a general solution to unify new and existing toolkits. The SciJava Ops library presented here addresses this need through two novel principles. Algorithm implementations are declared as plugins called Ops, providing a uniform interface regardless of the toolkit they came from. Users express their needs declaratively to the Op environment, which can then find and adapt available Ops on demand. By using these principles instead of direct function calls, users can write streamlined workflows while avoiding the translation boilerplate of bridge layers. Developers can easily extend SciJava Ops to introduce new libraries and more efficient, specialized algorithm implementations, even immediately benefitting existing workflows. We provide several use cases showing both user and developer benefits, as well as benchmarking data to quantify the negligible impact on overall analysis performance. We have initially deployed SciJava Ops on the Fiji platform, however it would be suitable for integration with additional analysis platforms in the future.

Automatic alignment (registration) of 3D images of adult fruit fly brains is often influenced by the significant displacement of the relative locations of the two optic lobes (OLs) and the center brain (CB). In one of our ongoing efforts to produce a better image alignment pipeline of adult fruit fly brains, we consider separating CB and OLs and align them independently. This paper reports our automatic method to segregate CB and OLs, in particular under conditions where the signal to noise ratio (SNR) is low, the variation of the image intensity is big, and the relative displacement of OLs and CB is substantial. We design an algorithm to find a minimum-cost 3D surface in a 3D image stack to best separate an OL (of one side, either left or right) from CB. This surface is defined as an aggregation of the respective minimum-cost curves detected in each individual 2D image slice. Each curve is defined by a list of control points that best segregate OL and CB. To obtain the locations of these control points, we derive an energy function that includes an image energy term defined by local pixel intensities and two internal energy terms that constrain the curve’s smoothness and length. Gradient descent method is used to optimize this energy function. To improve both the speed and robustness of the method, for each stack, the locations of optimized control points in a slice are taken as the initialization prior for the next slice. We have tested this approach on simulated and real 3D fly brain image stacks and demonstrated that this method can reasonably segregate OLs from CBs despite the aforementioned difficulties.

Tracking crowded cells or other targets in biology is often a challenging task due to poor signal-to-noise ratio, mutual occlusion, large displacements, little discernibility, and the ability of cells to divide. We here present an open source implementation of conservation tracking (Schiegg et al., IEEE international conference on computer vision (ICCV). IEEE, New York, pp 2928-2935, 2013) in the ilastik software framework. This robust tracking-by-assignment algorithm explicitly makes allowance for false positive detections, undersegmentation, and cell division. We give an overview over the underlying algorithm and parameters, and explain the use for a light sheet microscopy sequence of a Drosophila embryo. Equipped with this knowledge, users will be able to track targets of interest in their own data.

Small molecules are important tools to measure and modulate intracellular signaling pathways. A longstanding limitation for using chemical compounds in complex tissues has been the inability to target bioactive small molecules to a specific cell class. Here, we describe a generalizable esterase-ester pair capable of targeted delivery of small molecules to living cells and tissue with cellular specificity. We used fluorogenic molecules to rapidly identify a small ester masking motif that is stable to endogenous esterases, but is efficiently removed by an exogenous esterase. This strategy allows facile targeting of dyes and drugs in complex biological environments to label specific cell types, illuminate gap junction connectivity, and pharmacologically perturb distinct subsets of cells. We expect this approach to have general utility for the specific delivery of many small molecules to defined cellular populations.

Locomotor systems generate diverse motor patterns to produce the movements underlying behavior, requiring that motor neurons be recruited at various phases of the locomotor cycle. Reciprocal inhibition produces alternating motor patterns; however, the mechanisms that generate other phasic relationships between intrasegmental motor pools are unknown. Here, we investigate one such motor pattern in the Drosophila larva, using a multidisciplinary approach including electrophysiology and ssTEM-based circuit reconstruction. We find that two motor pools that are sequentially recruited during locomotion have identical excitable properties. In contrast, they receive input from divergent premotor circuits. We find that this motor pattern is not orchestrated by differential excitatory input but by a GABAergic interneuron acting as a delay line to the later-recruited motor pool. Our findings show how a motor pattern is generated as a function of the modular organization of locomotor networks through segregation of inhibition, a potentially general mechanism for sequential motor patterns.