We demonstrate a significant anisotropic magnification distortion, found on an FEI Titan Krios microscope and affecting magnifications commonly used for data acquisition on a Gatan K2 Summit detector. We describe a program (mag_distortion_estimate) to automatically estimate anisotropic magnification distortion from a set of images of a standard gold shadowed diffraction grating. We also describe a program (mag_distortion_correct) to correct for the estimated distortion in collected images. We demonstrate that the distortion present on the Titan Krios microscope limits the resolution of a set of rotavirus VP6 images to ∼7 Å, which increases to ∼3 Å following estimation and correction of the distortion. We also use a 70S ribosome sample to demonstrate that in addition to affecting resolution, magnification distortion can also interfere with the classification of heterogeneous data.

This work presents three different methods for automatic detection of anatomical landmarks in CT data, namely for the left and right anterior superior iliac spines and the pubic symphysis. The methods exhibit different degrees of generality in terms of portability to other anatomical landmarks and require a different amount of training data. The ſrst method is problem-speciſc and is based on the convex hull of the pelvis. Method two is a more generic approach based on a statistical shape model including the landmarks of interest for every training shape. With our third method we present the most generic approach, where only a small set of training landmarks is required. Those landmarks are transferred to the patient speciſc geometry based on Mean Value Coordinates (MVCs). The methods work on surfaces of the pelvis that need to be extracted beforehand. We perform this geometry reconstruction with our previously introduced fully automatic segmentation framework for the pelvic bones. With a focus on the accuracy of our novel MVC-based approach, we evaluate and compare our methods on 100 clinical CT datasets, for which gold standard landmarks were deſned manually by multiple observers.

The exact localization of the mandibular nerve with respect to the bone is important for applications in dental implantology and maxillofacial surgery. Cone beam computed tomography (CBCT), often also called digital volume tomography (DVT), is increasingly utilized in maxillofacial or dental imaging. Compared to conventional CT, however, soft tissue discrimination is worse due to a reduced dose. Thus, small structures like the alveolar nerves are even harder recognizable within the image data. We show that it is nonetheless possible to accurately reconstruct the 3D bone surface and the course of the nerve in a fully automatic fashion, with a method that is based on a combined statistical shape model of the nerve and the bone and a Dijkstra-based optimization procedure. Our method has been validated on 106 clinical datasets: the average reconstruction error for the bone is 0.5 +/- 0.1 mm, and the nerve can be detected with an average error of 1.0 +/- 0.6 mm.

Staining the mRNA of a gene via in situ hybridization (ISH) during the development of a D. melanogaster embryo delivers the detailed spatio-temporal pattern of expression of the gene. Many biological problems such as the detection of co-expressed genes, co-regulated genes, and transcription factor binding motifs rely heavily on the analyses of these image patterns. The increasing availability of ISH image data motivates the development of automated computational approaches to the analysis of gene expression patterns.

Landmark correspondences can be used for various tasks in image processing such as image alignment, reconstruction of panoramic photographs, object recognition and simultaneous localization and mapping for mobile robots. The computer vision community knows several techniques for extracting and pairwise associating such landmarks using distinctive invariant local image features. Two very successful methods are the Scale Invariant Feature Transform (SIFT)1 and Multi-Scale Oriented Patches (MOPS).2
We implemented these methods in the Java programming language3 for seamless use in ImageJ.4 We use it for fully automatic registration of gigantic serial section Transmission Electron Microscopy (TEM) mosaics. Using automatically detected landmark correspondences, the registration of large image mosaics simplifies to globally minimizing the displacement of corresponding points.
We present here an introduction to automatic landmark correspondence detection and demonstrate our implementation for ImageJ. We demonstrate the application of the plug-in on diverse image data.

Full reconstruction of neuron morphology is of fundamental interest for the analysis and understanding of neuron function. We have developed a novel method capable of tracing neurons in three-dimensional microscopy data automatically. In contrast to template-based methods, the proposed approach makes no assumptions on the shape or appearance of neuron’s body. Instead, an efficient seeding approach is applied to find significant pixels almost certainly within complex neuronal structures and the tracing problem is solved by computing an graph tree structure connecting these seeds. In addition, an automated neuron comparison method is introduced for performance evaluation and structure analysis. The proposed algorithm is computationally efficient. Experiments on different types of data show promising results.

Mapping the connectivity of neurons in the brain (i.e., connectomics) is a challenging problem due to both the number of connections in even the smallest organisms and the nanometer resolution required to resolve them. Because of this, previous connectomes contain only hundreds of neurons, such as in the C.elegans connectome. Recent technological advances will unlock the mysteries of increasingly large connectomes (or partial connectomes). However, the value of these maps is limited by our ability to reason with this data and understand any underlying motifs. To aid connectome analysis, we introduce algorithms to cluster similarly-shaped neurons, where 3D neuronal shapes are represented as skeletons. In particular, we propose a novel location-sensitive clustering algorithm. We show clustering results on neurons reconstructed from the Drosophila medulla that show high-accuracy.

Gene expression patterns obtained by in situ mRNA hybridization provide important information about different genes during Drosophila embryogenesis. So far, annotations of these images are done by manually assigning a subset of anatomy ontology terms to an image. This time-consuming process depends heavily on the consistency of experts.

The development of high-resolution microscopy makes possible the high-throughput screening of cellular information, such as gene expression at single cell resolution. One of the critical enabling techniques yet to be developed is the automatic recognition or annotation of specific cells in a 3D image stack. In this paper, we present a novel graph-based algorithm, ARC, that determines cell identities in a 3D confocal image of C. elegans based on their highly stereotyped arrangement. This is an essential step in our work on gene expression analysis of C. elegans at the resolution of single cells. Our ARC method integrates both the absolute and relative spatial locations of cells in a C. elegans body. It uses a marker-guided, spatially-constrained, two-stage bipartite matching to find the optimal match between cells in a subject image and cells in 15 template images that have been manually annotated and vetted. We applied ARC to the recognition of cells in 3D confocal images of the first larval stage (L1) of C. elegans hermaphrodites, and achieved an average accuracy of 94.91%.

Digital reconstruction of 3D neuron structures is an important step toward reverse engineering the wiring and functions of a brain. However, despite a number of existing studies, this task is still challenging, especially when a 3D microscopic image has low single-to-noise ratio and discontinued segments of neurite patterns.