Connectomics from electron microscopy

Algorithms, software pipelines, and volume assembly for large-scale serial-section TEM and block-face SEM: mosaicking, registration, annotation viewers, and learning-based segmentation for neural circuit reconstruction.

Reconstructing neural connectivity from electron microscopy requires imaging at synaptic resolution across volumes that can reach terabytes, together with reliable alignment of thousands of tiles per section and hundreds of sections in depth. In this line of work we contributed methods and tools that span the stack: automatic mosaicking and slice-to-slice registration (ir-tools), web-scale volume browsing and annotation (Viking), axon tracking in serial block-face SEM, hierarchical and cascaded models for EM image segmentation, and joint ultrastructural and molecular imaging frameworks that combine serial-section TEM with computational molecular phenotyping. Applications included the RC1 retinal connectome dataset and workflows for whole-section brain mosaics at light-microscopy scale. This project is retained as a reference for prior EM connectomics contributions; it is not an active research thrust in the current group portfolio.

Together these efforts aimed to make connectome-scale EM analysis more practical—reducing manual labor for alignment and tracing, and providing classifiers that respect the noise and anisotropy of real EM stacks—while keeping human annotation in the loop where automation is still insufficient.

Illustration: Connectomics from electron microscopy

Status: completed

Topics

ConnectomicsSerial-section EMVolume registrationSegmentation

Related publications

Figure: SSHMT: Semi-supervised Hierarchical Merge Tree for Electron Microscopy Image Segmentation

SSHMT: Semi-supervised Hierarchical Merge Tree for Electron Microscopy Image Segmentation

Ting Liu, Miaomiao Zhang, Mehran Javanmardi, Nisha Ramesh, Tolga Tasdizen

European Conference on Computer Vision (ECCV 2016) 2016

A modular hierarchical approach to 3D electron microscopy image segmentation

Ting Liu, Cory Jones, Mojtaba Seyedhosseini, Tolga Tasdizen

Journal of Neuroscience Methods 2014

Image Segmentation with Cascaded Hierarchical Models and Logistic Disjunctive Normal Networks

Mojtaba Seyedhosseini, Mehdi Sajjadi, Tolga Tasdizen

IEEE International Conference on Computer Vision (ICCV) 2013

Exploring the retinal connectome

James R. Anderson, Bryan W. Jones, Carl B. Watt, Margaret V. Shaw, Jia-Hui Yang, David DeMill, James S. Lauritzen, Yanhua Lin, Kevin D. Rapp, David Mastronarde, et al.

Molecular Vision 2011

Three-dimensional reconstruction of serial mouse brain sections: solution for flattening high-resolution large-scale mosaics

Monica L. Berlanga, Sébastien Phan, Eric A. Bushong, Stephanie Wu, Ohkyung Kwon, Binh S. Phung, Steve Lamont, Masako Terada, Tolga Tasdizen, Maryann E. Martone, et al.

Frontiers in Neuroanatomy 2011

A Computational Framework for Ultrastructural Mapping of Neural Circuitry

James R. Anderson, Bryan W. Jones, Jia-Hui Yang, Marguerite V. Shaw, Carl B. Watt, Pavel Koshevoy, Joel Spaltenstein, Elizabeth Jurrus, Kannan UV, Ross T. Whitaker, et al.

PLOS Biology 2009

Axon Tracking in Serial Block-Face Scanning Electron Microscopy

Elizabeth Jurrus, Melissa Hardy, Tolga Tasdizen, P. Thomas Fletcher, Pavel Koshevoy, Chi-Bin Chien, Winfried Denk, Ross T. Whitaker

Medical Image Analysis 2009