Deep Learning Based Registration of Serial Whole-slide Histopathology Images in Different Stains release_2frvqbo7ffaevjdjv46u55q2tm

by Mousumi Roy, Fusheng Wang, George Teodoro, Ritu Aneja, Jun Kong, other paper in another context

Released as a post by Cold Spring Harbor Laboratory.

2022  

Abstract

<jats:title>Abstract</jats:title>Whole-slide image (WSI) analysis has been largely performed in a 2D tissue space to support routine pathology diagnosis and imaging based biomedical research. For a more definitive representation and characterization of the tissue spatial space, it is critical to extend such tissue based investigations to a 3D space by spatially aligning 2D serial sections, which are often stained differently, such as Hematoxylin and Eosin (H&amp;E) and Immunohistochemistry (IHC) stains. However, registration of whole slide images is challenged by the overwhelmingly scale of images, the complexity of local histology structure changes across slides, and significant variations of tissue appearance between staining methods. We propose a novel translation based registration network CycGANReg-Net using deep learning for serial WSI images in different stains, which requires no prior deformation field information for deep model training. We first generate synthetic IHC slides from H&amp;E slides through a robust image synthesis algorithm. The synthetic IHC images and the real IHC images are then registered through a Fully Convolutional Network with multi-scale based deformable vector fields and a joint loss optimization for enhancing image alignment. We perform the registration at original image resolution with a patch-wide approach, thus tissue details at the highest resolution are retained in the results. CycGANRegNet out-performs both the state-of-the-art conventional and deep learning-based registration methods based on the evaluation using a serial WSI image dataset in H&amp;E stain and IHC stain with two biomarkers from 76 breast cancer patients. The experimental and comparison results demonstrate that CycGANRegNet can produce promising registration results with serial WSIs in different stains, suggesting its potential for integrative 3D tissue-based biomedical investigations.
In application/xml+jats format

Archived Files and Locations

application/pdf  12.1 MB
file_d6enpnkdubcjvjfzj56amnp56y
www.biorxiv.org (repository)
web.archive.org (webarchive)
Read Archived PDF
Preserved and Accessible
Type  post
Stage   unknown
Date   2022-06-01
Work Entity
access all versions, variants, and formats of this works (eg, pre-prints)
Catalog Record
Revision: 5b33bbae-37e6-415e-a28c-bca4132a7bed
API URL: JSON