Automatic Segmentation and Visualization of Choroid in OCT with Knowledge Infused Deep Learning [article]

Huihong Zhang, Jianlong Yang, Kang Zhou, Fei Li, Yan Hu, Yitian Zhao, Ce Zheng, Xiulan Zhang, Jiang Liu
<span title="2020-09-08">2020</span> <i title="Institute of Electrical and Electronics Engineers"> <a target="_blank" rel="noopener" href="https://fatcat.wiki/container/q2z26obphvchndqieqd65vltle" style="color: black;">IEEE journal of biomedical and health informatics</a> </i> &nbsp; <span class="release-stage">accepted</span>
The choroid provides oxygen and nourishment to the outer retina thus is related to the pathology of various ocular diseases. Optical coherence tomography (OCT) is advantageous in visualizing and quantifying the choroid in vivo. (1) The lower boundary of the choroid (choroid-sclera interface) in OCT is fuzzy, which makes the automatic segmentation difficult and inaccurate. (2) The visualization of the choroid is hindered by the vessel shadows from the superficial layers of the inner retina. In
more &raquo; ... is paper, we propose to incorporate medical and imaging prior knowledge with deep learning to address these two problems. We propose a biomarker infused global-to-local network for the choroid segmentation. It leverages the choroidal thickness, a primary biomarker in clinic, as a constraint to improve the segmentation accuracy. We also design a global-to-local strategy in the choroid segmentation: a global module is used to segment all the retinal and choroidal layers simultaneously for suppressing overfitting and providing global structure information, then a local module is used to refine the segmentation with the biomarker infusion. To eliminate the retinal vessel shadows, we propose a pipeline that firstly use anatomical and OCT imaging knowledge to locate the shadows using their projection on the retinal pigment epithelium layer, then the contents of the choroidal vasculature at the shadow locations are predicted with an edge-to-texture generative adversarial inpainting network. The experiments show our method outperforms the existing methods on both the segmentation and shadow elimination tasks. We further apply the proposed method in a clinical prospective study for understanding the pathology of glaucoma by detecting the structure and vascular changes of the choroid related to the elevation of intra-ocular pressure.
<span class="external-identifiers"> <a target="_blank" rel="external noopener noreferrer" href="https://doi.org/10.1109/jbhi.2020.3023144">doi:10.1109/jbhi.2020.3023144</a> <a target="_blank" rel="external noopener" href="https://www.ncbi.nlm.nih.gov/pubmed/32931435">pmid:32931435</a> <a target="_blank" rel="external noopener" href="https://arxiv.org/abs/2002.04712v2">arXiv:2002.04712v2</a> <a target="_blank" rel="external noopener" href="https://fatcat.wiki/release/nfcxejpqy5dbdora35prdjobee">fatcat:nfcxejpqy5dbdora35prdjobee</a> </span>
<a target="_blank" rel="noopener" href="https://web.archive.org/web/20201003000139/https://arxiv.org/pdf/2002.04712v2.pdf" title="fulltext PDF download" data-goatcounter-click="serp-fulltext" data-goatcounter-title="serp-fulltext"> <button class="ui simple right pointing dropdown compact black labeled icon button serp-button"> <i class="icon ia-icon"></i> Web Archive [PDF] </button> </a> <a target="_blank" rel="external noopener noreferrer" href="https://doi.org/10.1109/jbhi.2020.3023144"> <button class="ui left aligned compact blue labeled icon button serp-button"> <i class="external alternate icon"></i> Publisher / doi.org </button> </a> <a target="_blank" rel="external noopener" href="https://arxiv.org/abs/2002.04712v2" title="arxiv.org access"> <button class="ui compact blue labeled icon button serp-button"> <i class="file alternate outline icon"></i> arxiv.org </button> </a>