DeepContrast: Deep Tissue Contrast Enhancement using Synthetic Data Degradations and OOD Model Predictions.

First Authors Nuno P Martins
Authors Nuno P Martins, Yannis Kalaidzidis, Marino Zerial, Florian Jug
Corresponding Authors
Last Authors Florian Jug
Conference Proceedings Volume Title 2023 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION WORKSHOPS, ICCVW
Series Title IEEE International Conference on Computer Vision Workshops
Conference Name IEEE/CVF International Conference on Computer Vision (ICCV)
Conference Location Paris, FRANCE
Conference Start Date 2023-10-02
Conference End Date 2023-10-06
Chapter Number
Publisher IEEE
Conference Proceedings Editors
ISBN 979-8-3503-0744-3
First Page 3830
Last Page 3839
Open Access false
Print Publication Date 2023-10-06
Online Publication Date 2023-10-06
Abstract Microscopy images are crucial for life science research, allowing detailed inspection and characterization of cellular and tissue-level structures and functions. However, microscopy data are unavoidably affected by image degradations, such as noise, blur, or others. Many such degradations also contribute to a loss of image contrast, which becomes especially pronounced in deeper regions of thick samples. Today, best performing methods to increase the quality of images are based on Deep Learning approaches, which typically require ground truth (GT) data during training. Our inability to counteract blurring and contrast loss when imaging deep into samples prevents the acquisition of such clean GT data. The fact that the forward process of blurring and contrast loss deep into tissue can be modeled, allowed us to propose a new method that can circumvent the problem of unobtainable GT data. To this end, we first synthetically degraded the quality of microscopy images even further by using an approximate forward model for deep tissue image degradations. Then we trained a neural network that learned the inverse of this degradation function from our generated pairs of raw and degraded images. We demonstrated that networks trained in this way can be used out-of-distribution (OOD) to improve the quality of less severely degraded images, e.g. the raw data imaged in a microscope. Since the absolute level of degradation in such microscopy images can be stronger than the additional degradation introduced by our forward model, we also explored the effect of iterative predictions. Here, we observed that in each iteration the measured image contrast kept improving while detailed structures in the images got increasingly removed. Therefore, dependent on the desired downstream analysis, a balance between contrast improvement and retention of image details has to be found.
Cover Image
Affiliated With Zerial, Jug
Selected By
Acknowledged Services
Publication Status Published
Edoc Link
Sfx Link
DOI 10.1109/ICCVW60793.2023.00414
PubMed ID
WebOfScience Link WOS:001156680303101
Alternative Full Text URL https://arxiv.org/pdf/2308.08365
Display Publisher Download Only false
Visible On MPI-CBG Website true
PDF Downloadable true
Created By thuem
Added Date 2024-06-11
Last Edited By thuem
Last Edited Date 2024-06-11 15:26:29.879
Library ID 8734
Document ID
Entry Complete true
eDoc Compliant true
Include in Edoc Report true
In Pure false
Ready for eDoc Export false
Author Affiliations Complete false
Project Name
Project URL
Grant ID
Funding Programme
Funding Organisation