By the same authors

From the same journal

From the same journal

Uncertainty Estimation for Stereo Matching Based on Evidential Deep Learning

Research output: Contribution to journalArticlepeer-review

Author(s)

  • Chen Wang
  • Xiang Wang
  • Jiawei Zhang
  • Liang Zhang
  • Xiao Bai
  • Xin Ning
  • Jun Zhou
  • Edwin Hancock

Department/unit(s)

Publication details

Journal Pattern Recognition
DateAccepted/In press - 9 Dec 2021
DateE-pub ahead of print (current) - 10 Dec 2021
Number of pages35
Early online date10/12/21
Original languageEnglish

Abstract

Although deep learning-based stereo matching approaches have achieved excellent performance in recent years, it is still a non-trivial task to estimate the uncertainty of the produced disparity map. In this paper, we propose a novel approach to estimate both aleatoric and epistemic uncertainties for stereo matching in an end-to-end way. We introduce an evidential distribution, named Normal Inverse-Gamma (NIG) distribution, whose parameters can be used to calculate the uncertainty. Instead of directly regressed from aggregated features, the uncertainty parameters are predicted for each potential disparity and then averaged via the guidance of matching probability distribution. Furthermore, considering the sparsity of ground truth in real scene datasets, we design two additional losses. The first one tries to enlarge uncertainty on incorrect predictions, so uncertainty becomes more sensitive to erroneous regions. The second one enforces the smoothness of the uncertainty in the regions with smooth disparity. Most stereo matching models, such as PSM-Net, GA-Net, and AA-Net, can be easily integrated with our approach. Experiments on multiple benchmark datasets show that our method improves stereo matching results. We prove that both aleatoric and epistemic uncertainties are well-calibrated with incorrect predictions. Particularly, our method can capture increased epistemic uncertainty on out-of-distribution data, making it effective to prevent a system from potential fatal consequences. Code is available at https://github.com/Dawnstar8411/StereoMatching-Uncertainty

    Research areas

  • Stereo Matching, Uncertainty Estimation, Evidential Deep Learning

Discover related content

Find related publications, people, projects, datasets and more using interactive charts.

View graph of relations