ICCV 2023 Tutorial

🎭 The Many Faces of Reliability of Deep Learning for Real-World Deployment 🌍

Tuesday, October 3rd 2023, 08:30 - 13:00
Room S05
Paris, France


Puneet Dokania

U. Oxford, Five AI


How reliably can one deploy Deep Neural Networks (DNNs) to real-world applications? Answering this very question requires understanding all the relevant failure modes of DNNs, which have been largely investigated, however in small subsets and independently by different subgroups of researchers from multiple communities. Nevertheless, these failure modes might not be as dissimilar as we think they are, and to understand their interplay, similarities and dissimilarities, it is important to discuss them together. This is precisely the goal of our proposed tutorial where we will offer an overview of the efforts towards reliable DNNs (main challenges, evaluations, research directions, and trends) as well as in-depth coverage of the various paradigms for achieving it (uncertainty estimation, calibration, OOD detection, robustness to distribution shift).

A vast amount of literature in both machine learning and computer vision communities addressed recently one or more specific facets of reliability. This tutorial will focus on pragmatic and scalable approaches that can effectively improve reliability on complex computer vision tasks: from image classification trained on large repositories (e.g., ImageNet) to automatic perception for autonomous driving (object detection, segmentation, depth estimation, etc.). Specifically, the proposed tutorial would cover the following subjects: (1) Uncertainty estimation and different blindspots of modern DNNs, (2) Efficient Deep Ensembles, (3) Calibration of DNNs, (4) Out-of-distribution detection, (5) Robustness and generalization under distribution shift (adverse weather conditions).


08:30 - 08:50 Setting the stage: reliability in the real world by Patrick [slides] [video]

08:50 - 09:25 Uncertainty estimation and next generation ensembles by Andrei [slides] [video]

09:25 - 10:20 Calibration of Deep Neural Networks by Puneet [slides]

10:20 - 10:50 Break

10:50 - 11:40 Out-of-distribution detection by Sharon [slides] [video]

11:45 - 12:40 Domain adaptation on wheels by Dengxin and Tuan-Hung [slides]

12:40 - 12:50 Performance monitoring by Andrei [slides] [video]

12:50 - 13:00 Closing remarks + Q&A by All [slides] [video]

Please contact Andrei Bursuc for any questions.

This webpage template is by courtesy of Georgia Gkioxari.

Last updated: 25 October 2023