UNSURE2024
Uncertainty for Safe Utilization of Machine Learning in Medical Imaging

Recent Updates

Important Dates

  • June 24, 2024 Paper Submission Deadline (23:59 PST)
  • July 10, 2024 Reviews due
  • July 15, 2024 Publication of decisions
  • August 1, 2024 Camera ready submissions due
  • October 10, 2024 Workshop date

About the MICCAI UNSURE Workshop

Overview

With the rise and influence of machine learning (ML) in medical application and the need to translate newly developed techniques into clinical practice, questions about safety and uncertainty over measurements and reported quantities have gained importance. Obtaining accurate measurements is insufficient, as one needs to establish the circumstances under which these values generalize, or give appropriate error bounds for these measures. This is becoming particularly relevant to patient safety as many research groups and companies have deployed or are aiming to deploy ML technology in clinical practice.

The purpose of this workshop is to develop awareness and encourage research on uncertainty modelling to ensure safety for applications spanning both the MIC and CAI fields. In particular, this workshop invites submissions to cover different facets of this topic, including but not limited to: detection and quantification of algorithmic failures; processes of healthcare risk management (e.g. CAD systems); robustness and adaptation to domain shifts; evaluation of uncertainty estimates; defence against noise and mistakes in data (e.g. bias, label mistakes, measurement noise, inter/intra-observer variability). The workshop aims to encourage contributions in a wide range of applications and types of ML algorithms. The use or development of any relevant ML methods are welcomed, including, but not limited to, probabilistic deep learning, Bayesian nonparametric statistics, graphical models and Gaussian processes. We also aim to ensure broad coverage of applications in the context of both MIC and CAI, which are categorized into reporting problems (descriptions of image contents) such as diagnosis, measurements, segmentation, detection, and enhancement problems (addition of information) such as image synthesis, registration, reconstruction, super-resolution, harmonisation, inpainting and augmented display.

Details

In the last few years, machine learning (ML) techniques have permeated many aspects of the MICCAI community, leading to substantial progress in a wide range of applications ranging from image analysis to surgical assistance. However, in medical applications, algorithms ultimately assist life and death decisions, and translation of such innovations into practice requires a measure of safety. In practice, ML systems often face situations where the correct decision is ambiguous, and therefore principled mechanisms for quantifying uncertainty are required to envision potential practical deployment.

Safety is indeed paramount in medical imaging applications, where images inform scientific conclusions in research, and diagnostic, prognostic or interventional decisions in clinics. However, efforts have mostly focused on improving the accuracy, while systematic approaches ensuring safety of medical imaging-derived automated systems are largely lacking in the existing body of research.

Uncertainty quantification has recently attracted attention in the MICCAI community as a promising approach to provide a reliability metric of the output, and as a mechanism to communicate the knowledge boundary of such ML systems. Spurred on by this emergent interest, the workshop will encourage discussions on the topic of uncertainty modelling and alternative approaches for risk management in a wide range of medical applications. It aims thereby to highlight both fundamental and practical challenges that need to be addressed to achieve safer implementations of ML systems in the clinical world.

Format

The UNSURE workshop will be held as an in-person, half-day satellite event of MICCAI 2024 in Marrakech. The workshop will be joined with the Uncertainty Tutorial this year.

Call for Papers

Scope

We accept submissions of original, unpublished work on safety and uncertainty in medical imaging, including (but not limited to) the following areas:

  • Uncertainty quantification in any MIC or CAI applications
  • Risk management of ML systems in clinical pipelines
  • Out-of-distribution and anomaly detection
  • Defending against hallucinations in enhancement tasks (e.g. super-resolution, reconstruction, modality translation)
  • Robustness to domain shifts
  • Measurement errors
  • Modelling noise in data (e.g. labels, measurements, inter/intra-observer variability)
  • Validation of uncertainty estimates
  • Active Learning
  • Confidence bounds
  • Posterior inference over point estimates
  • Bayesian deep learning
  • Graphical models
  • Gaussian processes
  • Calibration of uncertainty measures
  • Bayesian decision theory

Submission Format

Our submission guidelines follow the guidelines of the main MICCAI conference. Submissions must be 8-page papers (excluding references) following the Springer LNCS format. Author names, affiliations and acknowledgements, as well as any obvious phrasings or clues that can identify authors must be removed to ensure anonymity. Note that the 8 page limit refers only to the main content. Including references and acknowledgements the submission may exceed 8 pages.


Analogous to the main conference we also allow supplementary materials in the form of a maximum 2-page PDF with tables, figures or proofs, and captions not exceeding 100 words. Multi-media materials such as videos are also allowed. Please refer to Section 5 of the MICCAI conference submission guidelines for more details.

How to submit?

Please submit papers using the paper submission system.

Submission Deadline: June 25, 2024 - 23:59 (PST)

Publication

All accepted papers will be published as part of the MICCAI Satellite Events joint LNCS proceedings to be published by Springer Nature.

UNSURE 2024 Organizing Committee

Organizers

In alphabetical order

Raghav Mehta

Imperial College London

Cheng Ouyang

Imperial College London

Chen Qin

Imperial College London

Carole Sudre

MRC Unit for Lifelong Health and Ageing, University College London / Centre for Medical Image Computing, University College London / Department of Biomedical Engineering, King's College London

William (Sandy) Wells

Radiology, BWH, Harvard Medical School

Program Committee

  • Adrian Galdran (Universitat Pompeu Fabra)
  • Cheng Ouyang (Imperial College London)
  • Chloe He (University College London)
  • Di Qiu (The Chinese University of Hong Kong)
  • Dimitri Hamzaoui (INRIA)
  • Evan Yu (Cornell University)
  • Fons van der Sommen (Eindhoven University of Technology)
  • Hariharan Ravishankar (GE Healthcare)
  • Hongwei Li (Technical University of Munich)
  • Hongxiang Lin (University College London / Zheijiang Lab)
  • Isaac Llorente Saguer (University College London)
  • Ishaan Bhat (University Medical Center Utrecht)
  • Jacob Carse (University of Dundee)
  • Jinwei Zhang (Cornell University)
  • Leo Joskowicz (Hebrew University of Jerusalem)
  • Liane Canas (King's College London)
  • Luke Whitbread (University of Adelaide)
  • Mark Graham (King's College London)
  • Matthew Baugh (Imperial College London)
  • Max-Heinrich Laves (Leibniz Universitat Hannover)
  • Neil Oxtoby (University College London)
  • Parinaz Roshanzamir (Concordia University)
  • Pedro Borges (King's College London)
  • Prasad Sudhakar (GE Healthcare)
  • Prerak Mody (Leiden University Medical Centre)
  • Robin Camarasa (Erasmus Medical Centre)
  • Stephen J. McKenna (University of Dundee)
  • Tim Adler (DKFZ)
  • Tristan Glatard (Concordia University)
  • William Consagra (Harvard Medical School)
  • Won Hwa Kim (POSTECH)
  • Yiming Xiao (Concordia University)
  • Yipeng Hu (University College London)
  • Contact

    For general inquiries please send an email to: unsure@mit.edu