Longitudinal and Multimodal AI for Oncology Imaging

With global cancer incidence projected to rise by 47% by 2040, the demand for medical imaging in cancer care will increase substantially. This will worsen the existing shortage of diagnostic staff, making efficiency improvements crucial to maintaining accessible healthcare.

Radiology departments already generate vast amounts of CT scans of the abdomen and thorax for cancer patients, and interpreting these scans is both time-consuming and complex. AI-assisted reading has the potential to enhance the efficiency and quality of image-based medical diagnostics. However, most certified AI tools only evaluate scans from a single timepoint, overlooking the valuable insights gained from prior imaging—an essential component of radiologists’ assessments, especially for metastatic cancer, where follow-up imaging is crucial to evaluate treatment response.

In this research line, we aim to develop, validate, and deploy AI algorithms for cancer patients capable of combing data from multiple timepoints and integrate patients' history into the decision-making process. This research line is led by Alessa Hering.

Oncology AI group

Projects

COMFORT

We aim to improve the efficiency of kidney and prostate cancer screening by using artificial intelligence.

Read more →
ULS23

Building and Evaluating Universal Lesion Segmentation Models for Computed Tomography

Read more →
TotalReg

A foundation model for CT image registration

Read more →
OncoFuture

Improving tumor follow-up assessment

Read more →
Unstructured Textual Data Integration for Radiology Image Analysis (UTDI)

Integrating unstructured radiology reports with image analysis using large language models

Read more →

People

Alessa Hering

Alessa Hering

Assistant Professor

Myrthe Buser

Myrthe Buser

Postdoctoral Researcher

Max de Grauw

Max de Grauw

PhD Candidate

Luc Builtjes

Luc Builtjes

PhD Candidate

Lena Philipp

Lena Philipp

PhD Candidate

Sarah de Boer

Sarah de Boer

PhD Candidate

Hartmut Häntze

Hartmut Häntze

PhD Candidate

Xuan Loc Pham

Xuan Loc Pham

PhD Candidate

Rianne Weber

Rianne Weber

PhD Candidate

Niels Rocholl

Niels Rocholl

PhD Candidate

Jan Tagscherer

Jan Tagscherer

PhD Candidate

Paul Zimmer

Paul Zimmer

Master Student

Publications

  • J. Dusseljee, S. de Boer and A. Hering, "Kidney Cancer Detection Using 3D-Based Latent Diffusion Models", 2026.
  • J. Tagscherer, S. de Boer, L. Philipp, F. van der Graaf, D. Peeters, J. Bosma, L. Leijten, B. Obreja, E. Smit and A. Hering, "EvalBlocks: A Modular Pipeline for Rapidly Evaluating Foundation Models in Medical Imaging", 2026.
  • R. Weber, N. Rocholl, M. de Grauw, M. Prokop, E. Smit and A. Hering, "ULS+: Data-driven Model Adaptation Enhances Lesion Segmentation", 2026.
  • S. de Boer, H. Häntze, K. Venkadesh, M. Buser, G. Mamani, L. Xu, L. Adams, J. Nawabi, K. Bressem, B. van Ginneken, M. Prokop and A. Hering, "Robust Kidney Abnormality Segmentation: A Validation Study of an AI-Based Framework", arXiv:2505.07573, 2025.
  • L. Builtjes, J. Bosma, M. Prokop, B. van Ginneken and A. Hering, "Leveraging open-source large language models for clinical information extraction in resource-constrained settings", JAMIA Open, 2025;8.
  • H. Häntze, L. Xu, M. Rattunde, L. Donle, F. Dorfner, A. Hering, J. Nawabi, L. Adams and K. Bressem, "MRI annotation using an inversion-based preprocessing for CT model adaptation", European Radiology Experimental, 2025;9.
  • H. Häntze, M. Buser, A. Hering, L. Adams and K. Bressem, "Sex-Based Bias Inherent in the Dice Similarity Coefficient: A Model Independent Analysis for Multiple Anatomical Structures", Lecture Notes in Computer Science, 2025:125-134.
  • X. Pham, M. Prokop, B. van Ginneken and A. Hering, "Divide to conquer: a field decomposition approach for multi-organ whole-body CT image registration", Medical Imaging 2025: Image Processing, 2025:48.
    DOI
  • X. Pham, G. Vuurberg, M. Doppen, J. Roosen, T. Stille, T. Ha, T. Quach, Q. Dang, M. Luu, E. Smit, H. Mai, M. Heinrich, B. van Ginneken, M. Prokop and A. Hering, "TotalRegistrator: Towards a Lightweight Foundation Model for CT Image Registration", arXiv:2508.04450, 2025.
  • N. Rocholl, E. Smit, M. Prokop and A. Hering, "Unstable Prompts, Unreliable Segmentations: A Challenge for Longitudinal Lesion Analysis", arXiv:2507.19230, 2025.
  • L. Builtjes, M. Brink, B. van Ginneken and A. Hering, "Evaluating ChatGPT's Performance in Generating and Assessing Dutch Radiology Report Impressions", Medical Imaging with Deep Learning, 2024.
  • M. de Grauw, E. Scholten, E. Smit, M. Rutten, M. Prokop, B. van Ginneken and A. Hering, "The ULS23 Challenge: a Baseline Model and Benchmark Dataset for 3D Universal Lesion Segmentation in Computed Tomography", arXiv:2406.05231, 2024.
  • H. Häntze, L. Xu, F. Dorfner, L. Donle, D. Truhn, H. Aerts, M. Prokop, B. van Ginneken, A. Hering, L. Adams and K. Bressem, "MRSegmentator: Robust Multi-Modality Segmentation of 40 Classes in MRI and CT Sequences", arXiv:2405.06463, 2024.
  • H. Häntze, L. Xu, L. Donle, F. Dorfner, A. Hering, L. Adams and K. Bressem, "Improve Cross-Modality Segmentation by Treating MRI Images as Inverted CT Scans", arXiv:2405.03713, 2024.
  • A. Hering, S. de Boer, A. Saha, J. Twilt, D. Yakar, M. de Rooij, H. Huisman and J.S. Bosma, "Deformable MRI Sequence Registration for AI-based Prostate Cancer Diagnosis", arXiv:2404.09666, 2024.
  • A. Hering, M. Westphal, A. Gerken, H. Almansour, M. Maurer, B. Geisler, T. Kohlbrandt, T. Eigentler, T. Amaral, N. Lessmann, S. Gatidis, H. Hahn, K. Nikolaou, A. Othman, J. Moltz and F. Peisen, "Improving assessment of lesions in longitudinal CT scans: a bi-institutional reader study on an AI-assisted registration and volumetric segmentation workflow", International Journal of Computer Assisted Radiology and Surgery, 2024.
  • A. Hering, S. de Boer, A. Saha, J. Twilt, M. Heinrich, D. Yakar, M. de Rooij, H. Huisman and J.S. Bosma, "Deformable MRI Sequence Registration for AI-Based Prostate Cancer Diagnosis", Biomedical Image Registration, 2024:148-162.
  • L. Philipp, M. de Rooij, J. Hermans, M. Rutten, H. Hahn, B. van Ginneken and A. Hering, "Annotation-Efficient Strategy for Segmentation of 3D Body Composition", Medical Imaging with Deep Learning, 2024.
  • A. Hering, L. Hansen, T. Mok, A. Chung, H. Siebert, S. Hager, A. Lange, S. Kuckertz, S. Heldmann, W. Shao, S. Vesal, M. Rusu, G. Sonn, T. Estienne, M. Vakalopoulou, L. Han, Y. Huang, P. Yap, M. Brudfors, Y. Balbastre, S. Joutard, M. Modat, G. Lifshitz, D. Raviv, J. Lv, Q. Li, V. Jaouen, D. Visvikis, C. Fourcade, M. Rubeaux, W. Pan, Z. Xu, B. Jian, F. De Benetti, M. Wodzinski, N. Gunnarsson, J. Sjolund, D. Grzech, H. Qiu, Z. Li, A. Thorley, J. Duan, C. Grosbrohmer, A. Hoopes, I. Reinertsen, Y. Xiao, B. Landman, Y. Huo, K. Murphy, N. Lessmann, B. van Ginneken, A. Dalca and M. Heinrich, "Learn2Reg: Comprehensive Multi-Task Medical Image Registration Challenge, Dataset and Evaluation in the Era of Deep Learning", IEEE Transactions on Medical Imaging, 2023;42:697-712.
  • L. Philipp, "Body Composition Assessment in 3D CT Images", Master thesis, 2023.
  • M. Grauw and B. Ginneken, "Semi-supervised 3D universal lesion segmentation in CT thorax-abdomen scans", European Congress of Radiology, 2022.
  • M. Grauw, B. Ginneken, B. Geisler, E. Smit, M. Rooij, S. Schalekamp and M. Prokop, "Deep learning universal lesion segmentation for automated RECIST measurements on CT: comparison to manual assessment by radiologists", European Congress of Radiology, 2022.
  • A. Hering, A. Lange, S. Heldmann, S. Häger and S. Kuckertz, "Fraunhofer MEVIS Image Registration Solutions for the Learn2Reg 2021 Challenge", Biomedical Image Registration, Domain Generalisation and Out-of-Distribution Analysis, 2022:147-152.
  • A. Hering, S. Hager, J. Moltz, N. Lessmann, S. Heldmann and B. van Ginneken, "CNN-based Lung CT Registration with Multiple Anatomical Constraints", Medical Image Analysis, 2021;72:102139.
  • A. Hering, F. Peisen, T. Amaral, S. Gatidis, T. Eigentler, A. Othman and J. Moltz, "Whole-Body Soft-Tissue Lesion Tracking and Segmentation in Longitudinal CT Imaging Studies", Medical Imaging with Deep Learning, 2021.
  • A. Hering and S. Heldmann, "mlVIRNET: Improved Deep Learning Registration Using a Coarse to Fine Approach to Capture all Levels of Motion", Bildverarbeitung für die Medizin, 2020:175.
  • A. Hering, B. van Ginneken and S. Heldmann, "mlVIRNET: Multilevel Variational Image Registration Network", Medical Image Computing and Computer-Assisted Intervention, 2019;11769:257-265.
  • A. Hering, S. Kuckertz, S. Heldmann and M. Heinrich, "Memory-efficient 2.5D convolutional transformer networks for multi-modal deformable registration with weak label supervision applied to whole-heart CT and MRI scans", Computer Assisted Radiology and Surgery, 2019.
  • A. Hering and S. Heldmann, "Unsupervised Learning for Large Motion Thoracic CT Follow-Up Registration", Medical Imaging, 2019;10949:109491B.
  • A. Hering, S. Kuckertz, S. Heldmann and M. Heinrich, "Enhancing Label-Driven Deep Deformable Image Registration with Local Distance Metrics for State-of-the-Art Cardiac Motion Tracking", Informatik aktuell, 2019:309-314.
    DOI