Awesome-Radiology-Report-Generation

We collect existing papers on radiology report generation published in prominent conferences and journals.

This paper list will be continuously updated at the end of each month.

Survey

A Systematic Review of Deep Learning-based Research on Radiology Report Generation (arXiv 2311) [paper]
A Survey of Deep Learning-based Radiology Report Generation Using Multimodal Data (arXiv 2405) [paper]
Automated Radiology Report Generation: A Review of Recent Advances (IEEE Reviews in Biomedical Engineering'24) [paper]

Dataset

MIMIC-CXR-JPG, a large publicly available database of labeled chest radiographs (MIMIC-CXR) [paper][data].
Preparing a collection of radiology examinations for distribution and retrieval (IU X-ray) [paper][data].
Learning Visual-Semantic Embeddings for Reporting Abnormal Findings on Chest X-rays (MIMIC-ABN) [paper][code]
An efficient but effective writer: Diffusion-based semi-autoregressive transformer for automated radiology report generation (XRG-COVID-19) [paper][data].
HistGen: Histopathology Report Generation via Local-Global Feature Encoding and Cross-modal Context Interaction (HistGen WSI) [paper][data].
CheXpert Plus: Hundreds of Thousands of Aligned Radiology Texts, Images and Patients (CheXpert Plus) [paper] [data]
CXR-PRO: MIMIC-CXR with Prior References Omitted (CXR-PRO) [data]
MS-CXR: Making the Most of Text Semantics to Improve Biomedical Vision-Language Processing (MS-CXR) [data]

Metrics

FineRadScore: A Radiology Report Line-by-Line Evaluation Technique Generating Corrections with Severity Scores (arXiv'2405) [paper][code]
FActScore: Fine-grained Atomic Evaluation of Factual Precision in Long Form Text Generation (EMNLP'23) [paper][code]
DocLens: Multi-aspect Fine-grained Evaluation for Medical Text Generation (ACL'24) [paper][code]
RaTEScore: A Metric for Radiology Report Generation [paper][code]

Papers

2024

AAAI'24

Automatic Radiology Reports Generation via Memory Alignment Network [paper] [code]
PromptMRG: Diagnosis-Driven Prompts for Medical Report Generation [paper][[code]]
Bootstrapping Large Language Models for Radiology Report Generation [paper] [code]

CVPR'24

Instance-level Expert Knowledge and Aggregate Discriminative Attention for Radiology Report Generation [paper] [code]
AHIVE: Anatomy-aware Hierarchical Vision Encoding for Interactive Radiology Report Retrieval [paper] [[code]]
InVERGe: Intelligent Visual Encoder for Bridging Modalities in Report Generation [paper][code]

ACL'24

** [paper] [code]

EMNLP'24

** [paper] [code]

MICCAI'24

Textual Inversion and Self-supervised Refinement for Radiology Report Generation [paper] [[code]]
Structural Entities Extraction and Patient Indications Incorporation for Chest X-ray Report Generation [paper] [code]

BIBM'24

** [paper] [code]

ICASSP'24

** [paper] [code]

MedIA'24

** [paper] [code]

TMI'24

Multi-grained Radiology Report Generation with Sentence-level Image-language Contrastive Learning [paper] [[code]]
SGT++: Improved Scene Graph-Guided Transformer for Surgical Report Generation [paper][[code]]
PhraseAug: An Augmented Medical Report Generation Model with Phrasebook [paper] [[code]]
Token-Mixer: Bind Image and Text in One Embedding Space for Medical Image Reporting [paper] [code]

TCSVT'24

** [paper] [code]

TNNLS'24

** [paper] [code]

TMM'24

Semi-Supervised Medical Report Generation via Graph-Guided Hybrid Feature Consistency [paper] [[code]]
Multi-Level Objective Alignment Transformer for Fine-Grained Oral Panoramic X-Ray Report Generation [paper] [[code]]

JBHI'24

CAMANet: Class Activation Map Guided Attention Network for Radiology Report Generation [paper] [code]
TSGET: Two-Stage Global Enhanced Transformer for Automatic Radiology Report Generation [paper] [code]
CAMANet: Class Activation Map Guided Attention Network for Radiology Report Generation [paper] [code]

Expert Systems with Applications'24

CheXReport: A transformer-based architecture to generate chest X-ray reports suggestions [paper][code]

Neurocomputing'24

Improving radiology report generation with multi-grained abnormality prediction [paper]

arXiv papers'24

Factual Serialization Enhancement: A Key Innovation for Chest X-ray Report Generation [paper] [code]
FITA: Fine-grained Image-Text Aligner for Radiology Report Generation [paper] [[code]]
GREEN: Generative Radiology Report Evaluation and Error Notation [paper] [[code]]
CheXpert Plus: Hundreds of Thousands of Aligned Radiology Texts, Images and Patients [paper] [code]
Topicwise Separable Sentence Retrieval for Medical Report Generation [paper] [[code]]
Dia-LLaMA: Towards Large Language Model-driven CT Report Generation [paper] [[code]]
ICON: Improving Inter-Report Consistency of Radiology Report Generation via Lesion-aware Mix-up Augmentation [paper] [code]
CT2Rep: Automated Radiology Report Generation for 3D Medical Imaging [paper] [code]
MAIRA-2: Grounded Radiology Report Generation [paper][[code]]
Benchmarking and Boosting Radiology Report Generation for 3D High-Resolution Medical Images [paper]
The Impact of Auxiliary Patient Data on Automated Chest X-Ray Report Generation and How to Incorporate It [paper]
Improving Expert Radiology Report Summarization by Prompting Large Language Models with a Layperson Summary [paper]

2023

AAAI'23

** [paper] [code]

CVPR'23

KiUT: Knowledge-injected U-Transformer for Radiology Report Generation [paper] [[code]]
METransformer: Radiology report generation by transformer with multiple learnable expert tokens [paper][[code]]
Dynamic Graph Enhanced Contrastive Learning for Chest X-Ray Report Generation [paper] [code]
Interactive and Explainable Region-guided Radiology Report Generation [paper][code]

ACL'23

ORGAN: Observation-Guided Radiology Report Generation via Tree Reasoning [paper] [code]

EMNLP'23

RECAP: Towards Precise Radiology Report Generation via Dynamic Disease Progression Reasoning [paper] [code]
Normal-Abnormal Decoupling Memory for Medical Report Generation [paper] [code]
Style-Aware Radiology Report Generation with RadGraph and Few-Shot Prompting [paper] [[code]]

MICCAI'23

** [paper] [code]

BIBM'23

** [paper] [code]

ML4H'23

Pragmatic Radiology Report Generation [paper] [code]

ICASSP'23

Improving Radiology Report Generation with D 2-Net: When Diffusion Meets Discriminator [paper] [[code]]

MedIA'23

Radiology report generation with a learned knowledge base and multi-modal alignment [paper] [code]

TMI'23

** [paper] [code]
Attributed Abnormality Graph Embedding for Clinically Accurate X-Ray Report Generation [paper][[code]]

TCSVT'23

** [paper] [code]

TNNLS'23

** [paper] [code]

TMM'23

From Observation to Concept: A Flexible Multi-view Paradigm for Medical Report Generation [paper] [[code]]
Joint Embedding of Deep Visual and Semantic Features for Medical Image Report Generation [paper] [[code]]

JBHI'23