ReViT-RF: A hybrid ResNet-50-Vision Transformer with a Radiomic Feature Fusion framework for lung tumor classificatio…

Flat vector medical editorial illustration of a hybrid CNN and vision transformer pipeline fusing radiomic features from a lung CT scan into TNM stagi

🤖 Generated with AI assistance · Does not replace individualized medical advice.

ReViT-RF: Hybrid Deep Learning for Lung Cancer Classification and Component-Wise TNM Staging

AI Transparency Notice: This post was generated by an AI assistant to summarize and contextualize published scientific literature. It is intended for educational and informational purposes only and does not constitute medical advice, diagnosis, or treatment recommendations. Always consult a qualified healthcare provider for clinical decisions.

Lead

A new hybrid model, ReViT-RF, combines ResNet-50 and Vision Transformers with radiomic features to classify lung nodules and predict individual TNM components. The study reports 97.62% accuracy in benign-malignant classification on the LIDC-IDRI dataset, aiming to enhance automated staging precision. PMID: 42862867

Key Facts

Metric Value Context
Classification Accuracy 97.62% Benign vs. Malignant nodule classification PMID: 42862867
Dataset LIDC-IDRI Publicly available thoracic CT database PMID: 42862867
Architecture Hybrid CNN-ViT ResNet-50 fused with Vision Transformer PMID: 42862867
Staging Output Component-wise Predicts T, N, and M stages independently PMID: 42862867

Why It Matters / Context

Lung cancer remains a leading cause of cancer-related mortality, necessitating rapid and accurate diagnostic tools. While deep learning models have shown promise in binary classification (benign vs. malignant), they often lack the granularity required for comprehensive clinical staging. Traditional Convolutional Neural Networks (CNNs) excel at capturing local morphological features but struggle with long-range spatial dependencies. Conversely, Transformer-based models capture global context but may miss fine-grained local details.

The ReViT-RF framework addresses this by integrating the complementary strengths of both architectures. By fusing deep features with handcrafted radiomic features (shape, size, texture), the model aims to provide clinically interpretable insights. Crucially, it moves beyond a single aggregated stage label to predict individual TNM components (Tumor, Node, Metastasis), which is critical for precise treatment planning. The inclusion of Grad-CAM explainability analysis further supports clinician confidence by highlighting the specific tumor regions driving the model’s predictions. PMID: 42862867

Details

The study utilized the Lung Image Database Consortium and Image Database Resource Initiative (LIDC-IDRI) dataset. The data was split into training, validation, and testing subsets using an 80:10:10 ratio. Data augmentation was applied exclusively to the training set to prevent information leakage. Preprocessing involved Contrast-Limited Adaptive Histogram Equalization (CLAHE) and intensity normalization to improve tumor visibility.

The ReViT-RF architecture operates through three main streams:

1. CNN Branch (ResNet-50): Extracts local morphological, textural, and structural characteristics.

2. Transformer Branch (ViT): Captures long-range spatial relationships and global contextual dependencies.

3. Radiomic Fusion: Integrates handcrafted radiomic features (shape, size, texture, spatial descriptors) with the deep features.

The model was trained to perform two primary tasks:

  • Binary Classification: Distinguishing benign from malignant pulmonary nodules.
  • TNM Component Prediction: For malignant cases, independently predicting the T (primary tumor extent), N (lymph node involvement), and M (metastatic status) components.
Component Description Role in Model
ResNet-50 Convolutional Neural Network Local feature extraction (morphology, texture) PMID: 42862867
Vision Transformer Attention-based Model Global context and long-range dependency capture PMID: 42862867
Radiomic Features Handcrafted Descriptors Shape, size, texture, spatial descriptors fused with deep features PMID: 42862867
Grad-CAM Explainability Tool Visualizes critical tumor regions contributing to predictions PMID: 42862867

Limitations

Critical Consideration: The study relies on the LIDC-IDRI dataset, which is a retrospective, single-center (or multi-center but non-prospective) collection. Performance metrics such as the 97.62% accuracy are derived from this specific dataset and may not generalize to diverse, real-world clinical populations with varying scanner types, protocols, or patient demographics. Furthermore, the study does not report external validation on independent cohorts, which is a standard requirement for clinical deployment. The component-wise TNM predictions, while promising, lack reported sensitivity/specificity breakdowns for each individual T, N, and M category in the provided abstract, making it difficult to assess the reliability of specific staging elements. PMID: 42862867

Clinical Takeaway

While ReViT-RF demonstrates high accuracy in automated lung nodule classification and component-wise staging, its clinical utility remains unproven outside the LIDC-IDRI dataset; prospective, multi-institutional validation is required before integration into diagnostic workflows.

Full Reference

DA S, B RN. ReViT-RF: A hybrid ResNet-50-Vision Transformer with a Radiomic Feature Fusion framework for lung tumor classification and TNM-based stage prediction using CT images. PloS one. 2026. PMID: 42862867 [DOI: 10.1371/journal.pone.0359211]