Colorectal Lesion diagnosis using transformer and deep learning with multiscale feature interface.

🤖 Generated with AI assistance · Does not replace individualized medical advice.

AI Act Transparency Notice

This content was generated with the assistance of artificial intelligence tools. It is intended for informational and educational purposes only and does not constitute medical advice, diagnosis, or treatment. Always seek the advice of a qualified health provider with any questions regarding a medical condition.

CDCTNet: A Hybrid CNN-Transformer Approach for Colorectal Lesion Diagnosis

CDCTNet, a hierarchical deep learning model, integrates convolutional neural networks with Vision Transformers to enhance global feature correlation in colorectal lesion diagnosis. Evaluated on Kather and Kvasir datasets, the model achieved 96.60% precision and 95.02% Kappa scores, addressing limitations of classical CNNs in capturing global attention. PMID: 42691064

Key Facts

Metric Value Context
Precision 96.60% High accuracy in positive predictions PMID: 42691064
Kappa Score 95.02% Strong agreement beyond chance PMID: 42691064
Recall 98.08% High sensitivity for lesion detection PMID: 42691064
F1 Score 97.94% Balanced measure of precision and recall PMID: 42691064

Why It Matters / Context

Colorectal cancer (CRC) remains the third most common malignancy worldwide, posing a significant burden on healthcare systems due to the need for expert manual screening and resource-intensive diagnostic processes. PMID: 42691064 While artificial intelligence has increasingly been adopted to reduce computational burden and diagnostic time, traditional machine learning models often rely on handcrafted features, making them expertise-dependent and less scalable. PMID: 42691064

Conversely, classical Convolutional Neural Networks (CNNs), while effective at extracting local spatial features, frequently fail to capture the global attention mechanisms necessary for comprehensive feature map correlation. PMID: 42691064 This limitation can result in missed subtle patterns that span larger regions of the tissue image. The introduction of CDCTNet (Colorectal Diagnosis Convolution Transformer Network) addresses this gap by creating a hierarchical model that synergizes the local feature extraction capabilities of CNNs with the global correlation strengths of Vision Transformers (ViT). PMID: 42691064

The model’s architecture is designed to overcome the inherent trade-offs between local and global feature processing. By utilizing two convolution blocks, CDCTNet extracts high-dimensional spatial features from the lesion, while a parallel ViT encoder provides global correlation of the feature map. PMID: 42691064 Crucially, the authors designed an Interaction of Embedding Modules (IEM) block to facilitate the interaction between these two streams, thereby improving attention on critical features. PMID: 42691064 This hybrid approach represents a significant step forward in automated histopathology and endoscopic image analysis, potentially reducing the dependency on scarce expert resources for initial screening.

Details

The CDCTNet architecture is defined by its parallel processing streams and the specific interaction mechanism between them. The following table outlines the core components and their reported performance metrics on the Kather and Kvasir datasets.

Component / Metric Description / Value Role in Model
Convolution Blocks 2 Blocks Extract local high-dimensional spatial features from the lesion PMID: 42691064
ViT Encoder Parallel Stream Provides global correlation of the feature map PMID: 42691064
IEM Block Interaction Module Facilitates feature interaction between CNN and ViT to improve attention PMID: 42691064
Precision 96.60% Ratio of true positives to all positive predictions PMID: 42691064
Kappa Score 95.02% Measure of inter-rater agreement PMID: 42691064
Recall 98.08% Ratio of true positives to all actual positives PMID: 42691064
F1 Score 97.94% Harmonic mean of precision and recall PMID: 42691064

The evaluation was conducted on two distinct datasets: Kather and Kvasir. The Kather dataset typically consists of histopathology images, while the Kvasir dataset comprises endoscopic images. The high performance across these different modalities suggests the model’s robustness in handling diverse imaging inputs. PMID: 42691064 The specific design of the IEM block is highlighted as a key innovation, as it explicitly addresses the “missed global attention” problem in classical CNNs by forcing a structured interaction between local and global feature representations. PMID: 42691064

Limitations

Critical Appraisal:

The study reports high performance metrics (Precision 96.60%, Recall 98.08%) on the Kather and Kvasir datasets. PMID: 42691064 However, the abstract does not provide details on external validation cohorts, which is a critical requirement for clinical translation. PMID: 42691064 Furthermore, the study does not specify the class balance of the datasets or the specific confusion matrix breakdown, which is essential for understanding false-positive rates in a clinical screening context. PMID: 42691064 The reliance on two specific public datasets may limit the generalizability of the model to diverse patient populations or different imaging equipment standards. PMID: 42691064 Additionally, the computational cost of running a hybrid CNN-Transformer model in real-time clinical settings is not addressed in the provided abstract. PMID: 42691064

Clinical Takeaway

Clinicians should view CDCTNet as a promising research prototype for automated lesion screening, but its clinical utility remains unproven until validated in prospective, multi-center trials with diverse patient populations.

Full Reference

Yadav DP, Sharma B, Webber JL, Mehbodniya A. Colorectal Lesion diagnosis using transformer and deep learning with multiscale feature interface. PloS one. 2026. PMID: 42691064 [DOI: 10.1371/journal.pone.0357664]