Independent evaluation of machine learning and deep learning models for breast cancer detection.

Abstract editorial illustration of two AI paradigms, tabular ML models and deep learning on imaging, converging into one clinical decision

🤖 Generated with AI assistance · Does not replace individualized medical advice.

AI in Breast Cancer Detection: Deep Learning Outperforms Traditional ML on Imaging Data

AI Transparency Notice: This post was generated by an AI assistant to summarize and contextualize published scientific literature. It is for informational purposes only and does not constitute medical advice, diagnosis, or treatment recommendations. Always consult a qualified healthcare provider for personal medical concerns.

Lead

A 2026 study in PLOS Digital Health evaluates machine learning (ML) and deep learning (DL) models for breast cancer detection. While DL models achieved up to 97.88% accuracy on histopathology images, ensemble ML models reached 98% on structured clinical data, highlighting modality-dependent performance.

Key Facts

Metric Value Context
Best Imaging Accuracy 97.88% Histopathological images using DL models PMID: 42804475
Best Clinical Data Accuracy 98.00% Structured data using ensemble/probabilistic ML PMID: 42804475
Ultrasound Accuracy 92.00% DL models on ultrasound datasets PMID: 42804475
Calibration Insight Variable Logistic Regression & Gradient Boosting best-calibrated for clinical data PMID: 42804475

Why It Matters / Context

Breast cancer remains a leading cause of cancer-related mortality, with persistent challenges in clinical diagnosis including inconclusive imaging results and significant inter-observer variability. These limitations underscore the urgent need for complementary computational approaches that can support early and accurate detection.

Traditional clinical workflows often rely on a combination of structured clinical data (such as patient history, demographics, and lab values) and unstructured imaging data (mammography, ultrasound, and histopathology). However, the optimal algorithmic approach for each data modality has not been consistently established. This study provides a critical independent evaluation, comparing traditional ML algorithms against modern DL architectures across multiple data types. The findings suggest that there is no “one-size-fits-all” model; rather, the choice of algorithm should be dictated by the specific data modality being analyzed. For imaging, DL’s ability to extract complex spatial features yields superior performance, while for tabular clinical data, traditional ensemble methods remain highly competitive and often better calibrated.

Details

The study applied a diverse set of algorithms to three distinct data categories: structured clinical data, mammography, histopathology, and ultrasound.

1. Structured Clinical Data Analysis

The researchers utilized three major datasets: the Wisconsin Breast Cancer Dataset, the CSAW-CC dataset, and the SEER database. Five ML models were tested: Random Forest, Decision Tree, Logistic Regression, Gradient Boosting, and Bayesian classifiers.

  • Performance: Ensemble-based and probabilistic models achieved the highest predictive accuracy, reaching up to 98% PMID: 42804475.
  • Calibration: Model calibration, assessed via Expected Calibration Error (ECE) and reliability diagrams, was strongest for Logistic Regression, Gradient Boosting, and Random Forest. In contrast, Decision Tree and Naive Bayes showed weaker calibration PMID: 42804475.

2. Imaging Data Analysis (Deep Learning)

Four DL architectures were evaluated: Convolutional Neural Networks (CNN), ResNet50, VGG16, and DenseNet. These were applied to mammography, histopathology, and ultrasound datasets.

  • Histopathology: DL models outperformed ML models, achieving an accuracy of 97.88% PMID: 42804475. Transfer-learning-based deep convolutional architectures demonstrated strong calibration on these datasets PMID: 42804475.
  • Ultrasound: DL models achieved an accuracy of 92.00% PMID: 42804475. However, calibration was comparatively weaker for the from-scratch CNN baseline and some DL models evaluated on the smaller BUSI dataset PMID: 42804475.
  • Mammography: While specific accuracy figures for mammography were not isolated in the abstract summary, the overall trend indicated DL superiority in image classification tasks across all imaging modalities PMID: 42804475.

Comparison of Modalities

The results indicate that model performance is significantly influenced by data modality. DL models are superior for image classification tasks due to their capacity to learn hierarchical feature representations from pixel data. Conversely, for structured clinical data, where features are pre-defined and tabular, traditional ML models like Gradient Boosting and Random Forest offer high accuracy with better probabilistic calibration, which is crucial for clinical decision-making where risk stratification is required.

Limitations

Critical Limitation: The study relies on retrospective datasets and retrospective validation. The authors explicitly state that further prospective validation using clinical data across diverse patient populations will be essential to confirm the robustness, interpretability, and generalizability of these findings PMID: 42804475.

Additionally, the study notes that calibration was weaker for certain models on smaller datasets (e.g., BUSI for ultrasound), suggesting that data volume and diversity significantly impact model reliability. The “black box” nature of some DL models also raises concerns regarding interpretability in clinical settings, although the study notes that transfer-learning architectures were well-calibrated on histopathology.

Clinical Takeaway

Clinicians and health system leaders should consider modality-specific AI integration: deploying deep learning models for image-based diagnostics (histopathology/ultrasound) while utilizing well-calibrated ensemble ML models for risk stratification based on structured clinical data, pending prospective validation.

Full Reference

Deepthi, Nayak A, Panicker RO. Independent evaluation of machine learning and deep learning models for breast cancer detection. PLOS Digital Health. 2026. PMID: 42804475 [DOI: 10.1371/journal.pdig.0001747]