Reference For Content Format
Reference For Content Format
ABSTRACT
Research on 3D medical image classification is still in its early stages, and current
progress is largely constrained by the way datasets are handled. Most existing
methods operate on very small cropped volumes typically 32×32×32 or 64×64×64
nodules rather than using entire CT scans. While these cropped-volume
approaches perform reasonably well due to clean labels and already isolated
regions of interest, they overlook the broader anatomical structures that are often
crucial for reliable clinical decision making. As a result, these models struggle to
generalize in real-world settings where abnormalities may not be neatly localized
or may span multiple spatial regions.
In this work, we demonstrate that diffusion models can be highly effective for 3D
medical understanding when guided properly. We introduce MediScopeDiffusion,
a guided 3D latent-diffusion framework that integrates both global scan level
features and fine grained local features to influence the denoising trajectory. By
injecting this structured guidance, the model is encouraged to focus on clinically
meaningful regions while still preserving holistic anatomical context. This
combination enables MediScopeDiffusion to learn richer spatial representations
and to better capture subtle abnormalities that may be overlooked by conventional
3D CNNs or transformer based baselines.
Our experiments on CT data show that the proposed approach not only improves
1
robustness to noise and imaging variability but also consistently outperforms
widely used 3D classification architectures. MediScopeDiffusion achieves an
accuracy of 75%, an F1-score of 77.55%, and a recall of 95%, demonstrating its
strong capability to detect abnormalities with high sensitivity. These results
highlight the promise of diffusion driven feature learning for medical diagnosis
and point toward a new direction for building reliable, context aware AI systems
for 3D medical imaging.
2
TABLE OF CONTENTS
1 Introduction 1
2 Literature Review 2
4 Methodology 7
6 Conclusion 23
References 24
3
LIST OF FIGURES
16
Figure 5.1 ROC Curve
16
Figure 5.2 Confusion Metrix
16
Figure 5.3 Sample predictions
19
Figure 5.4 3D CNN Architecture
20
Figure 5.5 Our Model Loss Curve
4
LIST OF TABLES
5
List of Symbols, Abbreviations or Nomenclature
AI Artificial Intelligence
CT Computed Tomography
OI Region of Interest
F Feature Prior
yl Local Prior
s Noise Term
S Saliency Matrix
yg Global Prior
6
Chapter 1
INTRODUCTION
7
• Limited applicability in clinical workflows that require whole-scan reasoning rather than
isolated patch analysis.
These limitations highlight the need to shift from isolated patch classification toward
full-volume 3D medical understanding, where the model learns disease signatures
distributed across the entire organ system. Full-scan classification provides richer contextual
information and better aligns with real diagnostic processes, but it also introduces new
challenges: extremely high computational cost, large inter-patient variability, and
significantly higher noise sensitivity.
Parallel to this, diffusion models have recently emerged as powerful generative frameworks
capable of learning rich multi-scale features. Yet, their application to
classification-especially for 3D medical volumes-remains largely unexplored. Existing
diffusion research is overwhelmingly focused on image generation, inpainting, or
segmentation, with very limited investigation into their potential as discriminative 3D
feature extractors.
In this work, we demonstrate that diffusion models, when augmented with structured priors
and anatomically guided representations, can act as highly effective 3D feature learners.
They capture both global volumetric context and fine-grained local patterns, enabling robust
classification across entire scans. This establishes a new direction for building reliable,
context-aware, and clinically deployable 3D medical image analysis systems.
8
Chapter 2
LITERATURE REVIEW
9
Subsequent improvements—Nichol and Dhariwal’s cosine schedule [7], Song et al.’s
deterministic DDIM sampling [8], and Rombach et al.’s Latent Diffusion Models (LDMs)
[9]-significantly improved sampling speed, stability, and scalability. These breakthroughs
laid the foundation for modern applications such as Stable Diffusion.
Despite their success, most diffusion research focuses on image synthesis rather than
classification, leaving their discriminative potential underexplored.
C. Diffusion Models in Medical Imaging
Collectively, these studies reveal that most diffusion-based medical research focuses
on reconstruction or segmentation tasks. Very few extend diffusion models to 3D
classification, and none demonstrate their ability to understand entire volumetric scans using
both global context and local anatomical structures.
D. Identified Research Gap
From the reviewed literature, two key limitations emerge:
1. Patch-based nodule classifiers lack global understanding
They only analyze small cropped ROIs, making them unsuitable for disease-level
interpretation or complex abnormalities spread across slices.
2. Diffusion models are underutilized for discriminative 3D learning
Existing works primarily target segmentation or synthesis, with almost no focus on
leveraging diffusion-based representations for full-scan medical classification.
These gaps highlight the need for a framework capable of:
● processing entire 3D volumes,
● capturing both global anatomical context and fine-grained local features, and
● learning robust volumetric representations using diffusion-based denoising.
E. Contribution Motivation
The limitations observed in prior work directly motivate our approach, which
integrates structured priors with diffusion-based feature learning to build a holistic,
full-volume 3D medical classification system. By combining global feature extraction, local
saliency-driven guidance, and diffusion modeling, our method aims to address the
shortcomings of both patch-based CNN approaches and existing diffusion architectures.
10
Chapter 3
(1)
(2)
where
Reverse (Denoising) Process: The denoising model p_θ learns to predict the original noise
component:
(3)
11
The DDPM training objective minimizes the noise-prediction loss:
(4)
This iterative denoising process forces the model to learn deep structural patterns, making
diffusion models highly expressive and robust.
3.2. Diffusion Models in Medical Imaging: Progress and Limitations
Diffusion models have been adopted in medical imaging primarily for image
synthesis, reconstruction, and segmentation. Examples include MedSegDiff [10] for
segmentation, Med-DDPM [11] for medical denoising, as well as Latent Diffusion for 3D
medical scans [12] and DiffBTS for 3D brain tumor segmentation [13].
These studies demonstrate that diffusion models:
• capture fine structural details in volumetric medical data,
• are highly robust to noise and imaging artifacts,
• outperform GAN-based generative models in stability.
However, very few works attempt to use diffusion models for classification. Most medical
diffusion research focuses on:
• 2D or 3D image generation,
• lesion or organ segmentation,
• synthetic data augmentation,
• modality translation (e.g., MRI → CT).
To the best of our knowledge, the use of diffusion models as discriminative feature learners
for 3D medical classification remains significantly underexplored. Existing classification
pipelines rely heavily on CNN-based or transformer-based backbones that struggle with:
• global anatomical context,
• inter-slice dependencies,
• noise and high similarity between classes,
• computational limitations for full 3D volumes.
This creates a notable research gap: Can diffusion models—with their inherent denoising
and structural learning capabilities—be repurposed for robust 3D classification?
12
3.3. Our Contribution: Guided 3D Diffusion for Medical Classification
To address this gap, we propose MediScopeDiffusion, a guided 3D latent diffusion
architecture tailored for medical image classification.
Our contributions are threefold:
• Guidance Vector (M): A spatial map that adaptively determines how much the diffusion
model should rely on global features vs. local ROI features at each voxel location.
• Feature Vector (F): A cross-attention mechanism integrating global anatomical structure
with fine-grained local patterns, providing rich contextual priors during diffusion.
• Guided Latent Diffusion for Classification: Instead of generating images, our diffusion
model learns discriminative 3D representations. By embedding (M, F) inside the denoising
process, the model becomes capable of learning both global and local spatial features. A
lightweight classifier head applied on the denoised latent space yields the final prediction.
Together, these components allow diffusion models to move beyond traditional
generative tasks and function as powerful 3D feature extractors. Experimental results show
improved robustness, stronger noise resistance, and better generalization compared to
standard 3D CNN baselines.
13
Chapter 4
METHODOLOGY
the model extracts two complementary priors:
2. Local prior( ) derived from the most informative slices and their corresponding
Regions of Interest (ROIs).
These two priors jointly guide the diffusion model.
A lightweight global encoder processes all slices in the scan to capture coarse anatomical
context, focusing on:
● Lung shape and structure
14
● Global intensity distribution
● Large-scale abnormalities
A 1×1 convolutional projection head maps these features into a global prediction vector:
From these selected slices, local patches (ROIs) are cropped around high-saliency regions,
enabling the model to focus on subtle patterns such as nodules, lesions, infiltrations, or focal
abnormalities.
3) Local Encoder and Local Prior (ŷ )
The cropped ROIs are passed through a dedicated local encoder τ designed to capture
fine-grained spatial features that may be absent in global representations.
An attention mechanism aggregates ROI embeddings:
15
4) Intuition Behind the Two-Prior Design
The two priors play complementary roles:
● Global Prior: Captures holistic structures—lung shape, symmetry, and coarse
anatomical patterns.
● Local Prior: Captures subtle regions—fine lesions, irregular textures, and small
nodules.
● Saliency-driven ROI extraction: Ensures the model focuses only on the most
diagnostically critical slices.
Together, the priors provide strong guidance for the diffusion model, later used to construct
the Dense Guidance Map (M) and Feature Prior (F).
4.2. Dense Guidance Map (M) and Image Feature Prior (F)
Figure 4.2. Dense Guidance Map (M) and Image Feature Prior (F)
After obtaining ŷ₍g₎ and ŷ , two key components are constructed to guide the diffusion
process:
1. Dense Guidance Map (M) - voxel-wise spatial guidance
2. Image Feature Prior (F) - semantic feature-level guidance
16
These priors play a similar role to guided conditioning in diffusion-based classification
frameworks such as DiffMIC-v2.
yielding:
17
c) Intuition
The Dense Guidance Map acts as a soft expert-switching mechanism:
● Voxels with small dᵢⱼ: rely on global information
● Voxels with large dᵢⱼ: rely on local cues
● = ROI-specific embeddings
18
C. Diffusion-Based Training and Classification
During training, the clean label vector is gradually perturbed into using the standard
DDPM forward process.
The U-Net receives:
● noisy latent variable
● Dense Guidance Map M
● Image Feature Prior F
and predicts the injected noise ε̂ θ:
This encourages the model to learn both semantic and position-aware features.
19
2) Reverse Diffusion (Inference Stage)
During inference, the model starts from a noisy latent and iteratively removes noise using
the learned U-Net.
At each timestep:
● M identifies which regions need global vs. local focus
● F supplies multi-scale contextual features
20
Chapter 5
RESULTS
Most existing state-of-the-art models for 3D medical image analysis primarily address
nodule-level classification, where a small cropped region around a lung nodule (typically
Matrices Values
Accuracy 75%
Sensitivity 95%
F1 Score 77.55
AUC 0.79
Table(5.1)
21
Figure(5.1) ROC Curve Figure(5.2) Confusion Matrix
Table 5.1 summarizes the performance of our MediScopeDiffusion model. The model
achieves an overall accuracy of 75%, with a notably high sensitivity (recall) of 95%,
indicating that it is highly effective at detecting abnormal cases. The F1-score of 77.55
reflects a strong balance between precision and recall, and the AUC value of 0.79 shows
good discrimination capability across classification thresholds. The confusion matrix further
illustrates that the model rarely misses abnormal cases, aligning with the high sensitivity
score. Additionally, the ROC curve demonstrates a consistent trade-off between true-positive
and false-positive rates, confirming the robustness of our diffusion-based approach.
22
A. Comparison with Diff3Dformer
To contextualize our performance, we compare our results with Diff3Dformer, a recent
diffusion–transformer framework designed for full-scan binary CT classification. Their work
is directly comparable to ours, as it also performs patient-level binary classification on
~600–700 CT scans for pneumonia-related abnormalities.
Table I summarizes the performance reported in their paper. Diff3Dformer achieves its
strongest performance when diffusion guidance is combined with a clustering-based ViT
embedding
23
Overall, our model achieves a favorable trade-off between performance and efficiency,
enabling fast, resource-friendly full-scan classification.
B. Comparison with X-ray2CTPA
We further compare our method with X-ray2CTPA, a cross-modality diffusion-based
pipeline for pulmonary embolism detection. Their approach synthesizes a 3D CTPA volume
from a single 2D chest X-ray using a diffusion model and classifies the resulting volume
using a 3D DenseNet-121 encoder.
24
C. Comparison with 3D CNN-Based CT Classification
25
Figure 5.5 (Our Model Loss Curve)
Figure X presents the training and validation diffusion loss curves for our
MediScopeDiffusion model. The loss steadily decreases during the early stages and
continues to drop with only mild fluctuations, indicating a stable and reliable learning
pattern. A key observation is that the validation loss remains closely aligned with the
training loss for most of the training duration. This suggests that the model is not overfitting
and is able to generalize well to unseen data. Although a few spikes appear toward the later
epochs, the overall trend still reflects a consistent and well-guided denoising process,
supported by the structured guidance incorporated into the diffusion framework.
26
Figure 5.7(3D CNN-Based CT Classification (Loss Curve & Accuracy Curve)
We also compare our approach with the 3D CNN baseline introduced in “Convolutional
neural network-based classification and monitoring models for lung cancer detection: 3D
perspective approach.” In their Case 3.1 experiment, a standard 3D CNN was trained on the
MosMedData COVID/viral pneumonia dataset (~700 CT scans) for binary classification.
27
Their reported performance is:
● Accuracy: 76.44%
● (No sensitivity, specificity, F1-score, or AUC reported.)
This limits the ability to perform a detailed comparison.
In contrast, our model provides a complete metric profile, achieving:
● Accuracy: 75%
● Sensitivity: 95%
● F1-score: 77.55
● AUC: 0.79
Although their accuracy is marginally higher, our significantly better sensitivity and
F1-score indicate stronger abnormality detection. Moreover, our diffusion-guided design
captures richer multi-scale structural cues than standard 3D CNNs, resulting in improved
robustness.
28
Chapter 6
CONCLUSION
29
REFERENCES
[1] W. Shen et al., “Multi-view convolutional neural networks for lung nodule
classification,” PLoS ONE, 2017.
[2] Q. Dou et al., “3D deep dual-path network for lung nodule classification,” in MICCAI,
2019.
[3] X. Zhu et al., “Multi-scale 3D convolutional neural network for lung nodule malignancy
classification,” arXiv preprint, 2018.
[5] N. Potdukhe and S. Neware, “Image enhancement technique based on deep learning and
hybrid particle swarm optimization for lung tumor classification,” Journal of Information
Systems Engineering and Management, vol. 10, p. 20s, 2025.
[10] R. Rombach et al., “High-resolution image synthesis with latent diffusion models,” in
CVPR, 2022.
[11] J. Kim et al., “MedSegDiff: Medical image segmentation with diffusion models,” arXiv
preprint, 2022.
[12] J. Wolleb et al., “Med-DDPM: Denoising diffusion models for medical imaging,” arXiv
preprint, 2021.
[13] F. Thaler et al., “Latent diffusion models for 3D medical imaging,” arXiv preprint,
2024.
[14] D. Nie et al., “DiffBTS: A lightweight diffusion model for 3D brain tumor
segmentation,” Sensors, 2025.
30
[16] C. Venkatesh, J. Chinna Babu, A. Kiran et al., “A hybrid model for lung cancer
prediction using patch processing and deep learning on CT images,” Multimedia Tools and
Applications, vol. 83, pp. 43931–43952, 2024.
[18] H. T. Gayap and M. A. Akhloufi, “Deep machine learning for medical diagnosis:
application to lung cancer detection—A review,” Biomed Informatics, vol. 4, pp. 236–284,
2024.
[19] S. Naseer, T. Akram, M. Masood, M. Rashid, and A. Jaffar, “Lung cancer classification
using modified U-Net based lobe segmentation and nodule detection,” IEEE Access, vol. 11,
pp. 60279–60291, 2023.
[20] M. Obayya et al., “Biomedical image analysis for colon and lung cancer detection using
tuna swarm algorithm with deep learning model,” IEEE Access, vol. 11, pp. 94705–94712,
2023.
[21] B. E. Youssef et al., “Integrated deep learning and stochastic models for accurate
segmentation of lung nodules from computed tomography images: A novel framework,”
IEEE Access, vol. 11, pp. 99807–99821, 2023.
[22] A. R. Wahab Sait, “Lung cancer detection model using deep learning technique,”
Applied Sciences, vol. 13, p. 12510, 2023.
[23] M. Cellina et al., “Artificial intelligence in lung cancer screening: The future is now,”
Cancers, vol. 15, p. 4344, 2023.
[24] H.-J. Kwon et al., “Enhancing lung cancer classification through integration of liquid
biopsy multi-omics data with machine learning techniques,” Cancers, vol. 15, p. 4556, 2023.
[25] Z. Gandhi et al., “Artificial intelligence and lung cancer: Impact on improving patient
outcomes,” Cancers, vol. 15, p. 5236, 2023.
[26] Y. Ren et al., “A genotype-based ensemble classifier system for non-small-cell lung
cancer,” IEEE Access, vol. 8, pp. 128509–128518, 2020.
[27] S. Pang et al., “A deep model for lung cancer type identification by densely connected
convolutional networks and adaptive boosting,” IEEE Access, vol. 8, pp. 4799–4805, 2020.
[28] N. K. Chaubey and P. Jayanthi, “Disease diagnosis and treatment using deep learning
algorithms for the healthcare system,” in Applications of Deep Learning and Big IoT on
Personalized Healthcare Services, IGI Global, pp. 99–114, 2020.
[29] M. Li et al., “Research on the auxiliary classification and diagnosis of lung cancer
31
subtypes based on histopathological images,” IEEE Access, vol. 9, pp. 53687–53707, 2021.
[30] E. Dritsas and M. Trigka, “Lung cancer risk prediction with machine learning models,”
Big Data and Cognitive Computing, vol. 6, p. 139, 2022.
[31] I. Shafi et al., “An effective method for lung cancer diagnosis from CT scan using deep
learning-based support vector network,” Cancers, vol. 14, p. 5457, 2022.
[32] L. Hussain et al., “Lung cancer prediction using robust machine learning and image
enhancement methods on extracted gray-level co-occurrence matrix features,” Applied
Sciences, vol. 12, p. 6517, 2022.
[33] K. Kobylińska et al., “Explainable machine learning for lung cancer screening models,”
Applied Sciences, vol. 12, p. 1926, 2022.
[34] S. Bhatia, Y. Sinha, and L. Goel, “Lung cancer detection: A deep learning approach,” in
Soft Computing for Problem Solving, AISC, vol. 817, pp. 699–705, Springer, 2019.
[35] N. N. Maltare, D. Sharma, and S. Patel, “An exploration and prediction of rainfall and
groundwater level for the district of Banaskantha, Gujarat, India,” International Journal of
Environmental Sciences, vol. 9, no. 1, pp. 1–17, 2023.
32