Research Projects
As a researcher at the intersection of artificial intelligence (AI) and biomedical imaging, my work spans a broad spectrum of applications, from diagnosis to understanding disease mechanisms, focusing on cancer and neurodegenerative diseases (NDs). I leverage trustworthy AI to enhance the capabilities of both traditional and emerging imaging modalities by uncovering hidden patterns and integrating multimodal data. These efforts will deepen our understanding of diseases, aid in drug screening, and personalize treatment, thereby supporting clinical decision-making and improving patient outcomes.
Deep Learning for Neuropathology
Attention-based multiple instance learning for understanding Chronic Traumatic Encephalopathy (CTE)
A vision foundation model for neuropathology for advancing AI-driven neuropathological image analysis
I have developed a vision foundation model for neuropathology to advance AI-driven neuropathological image analysis.
Deep Learning Analysis of Multi-modal Optical Imaging of Human Brain Tissue
Deep learning registration of Polarization-Sensitive Optical Coherence Tomography (PS-OCT) and quantitative Birefringence Microscopy (qBRM) images
Diffuse Optical Tomography (DOT)
Multimodal data fusion for breast lesion classification
I have developed data fusion approaches to combine ultrasound, DOT, and radiologists’ BIRADS assessments for breast cancer diagnosis. The proposed two-stage approach can potentially distinguish breast cancers from benign lesions in near real-time. [Paper1: Two-stage] [code1] [Paper2: DOT + BIRADS] [code2] [Paper3: DOT + ultrasound] [code3]
Tackling mismatch errors
My thesis aims to solve practical problems in DOT breast imaging and to improve breast cancer diagnosis. Our lab uses Ultrasound (US)-guided DOT to probe tissue optical properties i.e. optical absorption, oxygenated and deoxygenated hemoglobin concertation for breast cancer diagnosis and treatment monitoring. However, imaging artifacts can appear due to mismatches between the two side breasts in tissue curvature, tissue heterogeneity, the depth and angle of the chest wall underneath the breast tissue, and source or detector (optode) coupling. During patient studies, these errors can all cause misinterpretation of lesion images. I proposed two algorithms to mitigate probe-tissue contact problems and reduce image artifacts.
[Paper1: Correction of optode coupling errors]
[Paper2: Ultrasound-guided edge artifact reduction]
Difference imaging from single measurements
“Difference imaging”, which reconstructs target optical properties using measurements with and without target information, is often used in DOT in vivo imaging. However, taking additional reference measurements is time-consuming, and mismatches between the target medium and the reference medium can cause inaccurate reconstruction. I designed a multi-layer perceptron (MLP) to output data for difference imaging from target measurements only. The model is trained and validated on simulation data and tested with simulations, phantom experiments, and clinical data from 56 patients with breast lesions. It can simplify the data acquisition procedure, mitigate mismatch problems, and improve reconstructed image quality in DOT difference imaging. [Paper] [Code]
CNN for accurately estimating breast tissue optical properties
In general, image reconstruction methods used in diffuse optical tomography (DOT) are based on diffusion approximation, and they consider the breast tissue as a homogenous, semi-infinite medium. However, the semi-infinite medium assumption used in DOT reconstruction is not valid when the chest wall is underneath the breast tissue. We propose a deep learning-based neural network approach where a convolution neural network (CNN) is trained to simultaneously obtain accurate optical property values for both the breast tissue and the chest wall. The CNN model shows great promise in reducing errors in estimating the optical properties of the breast tissue in the presence of a shallow chest wall. [Paper]
Machine learning with physical constrains for DOT reconstruction
We trained an Autoencoder-based machine learning model with physical constraints (ML-PC) to perform diffuse optical tomography (DOT) reconstruction. Our method has two key components: (i) a neural network based on an auto-encoder is adopted for DOT reconstruction, and (ii) physical constraints are implemented to achieve accurate reconstruction. Both qualitative and quantitative results demonstrate that the accuracy of the proposed method surpasses that of existing models. [Paper]
Optical Coherence Tomography (OCT)
Human coloreactal cancer classification using deep learning and OCT
Optical coherence tomography (OCT) can differentiate normal colonic mucosa from neoplasia, potentially offering a new mechanism of endoscopic tissue assessment and biopsy targeting, with a high optical resolution and an imaging depth of ~1 mm. I designed customized ResNet is utilized to classify OCT catheter colorectal images. An area under the receiver operating characteristic (ROC) curve (AUC) of 0.975 is achieved to distinguish between normal and cancerous colorectal tissue images. [Paper] [Code]
Spatial Frequency Domain Imaging (SFDI)
AdaBoost-based multiwavelength SFDI for human colorectal tissue assessment
Multiwavelength spatial frequency domain imaging (SFDI) can provide tissue optical absorption and scattering signatures, and would be able to differentiate various colorectal neoplasia from normal tissue. In this ex vivo study of human colorectal tissues, we trained an abnormal vs. normal adaptive boosting (AdaBoost) classifier to dichotomize tissue based on SFDI imaging characteristics, and an area under the receiver operating characteristic (ROC) curve (AUC) of 0.95 is achieved. [Paper]
Image-guided Photo-mediated Ultrasound Therapy
Simultaneously applied laser and ultrasound treat neovascularization in rabbit eyes guided by OCT & photoacoustic microscopy (PAM). Simulated bubble dynamics under simultaneous laser & ultrasound and validated the simulations with experiments on tubes filled with blood. [Paper]