Overcoming optical scattering in photoacoustic imaging with intensity-recovering deep learning model
Wu, Christine
This item is only available for download by members of the University of Illinois community. Students, faculty, and staff at the U of I may log in with your NetID and password to view the item. If you are trying to access an Illinois-restricted dissertation or thesis, you can request a copy through your library's Inter-Library Loan office or purchase a copy directly from ProQuest.
Permalink
https://hdl.handle.net/2142/110315
Description
Title
Overcoming optical scattering in photoacoustic imaging with intensity-recovering deep learning model
Author(s)
Wu, Christine
Contributor(s)
Chen, Yun-Sheng
Issue Date
2021-05
Keyword(s)
Photoacoustic Imaging
Optical Scattering
Convolutional Neural Network
Conditional Generative Adversarial Network
Image-to-Image Translation
Abstract
Photoacoustic imaging (PAI) is a hybrid imaging modality with rich optical contrast and high
spatiotemporal resolution. PAI utilizes the principles of electromagnetic energy absorption and
thermal expansion of different specimens as a contrast to generate ultrasound waves and to
visualize deeper biological structures than pure optical imaging modalities find difficult to image in
a non-invasive manner. However, optical scattering and ultrasound attenuation in biological tissues
deteriorates the quality of PAI. The penetration depth is still limited to several optical mean-freepaths,
disabling current PAI techniques from numerous potential clinical applications, especially
on humans. While many reconstruction algorithms improved contrast to noise ratio, the issue with
scattering in optical imaging remains. In recent years, deep learning methods have been infused
into various imaging applications and have demonstrated promising results in the context of medical
imaging. In this thesis, we first constructed a laser intensity predictive network NetP, which is based
on a convolutional neural network (CNN), to predict the laser intensity given a PA image. Then,
we integrated NetP with a general solution image-to-image translation conditional Generative
Adversarial Network (cGAN) to construct an intensity-recovering PowerNet. PowerNet takes in an additional layer of laser intensity on top of one ultrasound and one photoacoustic image to assist the
cGAN generator in overcoming laser attenuation in current PA images. We also incorporated SSIM
score and laser intensity difference into the loss calculation of PowerNet for a more robust learning
evaluation while performing image-to-image translation between ultrasound and photoacoustic
images. We trained the PowerNet on lab-generated ideal datasets and real arm blood vessel
datasets to evaluate its performance and its practicality in real-world clinical applications. The
resulting ultrasound-assisted PA images from our method can retain uniform laser intensity while
depth increases within the tissue. The PowerNet consistently generates PA images with minimal
intensity attenuation as compared to the state-of-the-art methods. Thus, our method has effectively
reduced the amount of optical scattering in PAI.
Use this login method if you
don't
have an
@illinois.edu
email address.
(Oops, I do have one)
IDEALS migrated to a new platform on June 23, 2022. If you created
your account prior to this date, you will have to reset your password
using the forgot-password link below.