Cone-Beam Computed Tomography (CBCT) to Computed Tomography (CT) Image Translation with Perceptual Loss to Eliminate Cone-Beam Artifacts
S Yoo*, B Choi, I Park, J Kim, H Kim, Department of Radiation Oncology, Yonsei University College of Medicine, Seoul, Korea,
Presentations
SU-IePD-TRACK 1-4 (Sunday, 7/25/2021) 3:00 PM - 3:30 PM [Eastern Time (GMT-4)]
Purpose: Cone-beam computed tomography (CBCT) is widely used for image-guided radiation therapy (IGRT). The application of CBCT can be extended to adaptive radiation therapy (ART) for dose accumulation and re-planning, which are currently limited in accuracy due to degraded image quality from cone-beam artifacts. Thus, this work presents an advanced deep learning (DL) algorithm for generating synthetic CT from CBCT by incorporating perceptual loss.
Methods: Patient cohort for the DL model consisted of 43 scans with paired CBCT and CT images. The dataset was split into 35 patients for train-set, 3 for valid-set, and 5 for test-set. We utilized a two-dimensional FC-DenseNet as the DL architecture to eliminate the cone-beam artifacts of CBCT. CT slices were deformable registered and resampled to CBCT using MIM software and MATLAB. With L1-loss only, we found that details in bone structure disappeared in synthetic CT generation. To enhance the translating performance, the perceptual loss besides L1-loss was newly applied. Data augmentations (flip, rotation, blur) were conducted to increase the data size for training. The similarity metric to assess the trained networks employed structural similarity index (SSIM) and mean absolute error (MAE).
Results: 5 patients with paired CBCT/CT images were randomly selected to validate the trained networks. Two networks with L1-loss and (perceptual loss+L1-loss) resulted in similar MAEs (0.050 and 0.044). The L1-loss based network may well produce slightly lower MAE as the L1-loss emphasizes compressing MAE. Contrarily, in SSIM, our proposed network with additional perceptual loss outperformed that with L1-loss only (0.756 to 0.824). It implies that the perceptual loss substantially contributed to improving the similarity of synthetic CT produced from CBCT to real CT images.
Conclusion: Our DL model with perceptual loss was demonstrated to promote the performance of CBCT to CT image translation, which can strengthen the usefulness of CBCT in radiotherapy.
ePosters
Keywords
Not Applicable / None Entered.
Taxonomy
Not Applicable / None Entered.
Contact Email