Purpose: The real-time scattered-radiation display system (SDS) has been expanded in functionality to facilitate interactive resident and staff-member training in a virtual-reality world. In this work we report on improvements to the training system, which enhance the information provided to the trainee.
Methods: The SDS has been previously expanded to include a virtual reality (VR) training module (TM). Unity3D was utilized for designing a virtual interventional room consisting of a C-Arm, patient, and patient table. When the software is initiated, a main menu is opened to select either the dose-management module (DM) or the TM. The TM has two options. In the first, the trainee can view the scatter distributions for previous fluoroscopically-guided-interventional (FGI) procedures using machine-parameter log files stored by the DM. In addition, we utilize a time-of-flight depth-sensing camera along with a custom-built convolutional neural network and NiTE 2 for identifying and tracking staff-members’ locations during procedures which are also recorded in log files for post-procedure evaluation. The second TM mode allows the trainee to control parameters of an interactive virtual procedure and visualize the room-scatter-distribution display.
Results: Within the TM, three distinct enhancements have been made: 1) the ability to select staff-locational log files for playback allowing trainees to observe doses for each of the individuals involved with a procedure; previously, only machine-parameter log files were available; 2) a dose probe to numerically analyze the scatter distribution; 3) fluoroscopic image display, which gives the trainee a frame of reference to the clinical procedure and the ability to correlate the scatter distributions with clinical technique and conduct of the procedure.
Conclusion: We present enhancements to the SDS TM, which will further improve the training experience for staff and residents. A software system capable of VR training and real-time intraprocedural feedback will facilitate improved staff awareness and radiation-dose management during fluoroscopic-interventional procedures.
Funding Support, Disclosures, and Conflict of Interest: This work was supported in part by Canon Medical Systems and NIH Grant No. 1R01EB030092