3D Reconstruction from CT SCANS
Data Preparation: Starting with the full-body CTs, scans were cropped to focus on the abdominal area that covers the kidney and tumor.
Base Model Selection: We started with the nnUnet model with a few architectural variations on this dataset, given its prior success with similar modalities.
Model Training: We tried a model cascade version of nnUnet with both high and low-resolution versions.
Experiments: We converted our segmented kidney and tumor volumes into clouds of points over which we computed a smooth surface using laplacian surface reconstruction, and the introduction of some small amount of random noise in the location. From here we evaluated the quality of the segmentation operations.
Infrastructure and Hardware: This project was completed on the Google cloud platform(GCP), in which we dynamically assigned compute resources, both CPU cores, and GPUs, as needed for our computational workloads.
Results
%
Kidney Dice Coefficient
%
Tumor Dice Coefficient
%
Kidney and Tumor Average Dice Coefficient
We observed that realistic kidney reconstructions from bulk CT scans are feasible with current state-of-the-art technologies. The software re-generation of a patient’s kidney when coupled with surgical simulations, could enable non-invasive surgical practice tools on soft models of the patient’s specific anatomy. These tools allow for building simulated environments where a surgeon could Practice surgeries before actually doing them on a patient.
A sufficiently accurate model of a patient’s anatomy could lead to a simulated environment wherein a surgeon could practice, record, or undo surgical actions developed for a specific patient. A surgeon can then simply execute this recording on the actual patient, avoiding the pitfalls encountered within the simulation.