Instrument Segmentation
of a Surgical Robot

2D Semantic Segmentation of a Robotic Surgical Scene
The Challenge
An ultimate goal for robotic surgery could be one where surgical tasks are performed autonomously with accuracy better than human surgeons. Several technical building blocks are essential to make this goal a reality. One such engineering problem is segmentation and tracking of anatomical and surgical objects in real-time during the surgery. Solutions to these problems when achieved have many practical applications in the realms of surgeon training and developing patient safety tools when combined with Augmented Reality and Virtual Reality. In this case study, we developed multiple computer vision models to detect and track anatomical and surgical objects of interest using the state of the art CV models on a