METHOD AND SYSTEM FOR SURGICAL TOOL LOCALIZATION DURING ANATOMICAL SURGERY

摘要

Various aspects of a method and system to localize surgical tools during anatomical surgery are disclosed herein. In accordance with an embodiment of the disclosure, the method is implementable in an image-processing engine, which is communicatively coupled to an image-capturing device that captures one or more video frames. The method includes determination of one or more physical characteristics of one or more surgical tools present in the one or more video frames, based on one or more color and geometric constraints. Thereafter, two-dimensional (2D) masks of the one or more surgical tools are detected, based on the one or more physical characteristics of the one or more surgical tools. Further, poses of the one or more surgical tools are estimated, when the 2D masks of the one or more surgical tools are occluded at tips and/or ends of the one or more surgical tools.

主权项

1. A system for surgical tool localization during anatomical surgery, said system comprising:
one or more circuits in an image-processing engine communicatively coupled to an image-capturing device, wherein said image-capturing device is configured to capture one or more video frames, said one or more circuits being configured to:
determine one or more physical characteristics of one or more surgical tools present in said one or more video frames, based on one or more color and geometric constraints;detect two-dimensional (2D) masks of said one or more surgical tools present in said one or more video frames, based on said determined one or more physical characteristics of said one or more surgical tools; andestimate poses of said one or more surgical tools in said one or more video frames, when said 2D masks of said one or more surgical tools are occluded at tips and/or ends of said one or more surgical tools.