Loading...
Marker-free detection of instruments in laparoscopic images to control a cameraman robot
1257 viewed

Marker-free detection of instruments in laparoscopic images to control a cameraman robot

Amini Khoiy, K

Marker-free detection of instruments in laparoscopic images to control a cameraman robot

Amini Khoiy, K ; Sharif University of Technology

1257 Viewed
  1. Type of Document: Article
  2. DOI: 10.1115/DETC2010-28452
  3. Abstract:
  4. Assistant robots are widely used in laparoscopic surgery to facilitate the camera holding and manipulation task. A variety of a hands-free operator interfaces have been implemented for user control of the robots, including voice commands, foot pedals, and eye and head motion tracking systems. This paper proposes a novel user control interface, based on processing of the laparoscopic images, that enables the robot to automatically adjust the view of the laparoscopic camera without disturbing the surgeon's concentration. An effective marker-free detection method was investigated to track the instrument position in the laparoscopic images in real time so that the robot could center the instrument tip in the camera view. Considering several available methods it was found that a color space analysis, based on the quantitative comparison of the background's and instrument's pixels color contexts, provides the best results. The color contexts were presented in covariance matrix and mean values and analyzed using Mahalanobis distance measure in RGB color space. Tests on laparoscopic images with controlled conditions, e.g., sufficient light and low noises, revealed 86 percent correct detection with a processing rate of 3.7 frames per second on a conventional PC. Further work is going on to improve the algorithm
  5. Keywords:
  6. Cameraman robot ; Color space ; Laparoscopic surgery ; Assistant robot ; Camera view ; Controlled conditions ; Detection methods ; Foot pedals ; Frames per seconds ; Hands-free ; Head motion ; Low noise ; Mahalanobis distance measure ; Manipulation task ; Mean values ; Operator interfaces ; Processing rates ; Quantitative comparison ; Real time ; RGB color space ; User control ; Voice command ; Cameras ; Color ; Covariance matrix ; Engineering ; Image processing ; Instruments ; Machine design ; Mathematical operators ; Robots ; Surgery ; Surgical equipment
  7. Source: Proceedings of the ASME Design Engineering Technical Conference, 15 August 2010 through 18 August 2010 ; Volume 3, Issue PARTS A AND B , 2010 , Pages 477-482 ; 9780791844113 (ISBN)
  8. URL: http://proceedings.asmedigitalcollection.asme.org/proceeding.aspx?articleid=1611738