Instrument contact force estimation using endoscopic image sequence and 3D reconstruction model

Wei Che Lin, Kai-Tai Song

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

This paper presents a method to estimate contact force for minimally invasive surgery (MIS) using endoscopic imagery. In order to provide surgeons the information of contact force as surgical instruments get contact to human tissue, we developed a method to calculate tissue deformation by reconstructing 3D model using real-time image processing. The force information will be fed back to a haptic device to allow the surgeon to feel contact force as well as to show the force value on monitor for the surgeon. We propose a 3D reconstruction method to model the tissue surface under deformation, and use the deformation data to obtain contact force near the instrument tip. Using image tracking, we locate a surgical instrument in the endoscopy scene, then determine the deformation area in the image scene. Several experiments validate the effectiveness of method of deformation calculation.

Original languageEnglish
Title of host publication2016 International Conference on Advanced Robotics and Intelligent Systems, ARIS 2016
PublisherInstitute of Electrical and Electronics Engineers Inc.
ISBN (Electronic)9781509051021
DOIs
StatePublished - 24 Mar 2017
Event2016 International Conference on Advanced Robotics and Intelligent Systems, ARIS 2016 - Taipei, Taiwan
Duration: 31 Aug 20162 Sep 2016

Publication series

Name2016 International Conference on Advanced Robotics and Intelligent Systems, ARIS 2016

Conference

Conference2016 International Conference on Advanced Robotics and Intelligent Systems, ARIS 2016
CountryTaiwan
CityTaipei
Period31/08/162/09/16

Fingerprint Dive into the research topics of 'Instrument contact force estimation using endoscopic image sequence and 3D reconstruction model'. Together they form a unique fingerprint.

  • Cite this

    Lin, W. C., & Song, K-T. (2017). Instrument contact force estimation using endoscopic image sequence and 3D reconstruction model. In 2016 International Conference on Advanced Robotics and Intelligent Systems, ARIS 2016 [7886629] (2016 International Conference on Advanced Robotics and Intelligent Systems, ARIS 2016). Institute of Electrical and Electronics Engineers Inc.. https://doi.org/10.1109/ARIS.2016.7886629