Virtual reality control of a robotic camera holder for minimally invasive surgery

Kateryna Zinchenko, Oleksii Komarov, Kai-Tai Song

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

5 Scopus citations

Abstract

This paper presents a virtual reality(VR) control system for a robotic endoscope holder for minimally invasive surgery (MIS). The system features a three degree of freedom(DOF) robotic endoscope holder, virtual reality head mounted display and a control system that allows robot to follow headset movement. The headset display is aligned with endoscope camera view thus creating a full presence effect for a surgeon. The video from endoscope is streamed to the virtual reality head mounted display after image processing in a computer. During surgery, the proposed control system generates commands to the robot based on the headset's positioning data. After the desired camera motion direction is estimated, the robotic endoscope holder receives motion commands through serial interface. The proposed virtual reality robot control system is implemented in Unity. The system has been tested in the laboratory environment through a set of motion tests and achieved a response latency of 2s. The proposed system is able to restore the surgeon's perceptual capability of the operation space that is highly restricted in MIS and provide highly intuitive endoscope robot control.

Original languageEnglish
Title of host publication2017 Asian Control Conference, ASCC 2017
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages970-975
Number of pages6
ISBN (Electronic)9781509015733
DOIs
StatePublished - 7 Feb 2018
Event2017 11th Asian Control Conference, ASCC 2017 - Gold Coast, Australia
Duration: 17 Dec 201720 Dec 2017

Publication series

Name2017 Asian Control Conference, ASCC 2017
Volume2018-January

Conference

Conference2017 11th Asian Control Conference, ASCC 2017
CountryAustralia
CityGold Coast
Period17/12/1720/12/17

Keywords

  • minimally invasive surgery
  • real-time image processing
  • robot control
  • Virtual reality

Fingerprint Dive into the research topics of 'Virtual reality control of a robotic camera holder for minimally invasive surgery'. Together they form a unique fingerprint.

Cite this