Skip to main navigation Skip to search Skip to main content

Surgical hand gesture prediction for the operating room

  • Inna Skarga-Bandurova*
  • , Rostislav Siriak
  • , Tetiana Biloborodova
  • , Fabio Cuzzolin
  • , Vivek Singh Bawa
  • , Mohamed Ibrahim Mohamed
  • , R. Dinesh Jackson Samuel
  • *Corresponding author for this work
  • Oxford Brookes University
  • Volodymyr Dahl East Ukrainian National University

Research output: Chapter in Book/Report/Conference proceedingConference proceedings published in a bookpeer-review

Abstract

Technological advancements in smart assistive technology enable navigating and manipulating various types of computer-aided devices in the operating room through a contactless gesture interface. Understanding surgeon actions is crucial to natural human-robot interaction in operating room since it means a sort of prediction a human behavior so that the robot can foresee the surgeon's intention, early choose appropriate action and reduce waiting time. In this paper, we present a new deep network based on Convolution Long Short-Term Memory (ConvLSTM) for gesture prediction configured to provide natural interaction between the surgeon and assistive robot and improve operating-room efficiency. The experimental results prove the capability of reliably recognizing unfinished gestures on videos. We quantitatively demonstrate the latter ability and the fact that GestureConvLSTM improves the baseline system performance on LSA64 dataset.

Original languageEnglish
Title of host publicationpHealth 2020 - Proceedings of the 17th International Conference on Wearable Micro and Nano Technologies for Personalized Health
EditorsBernd Blobel, Lenka Lhotska, Peter Pharow, Filipe Sousa
PublisherIOS Press BV
Pages97-103
Number of pages7
ISBN (Electronic)9781643681122
DOIs
Publication statusPublished - 4 Sept 2020
Externally publishedYes
Event17th International Conference on Wearable Micro and Nano Technologies for Personalized Health, pHealth 2020 - Prague, Czech Republic
Duration: 14 Sept 202016 Sept 2020

Publication series

NameStudies in Health Technology and Informatics
Volume273
ISSN (Print)0926-9630
ISSN (Electronic)1879-8365

Conference

Conference17th International Conference on Wearable Micro and Nano Technologies for Personalized Health, pHealth 2020
Country/TerritoryCzech Republic
CityPrague
Period14/09/2016/09/20

ASJC Scopus subject areas

  • Biomedical Engineering
  • Health Informatics
  • Health Information Management

Keywords

  • ConvLSTM
  • GestureConvLSTM
  • Hand gesture
  • Operating room
  • Prediction
  • Surgeon

Fingerprint

Dive into the research topics of 'Surgical hand gesture prediction for the operating room'. Together they form a unique fingerprint.

Cite this