Reinforcement Learning-Based Control for Collaborative Robotic Brain Retraction

Sensors (Basel). 2024 Dec 20;24(24):8150. doi: 10.3390/s24248150.

Abstract

In recent years, the application of AI has expanded rapidly across various fields. However, it has faced challenges in establishing a foothold in medicine, particularly in invasive medical procedures. Medical algorithms and devices must meet strict regulatory standards before they can be approved for use on humans. Additionally, medical robots are often custom-built, leading to high costs. This paper introduces a cost-effective brain retraction robot designed to perform brain retraction procedures. The robot is trained, specifically the Deep Deterministic Policy Gradient (DDPG) algorithm, using reinforcement learning techniques with a brain contact model, offering a more affordable solution for such delicate tasks.

Keywords: ROS; brain retraction; reinforcement learning control.

MeSH terms

  • Algorithms*
  • Brain* / physiology
  • Humans
  • Machine Learning
  • Reinforcement, Psychology
  • Robotic Surgical Procedures / instrumentation
  • Robotic Surgical Procedures / methods
  • Robotics / instrumentation
  • Robotics / methods