Researchers Develop AI-Powered Markerless Augmented Reality for Surgical Robots

Strategic Insights -

Researchers at Wayne State University have developed a novel approach to markerless augmented reality (AR) for surgical robots, utilizing artificial intelligence (AI) to improve precision. The study, published in the journal Robotics, examines the integration of AR within the da Vinci Surgical Robot, utilizing AI for improved precision. The research team, led by Abhishek Shankar, demonstrated the use of a dense neural network to reduce the total projection error by directly learning the mapping of a 3D point to a 2D image plane. The results show a median error of 7 pixels (1.4 mm) when using a neural network, as compared to an error of 50 pixels (10 mm) when using a more traditional approach.

Key Takeaways:

  • The study develops a novel approach to markerless augmented reality (AR) for surgical robots, utilizing artificial intelligence (AI) to improve precision.
  • The research team employed a dense neural network to reduce the total projection error, achieving a median error of 7 pixels (1.4 mm) compared to 50 pixels (10 mm) using traditional methods.
  • The study demonstrates the use of a neural network to directly learn the mapping of a 3D point to a 2D image plane, enhancing the accuracy of AR for surgical procedures.
  • The research findings underscore the potential of AI in revolutionizing AR applications in medical robotics and other teleoperated systems.
  • The approach offers a more seamless integration with existing robotic platforms, promising efficient and safer interventions.
  • The study was conducted by researchers at Wayne State University, led by Abhishek Shankar, in collaboration with Luay Jawad and Abhilash Pandya.
  • The research has implications for the development of more accurate and efficient surgical procedures, as well as the integration of AI-powered AR in medical robotics.

Statistics:

  • The median error of the neural network approach was 7 pixels (1.4 mm), compared to 50 pixels (10 mm) using traditional methods.
  • The study utilized a dense neural network to reduce the total projection error.
  • The research team demonstrated a 75% reduction in error compared to traditional camera-calibration approaches.
  • The study was published in the journal Robotics, Volume 14, Issue 7, page 99.
  • The research was conducted by researchers at Wayne State University, in collaboration with other institutions.
  • The study has implications for the development of more accurate and efficient surgical procedures.

Sources:

  • NewsRx. Research on Robotics Detailed by Researchers at Wayne State University (An AI Approach to Markerless Augmented Reality in Surgical Robots). Medical Devices & Surgical Technology Week. August 17, 2025; p 1324.
  • Robotics. An AI Approach to Markerless Augmented Reality in Surgical Robots. 2025,14(7):99. (http://www.mdpi.com/journal/robotics).
  • MDPI AG. Robotics. (http://www.mdpi.com/journal/robotics).
  • Wayne State University. Department of Computer Science. (https://www.cse.wayne.edu/).