Artificial Intelligence Model Accurately Evaluates Surgical Proficiency in Robot-Assisted Prostatectomies
A study published in the journal Surgical Endoscopy has developed an artificial intelligence (AI) model that can accurately identify surgical phases and distinguish expert from novice surgeons in robot-assisted radical prostatectomies (RARP). The research, conducted by a team from the National Cancer Center Hospital East in Kashiwa, Japan, analyzed a dataset of 410 RARP videos from 18 Japanese medical institutions and identified key parameters that distinguish experienced surgeons from novices. The AI model achieved an accuracy of 0.89 in identifying surgical phases and developed a scoring system that effectively differentiated experts from novices with an accuracy of 86.2%.
Key Takeaways:
- The AI model, which used deep-learning technology, was trained on a dataset of 410 RARP videos from 18 Japanese medical institutions.
- The model achieved an accuracy of 0.89 in identifying surgical phases, with experts having significantly shorter durations in phases 2-8 and higher AI confidence scores (AICS) than novices.
- Stepwise analysis identified phases 2 (Retzius space expansion), 7 (dorsal venous complex incision, apex treatment, hemostasis), and 8 (urethrovesical anastomosis) and the AICS as key predictors of expertise.
- The developed AI model revealed that the duration of several surgical phases and AICS are key parameters in assessing surgical skill proficiency in RARP.
- The scoring system developed from these variables effectively distinguished experts from novices with an accuracy of 86.2%.
- The research has been peer-reviewed and is published in the journal Surgical Endoscopy.
Statistics:
- 410 RARP videos were analyzed from 18 Japanese medical institutions.
- The model achieved an accuracy of 0.89 in identifying surgical phases.
- The experts vs. novices accuracy for the developed scoring system is 86.2%.
- 99 videos were used for training, 20 for validation, and 94 for testing.
- 61 experts and 33 novices were included in the analysis.
Sources:
- NewsRx. National Cancer Center Hospital East Reports Findings in Artificial Intelligence (Automatic recognition of surgical phase of robot-assisted radical prostatectomy based on artificial intelligence deep-learning model and its application in surgical skill evaluation: a joint study of 18 medical education centers). Education Letter. July 23, 2025; p 301.
- Springer. (2025). Automatic recognition of surgical phase of robot-assisted radical prostatectomy based on artificial intelligence deep-learning model and its application in surgical skill evaluation: a joint study of 18 medical education centers. Surgical Endoscopy, 2025.