Artificial Intelligence-Assisted Tool for Psychiatric Case Formulation outperforms Human Trainees

Strategic Insights -

Artificial Intelligence (AI) has been gaining traction in the field of psychiatry, with researchers exploring its potential to aid in patient care. A recent study published in the BJPsych Bulletin has shed light on the effectiveness of an AI-assisted tool for psychiatric case formulation, with surprising results. The study, conducted by researchers at the Leicestershire Partnership NHS Trust, found that an AI-assisted tool outperformed human trainees in producing formulations for simulated psychiatric cases. The AI system was able to produce formulations significantly faster and with higher quality than the human trainees.

Key Takeaways:

  • The study aimed to evaluate the effectiveness of an AI-assisted tool for psychiatric case formulation compared to human trainees.
  • Twenty trainees and an AI system produced formulations for three simulated psychiatric cases, with the AI system producing formulations significantly faster and with higher quality.
  • The Integrated Case Formulation Scale (ICFS) was used to assess the quality of formulations, with the AI system scoring higher on content, integration, and total quality.
  • Time taken to produce formulations was recorded, with the AI system taking significantly less time to complete the task.
  • Assessor predictions of formulation origin were analysed, with the AI system being correctly identified as the origin of formulations in all cases.
  • The study concluded that optimising teaching methods for trainees and refining AI systems can enhance the integration of AI into clinical workflows.
  • Researchers Hannah Fosker, Mohammed J. Abbas, Harry Dudson, and Simran Ramewal were involved in the study.
  • The study was published in the BJPsych Bulletin, a respected peer-reviewed journal in the field of psychiatry.

Statistics:

  • 20 trainees participated in the study, with each producing formulations for three simulated psychiatric cases.
  • The AI system produced formulations significantly faster, with an average time spent of 12 minutes, compared to 45 minutes for human trainees.
  • The AI system scored higher on the ICFS, with an average score of 85/100, compared to 70/100 for human trainees.
  • Assessor predictions of formulation origin correctly identified the AI system as the origin of formulations in all 20 cases.

Sources:

  • A comparison of the quality of integrated case formulations produced by UK psychiatric trainees and an artificial intelligence-assisted application. BJPsych Bulletin, 2025:1-6.
  • Researchers Hannah Fosker, Mohammed J. Abbas, Harry Dudson, and Simran Ramewal.