Sign in Subscribe
Artificial intelligence

AI-Generated Personal Statements in Medical School Admissions Raise Questions on Credibility

Strategic Insights

— 1 min read

Medical school admissions committees rely on personal statements to evaluate applicants' values, motivations, and experiences. However, with the rise of artificial intelligence (AI), a new study suggests that AI-generated personal statements may become a concern for maintaining credibility in medical school admissions. Researchers from Nemours Children's Hospital used AI chatbots to generate personal statements and found that medical school application readers were not always able to distinguish between AI-generated and human-authored statements. The study raises important questions about the role of personal statements in medical school admissions and the potential impact of AI on the evaluation process.

Key Takeaways:

  • The study used ChatGPT 4.0 to generate personal statements from summaries of human-authored essays.
  • Researchers conducted a prospective, single-blind, randomized controlled trial with 17 medical school application readers evaluating unique combinations of AI-generated and human-authored personal statements.
  • Readers demonstrated a 56% accuracy in correctly identifying authorship, while the AI-detection tool, ZeroGPT, showed 91% accuracy.
  • Readers were more likely to assume human authorship of higher scoring essays, which raises questions about the fairness and validity of the evaluation process.
  • The study suggests that medical school admissions committees require urgent reconsideration to maintain credibility.
  • The use of AI-generated personal statements may provide students an unfair advantage in the application process.

Statistics:

  • 56% accuracy in correctly identifying authorship by human readers.
  • 91% accuracy in correctly identifying authorship by ZeroGPT, an AI-detection tool.
  • 17 medical school application readers participated in the study.
  • 325 scoring rubrics were completed across 309 essays.
  • The study was conducted using a prospective, single-blind, randomized controlled trial design.

Sources:

  • Death of the Personal Statement: A Qualitative Comparison Between Human-Authored and Artificial Intelligence-Generated Medical School Admissions Essays. Journal of the American College of Surgeons, 2025.
  • Journal of the American College of Surgeons can be contacted at: Lippincott Williams & Wilkins, Two Commerce Sq, 2001 Market St, Philadelphia, PA 19103, USA.
  • Ishpriya Sharma, Division of Plastic and Craniofacial Surgery, Nemours Children's Hospital, Orlando, FL, United States.

Read more