Sign in Subscribe
Artificial intelligence

Artificial Intelligence in Academic Writing: A Comparative Analysis

Strategic Insights

— 1 min read

A recent study conducted by researchers from Southwest Minnesota State University has sparked debate on the potential of artificial intelligence (AI) in academic writing. The study, published in the Journal of Neurosurgery-spine, aimed to evaluate the strengths and limitations of AI-generated content in scientific publishing. The research found that while AI can improve aspects of scientific writing, such as clarity and readability, it falls short in critical reasoning and contextual understanding. This study suggests that AI may be used as a complementary tool to support, rather than replace, human-led scientific writing.

Key Takeaways:

  • The study compared the quality of human-written and AI-generated scientific manuscripts in five domains: clarity and readability, coherence and flow, technical accuracy, depth, and conciseness and precision.
  • The AI-generated manuscript scored higher in clarity and readability (mean 9.0 vs 7.2), but lower in technical accuracy (mean 6.3 vs 9.3) and depth (mean 5.5 vs 7.5).
  • Reviewers noted that the AI version lacked depth, critical analysis, and contextual interpretation.
  • All reviewers accurately identified the authorship of each manuscript and tended to rate the version more favorably when it aligned with their own origin (human or AI).
  • The study reinforced the importance of human authorship and oversight in maintaining critical analysis and scientific accuracy in academic publishing.
  • AI may be used as a complementary tool to support, rather than replace, human-led scientific writing.

Statistics:

  • The AI-generated manuscript scored 9.0 out of 10 in clarity and readability, compared to 7.2 for the human-written manuscript.
  • The AI-generated manuscript scored 6.3 out of 10 in technical accuracy, compared to 9.3 for the human-written manuscript.
  • The AI-generated manuscript scored 5.5 out of 10 in depth, compared to 7.5 for the human-written manuscript.
  • 100% of reviewers accurately identified the authorship of each manuscript.
  • 3 reviewers rated the AI-generated manuscript higher when they were AI, while 2 reviewers rated the human-written manuscript higher when they were human.

Sources:

  • Can artificial intelligence write science? A comparative analysis of human-written and artificial intelligence-generated scientific writings. Journal of Neurosurgery-spine, 2025:1-6.
  • Southwest Minnesota State University, 3Dept. of Mathematics and Computer Science, Marshall, Minnesota, USA.
  • Amer Assoc Neurological Surgeons, 5550 Meadowbrook Drive, Rolling Meadows, IL 60008, USA.
  • Aleeza Safdar, Karim Rizwan Nathani, Maliya Delawan, Mohamad Bydon, and Ali-Muhammad Nathani, Researchers, Southwest Minnesota State University.

Read more