Sign in Subscribe
Cloud computing

AI-Assisted Security Analysts Outperform Manual Counterparts in Large-Scale Study

Strategic Insights

— 1 min read

A comprehensive benchmark study conducted by the Cloud Security Alliance (CSA) and Dropzone AI has found that AI-assisted security analysts exhibit greater speed and accuracy compared to their manual counterparts. The study, featuring over 140 participants, assessed the performance of SOC analysts under various investigative conditions, with and without AI assistance. The results show that AI-assisted analysts completed escalated alert investigations from 45-61% faster and achieved 22-29% greater accuracy than their manual counterparts.

Key Takeaways:

  • AI-assisted security analysts demonstrated greater speed and accuracy compared to manual analysts, completing escalated alert investigations 45-61% faster and achieving 22-29% greater accuracy.
  • AI-assisted analysts produced more thorough investigations in less time, with greater accuracy and resistance to fatigue, even when using AI tooling for the first time.
  • Manual analysts' report detail dropped by 27% and conclusion detail by 20% during the study, while AI-assisted analysts maintained or slightly increased their level of detail.
  • The study focused on escalated investigations that require analyst involvement, highlighting the importance of AI in high-volume SOC environments.
  • Dropzone AI, the leading provider of AI SOC analysts, armed human analysts with AI agents, allowing them to overmatch attackers.
  • The study supports human judgment at scale, demonstrating that AI can make that happen in a way that was not previously possible.

Statistics:

  • 148 participants were randomly assigned to either the AI-assisted group or the manual (control) group.
  • The study lasted for two months, from July to August 2025.
  • 22% greater accuracy in the first scenario and 29% greater accuracy in the second scenario were achieved by AI-assisted analysts compared to manual analysts.
  • 45% faster in the first scenario and 61% faster in the second faster investigations were completed by AI-assisted analysts compared to manual analysts.
  • Manual analysts' report detail dropped by 27% and conclusion detail by 20% during the study.

Sources:

  • Cloud Security Alliance (CSA)
  • Dropzone AI
  • "Beyond the Hype: A Benchmark Study of AI in the SOC" report
  • NewsRx LLC (https://www.businesswire.com/news/home/20251007376660/en/)

Read more