Sign in Subscribe
Artificial intelligence

Emerging AI-Powered Cyber Risks in 2025 and Steps to Defend

Strategic Insights

— 1 min read

As AI transforms businesses, powering analytics and reshaping customer interactions, it also poses a significant threat to cybersecurity. Cybercriminals are harnessing AI to scale and intensify cybercrime, using generative AI to craft near-perfect phishing messages, voice cloning tools to simulate executives' voices, and deepfake video to mimic someone giving fraudulent instructions. According to Tech Advisors, phishing attacks surged 202% in late 2024, and over 80% of phishing emails now incorporate AI, with nearly 80% of recipients opening them.

Key Takeaways:

  • AI-generated phishing and social engineering attacks are skyrocketing, with phishing emails incorporating AI and bypassing filters to fool employees.
  • Adaptive AI-malware and autonomous attacks are driven by AI itself, automatically learning, adapting, and developing strategies with minimal human intervention.
  • Attacks against AI models themselves, including data poisoning, prompt injection, and model theft/inversion, can lead to compromised AI, leaked sensitive data, or disclosure of confidential corporate information.
  • Deepfakes and identity fraud are being used to mimic executives or trusted contacts, instructing staff to transfer funds, disclose passwords, or bypass security protocols.
  • AI accelerates supply chain attacks, enabling automated scanning and compromise of vendor infrastructures.
  • Employees should recognize not just misspellings, but hyper-realistic phishing, voice calls, and video impersonations.
  • Relying solely on vendor security practices may not be sufficient, particularly if not read carefully and in context.
  • Organizations should validate AI inputs and monitor outputs to spot vulnerabilities.
  • Deploying AI-driven defensive tools, adopting zero-trust and multi-factor authentication, and planning for AI-targeted incidents are crucial steps to enhance cyber resilience.

Statistics:

  • Phishing attacks surged 202% in late 2024 (Source: Tech Advisors).
  • Over 80% of phishing emails now incorporate AI (Source: Tech Advisors).
  • Nearly 80% of recipients opened phishing emails incorporating AI (Source: Tech Advisors).
  • Phishing attacks are expected to continue to rise in 2025 due to the increasing use of AI-generated attacks (Source: Cyber Defense Magazine).
  • Deepfake fraud activity increased by 3,000% (Source: Unknown).

Sources:

  • Tech Advisors
  • Cyber Defense Magazine
  • Adversarial Machine Learning A Taxonomy and Terminology of Attacks and Mitigations (NIST)
  • Jackson Lewis P.C.
  • Mondaq Ltd

Read more