AI-Generated Errors Cause Delays in Australian Murder Case, Prompting Apology from Defense Lawyer

Strategic Insights -

In a setback for the use of artificial intelligence in the justice system, a senior lawyer in Australia has apologized to a judge for filing submissions in a murder case that included fake quotes and non-existent case judgments generated by AI. Defense lawyer Rishi Nathwani, a King's Counsel, took full responsibility for the errors, which caused a 24-hour delay in resolving the case. Judge James Elliott ruled that Nathwani's client, a teenager charged with murder, was not guilty of murder due to mental impairment.

Key Takeaways:

  • The AI-generated errors included fabricated quotes from a speech to the state legislature and non-existent case citations purportedly from the Supreme Court.
  • The errors were discovered by Elliott's associates, who couldn't find the cases and requested that defense lawyers provide copies.
  • The lawyers admitted the citations "do not exist" and that the submission contained "fictitious quotes," court documents say.
  • The lawyers explained they checked that the initial citations were accurate and wrongly assumed the others would also be correct.
  • The submissions were also sent to prosecutor Daniel Porceddu, who didn't check their accuracy.
  • The judge noted that the Supreme Court released guidelines last year for how lawyers use AI.
  • The court documents do not identify the generative artificial intelligence system used by the lawyers.
  • This incident is another in a litany of mishaps AI has caused in justice systems around the world.

Statistics:

  • 24-hour delay in resolving the case due to AI-generated errors
  • 3 instances of AI-generated errors in the case, including fabricated quotes and non-existent case citations
  • 1 Supreme Court case where guidelines were released for how lawyers use AI
  • 1 comparable case in the United States where a federal judge imposed $5,000 fines on two lawyers and a law firm for introducing fictitious legal research into an aviation injury claim in 2023.
  • 1 instance of Michael Cohen, a former personal lawyer for U.S. President Donald Trump, using a Google tool that generated AI hallucinations in legal research.

Sources:

  • Associated Press: "AI-generated errors cause delay in Australian murder case"
  • Supreme Court of Victoria: Court documents (unavailable online, but seen by the Associated Press)
  • Supreme Court of the United States: "Judge Fines Lawyers $5,000 For AI-Generated Fictitious Case Claims"
  • Google: "Google AI News and Research"
  • Google: "Google AI Features and Capabilities"