DAVID DEE DELGADO/Reuters
- Wall Street firm Sullivan & Cromwell apologized for AI hallucinations in a court filing.
- Partner Andrew Dietderich said the errors made it through despite firm policies on AI and reviews.
- Fake legal citations are on the rise as AI hallucinations make there way into court filings.
A partner at the elite Wall Street law firm Sullivan & Cromwell wrote an apology letter to a federal bankruptcy judge for a court filing that contained AI hallucinations.
Andrew Dietderich, co-head of Global Finance & Restructuring at the firm, said in the April 18 note that a prior filing contained inaccurate citations and other errors, including AI hallucinations.
“‘Hallucinations’ are instances in which artificial intelligence tools fabricate case citations, misquote authorities, or generate non-existent legal sources,” Dietderich’s letter said. “We deeply regret that this has occurred.”
A chart attached to the letter showed that the motion contained incorrect case names and numbers and apparently fabricated quotes from cases.
Dietderich said the errors by Sullivan & Cromwell, which represented the bankrupt firm Prince Global Holdings, were caught by the law firm Boies Schiller Flexner, which represented creditors, and that he’d thanked them and apologized.
He said Sullivan & Cromwell — a 140-year-old firm with more than 1,000 attorneys — has comprehensive policies when it comes to using AI and that there are safeguards to avoid this exact scenario. The firm’s policies weren’t followed, and the errors also made it past the firm’s review process for citations, he said.
Dietderich wrote to Manhattan-based Chief Judge Martin Glenn that he and the firm were “keenly aware of our responsibility to ensure the accuracy of all submissions.”
“I take responsibility for the failure to do so,” he said, adding they would submit a corrected version of the filing.
A representative for the firm and Dietderich did not respond to inquiries from Business Insider. A representative for the judge also did not respond.
When it comes to AI hallucinations in legal work, Sullivan & Cromwell has company.
Fake legal citations have become more common since 2023, according to legal researcher Damien Charlotin, who keeps a public database of AI hallucinations in legal cases.
