What the courts found.
What you can change.
Damien Charlotin’s AI Hallucination Cases database passed 2,000 decisions. Explore the record, practice on a brief or a contract, and build verification into the work.
2,008 rows · snapshot September 2, 2026
Damien Charlotin’s database: every decision, updated as courts write them.
Open the database ↗ 02Practice on a filingMake the next decision in a realistic litigation scenario.
Enter the training → 03Review a contractCatch a changed quotation, a missed exception, or an invented term.
Open the deal room →Nine findings from the study
Inspect the record ↗Read the study
Sources and method →Sources for this page
- Damien Charlotin, AI Hallucination Cases, damiencharlotin.com/hallucinations. Figures are from the database’s CSV download as it stood on Sept. 2, 2026 (2,008 rows): the export of Sept. 1 (2,006 rows), plus two rows added and eight rows edited since, each verified row by row against the live download on Sept. 3. Country count excludes one blank row and one ICSID tribunal row.
- Party counts: Pro se 1,154; Lawyer 792; Lawyer (mixed) 9; Government lawyer 7; Paralegal 1; Judge 24; Expert 15; Arbitrator 1; Unknown 5. “Lawyers or their staff” = 809 (Lawyer, mixed, government lawyer, paralegal). Common-law jurisdictions: 1,807 decisions from the United States, Canada, Australia, the United Kingdom, India, Singapore, New Zealand, Ireland, Hong Kong, Kenya, Uganda, Tanzania, Zimbabwe, Papua New Guinea, the Bahamas, and Trinidad and Tobago, counted by the database’s country field (which does not separate Quebec or Scotland); mixed systems such as Israel (57) and South Africa (6) are not counted.
- Median sanction: the 143 U.S. decisions tagged “Lawyer” with a stated dollar amount, median $2,500; by half-year, $1,500 (2025 H1, 17 amounts), $3,515 (2025 H2, 56), $2,712 (2026 H1, 57), $3,250 (July–August 2026, 14). Amounts of $25,000 or more by half-year: 1 (2025 H1), 4 (2025 H2), 5 (2026 H1), 2 (July–August 2026); amounts as recorded in the database; its largest, $110,204 in Couvrette v. Wisnovsky (D. Or.), combines a $15,500 penalty (Dec. 12, 2025) with a $94,704.38 award of fees and costs entered in a later order (Mar. 23, 2026), both read from the orders. Suspensions, disbarment, the 128 orders with no invented case (101 of them with at least one real-case defect: a real case misquoted, cited for something it does not hold, matched to the wrong reporter citation, or pinned to the wrong page; the rest a fabricated or misquoted statute or rule, facts not in the record, or another defect), the product counts, and the firm-size figures are explained on the Discipline, The circumstances, and About pages; the free-or-paid point: three of the 450 orders name a ChatGPT version or tier.
- Projections start from 2,008 on Sept. 2, 2026; the trailing rates are measured through July 2026 (August was still being filled in); the linear fit is ordinary least squares over August 2025–July 2026; dates use 30.44-day months. Monthly counts in 2026: 136, 132, 178, 127, 154, 127, 129 (mean 140), and 100 for an August still being filled in (154 in December 2025).
- Milestones by decision date: 500th Sept. 24, 2025; 1,000th Jan. 19, 2026; 1,500th May 1, 2026; 2,000th Aug. 27, 2026; first entry Apr. 14, 2023. Days per five hundred: 894, 117, 102, 118. Per year: 16 in 2023, 59 in 2024, 850 in 2025, 1,083 in January–August 2026. Prior forecast: the 1,000-case dashboard’s forecast array put the cumulative count at 1,870 for September and 2,022 for October 2026.
Two-thirds American, every U.S. state, majority pro se
Of 2,008 decisions, 1,378 (69%) are American and 1,154 (57%) involve pro se litigants. Decisions on lawyers account for 809 (40%) worldwide. We’ll focus on U.S. lawyers.
- Every state and D.C. has at least one decision. Rhode Island, South Dakota, and West Virginia have one each; Alaska and New Hampshire two.
- No decision involving a lawyer yet in Montana, North Dakota, South Dakota, or West Virginia.
- Federal courts publish more searchable orders, so the 68% federal share partly reflects what can be found. The data does not show that state-court practice is safer: state courts handed down three of 2026’s ten largest dollar sanctions against lawyers.
- Appellate courts are in the record too: the Second Circuit’s grievance-panel referral in Park v. Kim (January 2024), the Fourth Circuit’s public admonishment in In re Nwaubani (March 2026), the Nebraska Supreme Court’s dismissal of an appeal in Prososki v. Regan (March 2026), the Sixth Circuit’s $30,000 in fines in Whiting v. City of Athens (March 2026), the Ninth Circuit’s six-month suspensions in Lnu v. Blanche (June 2026), and the California Court of Appeal’s published $10,000 sanction in Noland v. Land of the Free (September 2025).
The pro se majority, briefly
- 817 of the 1,378 U.S. decisions (59%) involve a pro se party. The most common recorded outcome is a warning (413); 59 involve a dismissal of some kind; 41 record a monetary outcome, median about $600 where an amount is stated.
- This site focuses on lawyers because professional duties create a different accountability question. The pro se majority is an access-to-justice story that deserves its own study.
Sources for this page
- All counts from the database as of Sept. 2, 2026, U.S. rows (1,378). Court level and type from a rule-based reading of the free-text court field, checked against the linked order for every state-court label family: the database’s “SC” codes mean Superior Court (a trial court) in California, Connecticut, Delaware, Georgia, Massachusetts, Rhode Island, Vermont, and D.C., the Superior Court of Pennsylvania (an appellate court) in Pennsylvania, the Superior Court in New Jersey (one row, an Appellate Division decision), and Supreme Court in North Dakota, Nevada, Nebraska, Arkansas, Alabama, Hawaii, Oklahoma, Oregon, New Mexico, Colorado, and Iowa; one “SC New Hampshire” row with no case name or document is left unclassified; 17 rows were placed by reading the order or a companion decision where the label alone did not settle it (four “SC New York” rows are Appellate Division decisions; four district-court labels are bankruptcy court decisions; one row labeled “CC Minnesota” is a Mississippi circuit court order). Court types: trial 955, intermediate appellate 329, bankruptcy 33, administrative bodies 33, courts of last resort 24, unclassified 4. Federal 934, state 442, one tribal court, one arbitral forum. 84 rows have no home state. Top states: California 139, New York 123, Texas 84, Florida 66, Illinois 63, Michigan and Arizona 50 each.
- Busiest courts, with every label variant merged: S.D.N.Y. 50 (“S.D. New York” + “SDNY”); California Court of Appeal 40 (“CA California” and its six district variants plus one long-form label); New York Supreme Court 36 (“SC New York” + “Supreme Court, NY,” less the four Appellate Division decisions); E.D. Mich. 33; N.D. Ill., C.D. Cal., and W.D. Wash. 31 each; D. Ariz. and D. Nev. 29; N.D. Cal. 27; Texas Courts of Appeals 27 (seven label variants); Illinois Appellate Court 23 (six); D.N.J. 23; Florida District Courts of Appeal 22 (seven); S.D. Fla. and M.D. Fla. 21 each (both shown, tied at the cutoff). Next: the Arizona Court of Appeals, the California Superior Court, and the Government Accountability Office (bid protests), 20 each.
- Lawyer split: 360 federal, 186 state (of 546). Pro se monetary median: 38 U.S. pro se rows with a stated dollar amount, median $605.
- Appellate examples: Park v. Kim, 91 F.4th 610 (2d Cir. 2024); In re Nwaubani, No. 25-9517 (4th Cir. Mar. 11, 2026); Prososki v. Regan, 321 Neb. 38 (2026); Whiting v. City of Athens, 170 F.4th 455 (6th Cir. 2026); Lnu v. Blanche, No. 24-4790 (9th Cir. June 3, 2026); Noland v. Land of the Free, L.P., 114 Cal. App. 5th 426 (2025).
- Largest 2026 amounts against lawyers from state courts: Kleyman Law Group v. Kaloidis (N.Y. Sup. Ct.) $46,511; Ibach v. Stewart (Ala.) $17,200; Scott v. Illinois Human Rights Comm’n (Ill. App. Ct.) $15,000 — three of the ten largest, as recorded in the database.
- Map outlines: the us-atlas project’s 1:10m state boundaries (from the U.S. Census Bureau), Albers USA projection, simplified for this page.
What 450 court orders say about U.S. lawyers
Of the 420 lawyers identified, 37 appear in multiple orders — one lawyer appears in five.
What about gender?
In the lawyers’ own words
“I didn’t know AI could do that” appears in 22 of 450 orders (5%). Counting each decision once, the ignorance family — didn’t know, thought it was a search engine, first time using AI — covers 35 (8%). Four of them:
“I did not fully appreciate that such tools can generate inaccurate or nonexistent citations unless each authority is independently verified through reliable legal research sources.”Lawyer’s declaration, quoted in Capital Standard, LLC v. U.S. Bank Nat’l Ass’n (Fla. 2d DCA Aug. 21, 2026)
“[T]he errors were unintentional and resulted from an inadequate verification process that confirmed only the existence of the cited cases, rather than the accuracy of the quotations, pin cites, parentheticals, and legal propositions attributed to those authorities.”Barteca Holdings LLC v. Tacobarn (D. Conn. Aug. 4, 2026), recording counsel’s explanation
“[S]he was unaware that AI could produce hallucinated cases and explained that she did not even know what a hallucinated case was.”Withers v. City of Aberdeen (N.D. Miss. June 8, 2026), describing an explanation the court found “insufficient and incredulous”
She “understood that ChatGPT was capable of what we have come to call hallucinations,” but “did not understand it could manufacture legal citations with fictitious names and ‘publication information.’”Jordan v. Chicago Housing Authority (Cir. Ct. Cook County, Ill. Dec. 5, 2025), describing a law-firm partner’s explanation
Four takeaways
- Courts mostly do not record which product it was. Only 86 orders name the product (ChatGPT 35, legal research platforms with an AI layer 23, Gemini or Google 7, Claude 4, Copilot 2). That share, one in five, has been flat since mid-2025. The sanction turns on what the lawyer did after the output arrived, not on where it came from.
- Most of the lawyers caught were solo or in small firms.
Firm size of the 395 private-practice lawyers placed in one bandThe orders themselves state firm size only 16% of the time; the rest comes from dockets, filings, and firm and bar records (method in About).
Of the 420 lawyers identified in 391 of the 450 orders: 395 in private practice and placed in one band; 23 in government, public defense, legal aid, in-house, or other roles outside a firm; one privacy pseudonym with no organization; one repeat lawyer who was a solo in one order and at a 2–10-lawyer firm in a later one. A distribution within collected cases, not a hallucination rate by firm size. - The first order is not always the last. Thirty-seven of the 420 lawyers identified appear in more than one order, thirteen of them only because one case produced two. For the rest, the record shows what happened after a court had already spoken:
First order regarding the lawyer What followed Facey v. Fisher (N.Y. Sup. Ct., Sept. 15, 2025): sanctions under 22 NYCRR 130-1.1 against the plaintiff’s lawyer, with the defendants’ fees, in an order noting that federal judges had already warned him (“This conduct cannot go unaddressed and without consequences.”) Five orders in six months. Two weeks later a District of New Jersey warning (Kertesz v. Colony Tire, Sept. 30, 2025: “It is sanctionable conduct”); in December, $6,000, a self-report to the New Jersey and New York licensing authorities, and copies to the client (Gardner v. Combs, Dec. 15, 2025), then the consolidated complaint dismissed without prejudice, with thirty days to amend, after an opposition brief that “continued to use fabricated citations” (Hildebrandt v. SiParadigm, Dec. 31, 2025); in March 2026 a public admonition from the Southern District of New York: “[T]he warnings and sanctions by the courts, as well as the CLE courses, did not have an appreciable impact” (Cartagena v. Dixon, Mar. 10, 2026) LiveVideo.AI Corp. v. Redstone (S.D.N.Y.): an earlier grievance-committee referral June 2026: $85,056 in fees, and the lawyer referred to the district’s grievance committee “again” Withers v. City of Aberdeen (N.D. Miss.): show-cause hearing, Jan. 20, 2026 March 2026: the same lawyer filed two more documents citing nonexistent cases in a Louisiana bankruptcy court and was sanctioned there on Apr. 9 (In re Wise, Bankr. W.D. La.); the Mississippi sanctions order of June 8, 2026 notes it Coomer v. Lindell (D. Colo.): $3,000 sanctions, July 2025 March 2026: a second show-cause order proposing a “graduated amount of $5,000” “for their continued failure to check their citations”; imposed May 2026 - It is not a novice problem. The failures span the career ladder, from 0 to 56 years since the earliest verified bar admission found. Of the 420 lawyers identified, 394 have a bar-admission year we could verify. At the date of the first order against each of them, the median lawyer had been admitted for 21 years. More than half (54%) had 20 years or more.
Years since first bar admission, at the first order
Median 21 years; the middle half between 13 and 31; range 0 to 56. The 26 lawyers not in the chart could not be resolved: one court-assigned pseudonym, the rest without a dated public admission record.
Sources and method for this page
- Coverage: of the 546 U.S. rows tagged to a lawyer or a lawyer’s staff, 449 are in the coded set (the 450th comes from a row tagged to a judge or expert in which the court found a lawyer had used AI). The 97 not in it: 73 rows with no retrievable court document (59 link to press or a blog, 14 to nothing), 2 added to the database after the coding was done on Sept. 1–2 (one of them a party’s motion rather than a court order), 12 in which the order or the docket shows the filer was pro se (three of them found on the dockets after the orders were coded and recoded on September 2, 2026), 8 in which the user could not be determined, one whose linked document was a different case, and one unreadable. In pipeline terms: 560 U.S. rows tagged lawyer, prosecutor, government lawyer, federal defender, paralegal, judge, expert, or arbitrator; 483 with a court document hosted by the database, 481 of them downloaded by Sept. 1; 479 converted to text; 477 usable; 450 orders on lawyers after reading. Reading was done by Claude (Sonnet) under a written codebook, one pass per order, with no second coder and no agreement measurement. Every verbatim quotation the coder produced was checked mechanically against the order text after reducing both to letters only (1,565 of 1,586 matched; the 21 that did not are not used); that check establishes the words, not the coder’s reading of them.
- Firm-size research: conducted by OpenAI Codex 5.6 Sol on Sept. 2, 2026 over the 453 orders then coded (recomputed here for the 450 after three rows were recoded as pro se on the strength of the same docket work). Unit: one responsible lawyer in one decision; a lawyer counted only where the record tied that person to the defective filing (user, drafter, signer, show-cause target, or sanctioned person), never from an appearance alone. Firm size at the filing date where a source allowed it, otherwise at the decision date, in whole-firm counts; evidence in order of preference: contemporaneous filings, official firm and government pages, bar records, and archived pages; current pages only with a time caveat; directories last. Confidence across the 525 lawyer-decision records after the recode: 174 high, 267 medium, 24 low, 60 unresolved. The workbook and its 44 preserved source files are kept with the project and are not published because they name lawyers and small firms. Names consolidated on Sept. 3, 2026: the 434 name forms in the research resolve to 420 people after 14 pairs were matched by bar registration number, firm, and case (a shared surname, firm, or case alone was not treated as a match). Repeat lawyers are counted from the same roster: 37 of 420 in two or more of the 450 orders (one in five, one in four, three in three), of whom 13 appear twice only because one case produced two orders. One repeat lawyer’s firm is counted at 11–99 lawyers for both of her orders on the basis of an 11–20-member entry in the state bar directory, reported by the lawyer herself and last updated five months after the earlier order; the later order recounts a 2025 workflow with a supervising attorney on staff, which rules out a solo practice.
- Years since bar admission: researched by OpenAI Codex 5.6 Sol on Sept. 3, 2026 for the same 420 lawyers. The measure is the earliest verified admission we found, taken from official bar records (138 lawyers), official court or government sources (21), official firm or employer biographies (32), Martindale, Avvo, Justia, Lawyers.com, or another structured directory (196), and a court decision or other public report (7); no year was inferred from a law-school graduation year, a bar number, an age, a first appearance, or a firm’s founding date. Exact admission dates for 110 lawyers (completed years at the order date); the year only for 284 (order year minus admission year, accurate to within a year); 26 unresolved (a court-assigned pseudonym, a known license without a public date, an earlier foreign or territorial license without a date, or a directory behind a login). Confidence: 153 high, 231 medium, 10 low. Measured at the date of the first of the 450 orders against each lawyer, which can slightly overstate experience at the date of the defective filing. Bands: 0–1 years 4; 2–4 17; 5–9 44; 10–19 116; 20–29 103; 30 or more 110. The table names lawyers and is not published.
- Who generated the citation: signing lawyer 187; associate 7; paralegal or staff 9; law clerk, intern, or student 9; contract lawyer 5; co-counsel or local counsel 6; client 10; unknown or denied 217. How used: research 174; drafting portions 121; entire document 62; editing or formatting citations 8; checking own work 12; summarizing the record 6; not stated 193.
- Explanations (a decision can carry several): none recorded 179; admitted and apologized 138; delegated and did not check 67; typo or formatting 50; denied using AI 44; blamed another person 44; verified some citations 32; personal hardship 32; time pressure 27; blamed software 23; did not know AI fabricates 22; trusted a legal-specific or paid tool 22; first time using AI 15; workload 14; thought it was a search engine or database 9; other 54.
- Candor (265 recorded): admitted after the court raised it 162; admitted, timing not stated 1; admitted at once or self-disclosed 22; denied then admitted 26; denied throughout 17; doubled down with more bad citations 37. Side: plaintiff 226, appellant 67, petitioner 33; defense 78, respondent 13, appellee 9; criminal defense 10; prosecution 1; other 10; unknown 3. Firm size not stated 379; solo 44; two to ten 10; government 8; 100+ 6; in-house 2; mid-sized 1.
- Capital Standard, LLC v. U.S. Bank Nat’l Ass’n (Fla. 2d DCA Aug. 21, 2026); Barteca Holdings LLC v. Tacobarn (D. Conn. Aug. 4, 2026); Wilkes v. Canyons Sch. Dist. (D. Utah May 4, 2026); Withers v. City of Aberdeen (N.D. Miss. June 8, 2026). Repeat conduct: LiveVideo.AI Corp. v. Redstone (S.D.N.Y. June 9, 2026) (“[Counsel] is again referred to the Grievance Committee of this District”); Withers, above (noting In re Wise (Bankr. W.D. La. Apr. 9, 2026)); Coomer v. Lindell, No. 1:22-cv-01129 (D. Colo.), orders of July 7, 2025 and May 7, 2026 and second show-cause order of Mar. 25, 2026, as recorded in the docket text. Large-firm examples: Lacey v. State Farm Gen. Ins. Co., No. 2:24-cv-05205 (C.D. Cal. May 6, 2025); Johnson v. Dunn, 792 F. Supp. 3d 1241 (N.D. Ala. 2025); Wadsworth v. Walmart Inc., 348 F.R.D. 489 (D. Wyo. 2025); CalMatters (Aug. 18, 2026) on the State Farm matter; Volokh Conspiracy (Apr. 21, 2026) reproducing Sullivan & Cromwell’s disclosure letter (a voluntary disclosure, not a sanction).
A language model, by itself, is not looking anything up
A language model predicts text; it does not verify citations. Retrieval, browsing, and citator links do not fully solve the issue. You must verify.
The mutation problem
A check that asks only whether the case exists catches one kind of error. The Princeton taxonomy of citation hallucinations, built from actual filings, has five categories, and an existence check catches only one of them: the case that does not exist. The other four survive it: a name and a reporter citation that “refer to two different real cases,” a page that “does not support the quoted language,” a quotation that “does not appear in the cited case,” and a real case that “does not support the proposition.” In 32 of the 450 orders on lawyers (7%), the lawyer told the court that some of the citations had been checked; the rest had not.
In Concord Music Group v. Anthropic (N.D. Cal. May 23, 2025), a lawyer had the right article and the right link and asked Claude to put the citation in proper form. Back came the right journal and year with “a fictitious article name with inaccurate authors (who have never worked together).” The AI’s process transformed the citation from correct to incorrect, and nobody noticed until it was filed. “That is a plain and simple AI hallucination,” the magistrate judge wrote, and yet “the underlying article exists, was properly linked to and was located by a human being using Google search.”
A real article, found by a person using a search engine, with a working link.
As filed in footnote 3 of the declaration (ECF No. 341-2). The journal, volume, page, year, and link were right. The title and the authors were invented.
- Parker v. Costco Wholesale Corp. (W.D. Wash. Nov. 7, 2025): drafting with a legal-specific AI tool, “the cases offered by Counsel do exist and some generally stand for the propositions attributed to them through hallucinated quotations. But the quotations Counsel included do not actually exist.” $3,000 to the court, the defendant’s fees, a public reprimand, and a bar referral.
- TOV Realty, LLC v. Suarez (Conn. July 31, 2026): the lawyer wrote accurate documents and used ChatGPT to edit them; “unbeknownst to [the lawyer], the drafts produced by ChatGPT added new case citations or altered existing case citations.” Six hours of CLE and donations to the Connecticut Bar Institute.
Verify every citation after the final AI-assisted pass, including editing and formatting.
Legal research tools still require review
- Retrieval does not eliminate citation errors. The 2024 and 2025 Stanford studies used different tasks and definitions, so their percentages are not a controlled comparison of retrieval with general chatbots. The retrieval-based systems in the 2025 study still made citation errors; that study’s own summary is “no panacea.” Vendor headlines have promised more than the release text (sources below).
- A citator signal does not establish that a quotation or proposition is accurate. “Linked and Shepardized” means the case exists and carries a citator flag. Whether it says what the AI’s sentence claims, and whether it is good law for that proposition, require reading the case.
Sources for this page
- OpenAI, Why language models hallucinate (Sept. 5, 2025), openai.com; Adam Tauman Kalai, Ofir Nachum, Santosh S. Vempala & Edwin Zhang, Why Language Models Hallucinate, arXiv:2509.04664 (Sept. 4, 2025) (abstract). The paper’s examples are dissertation titles and birthdays; the application to citations is ours.
- Matthew Dahl, Varun Magesh, Mirac Suzgun & Daniel E. Ho, Large Legal Fictions: Profiling Legal Hallucinations in Large Language Models, 16 J. Legal Analysis 64 (2024) (“hallucinate between 58% (ChatGPT 4) and 88% (Llama 2) of the time”; the misspelling “verifable” is in the published text). Varun Magesh, Faiz Surani, Matthew Dahl, Mirac Suzgun, Christopher D. Manning & Daniel E. Ho, Hallucination-Free? Assessing the Reliability of Leading AI Legal Research Tools, 22 J. Empirical Legal Stud. 216 (2025) (“each hallucinate between 17% and 33% of the time”; “misgrounded” means “key factual propositions are cited but misinterpret the source or reference an inapplicable source”; “RAG systems, however, are no panacea”); preprint at law.stanford.edu.
- Sijia Chen, Hang Yin & Shunfan Zhou, LegalCiteBench: Evaluating Citation Reliability in Legal Language Models, arXiv:2605.10186 (May 11, 2026) (closed-book setting). Patty Liu, Dominik Stammbach & Peter Henderson, Who Checks the Citations? Benchmarking Legal Hallucination Detection, arXiv:2606.21155 (v2, Aug. 6, 2026), arxiv.org (92 legal drafting prompts across eight model generations; § 3, taxonomy). A preprint, not yet peer reviewed.
- Database as of Sept. 2, 2026, “Hallucination Items” field: “Fabricated” in 1,666 decisions; “Misrepresented” 837; “False Quotes” 544; “Outdated Advice” 33; 239 decisions carry no Fabricated entry; 103 carry no itemized entry. Subcategories: Case Law 1,806; Legal Norm (statutes, rules, regulations) 232; Exhibits & Submissions 144; Doctrinal Work 44; Other 43; Overturned Case Law 17; Repealed Law 16. Share of the coded orders on lawyers with no invented case: 128 of 450.
- Concord Music Grp., Inc. v. Anthropic PBC, No. 5:24-cv-03811-EKL (SVK) (N.D. Cal.): the citation as filed, ECF No. 341-2 at 3 n.3 (Apr. 30, 2025); counsel’s explanation of the formatting request and the manual check that missed it, ECF No. 371 ¶¶ 3–8 (May 15, 2025), which identifies the real article; the order, 2025 WL 1482734, ECF No. 377 (May 23, 2025) (van Keulen, M.J.). The real authors are Owen McGrath and Kevin Burke; the two named in the filed citation have never written together, as the order notes. Parker v. Costco Wholesale Corp., No. C25-0519-SKV (W.D. Wash. Nov. 7, 2025) (Vaughan, M.J.); Eugene Volokh, Volokh Conspiracy (Feb. 14, 2026) (the district judge’s referral to the state bar). TOV Realty, LLC v. Suarez, Nos. SC 21183, SC 21184 (Conn. July 31, 2026) (per curiam).
- Vendor language: LexisNexis launched Lexis+ AI (press release, Oct. 25, 2023) under a headline promising “Hallucination-Free Linked Legal Citations,” while the body said the product “minimizes the risk of invented content”; Zach Warren, Thomson Reuters Institute (Aug. 18, 2025), thomsonreuters.com (“GenAI hallucinations are still pervasive in legal filings, but better lawyering is the cure”); Anthropic, Usage Policy (effective Sept. 15, 2025), anthropic.com/legal/aup (legal work listed as a high-risk use: “[A] qualified professional in that field must review the content or decision prior to dissemination or finalization”). Closed-book benchmark: LegalCiteBench (May 2026) tested 21 models producing exact citations with no database to look in and found that “even the strongest models score below 7/100 on citation retrieval and completion.” This site was built with Claude models; the Concord example and the usage-policy quotation are reported as the record has them.
Most fines are modest. Fee awards and disciplinary referrals carry the greater risk.
The first American fine, in 2023, was $5,000. The median amount against a lawyer since is $2,500; the largest verified award in one order is $94,704.38 in fees and costs, and the largest in one case $110,204.38.
The largest amounts against lawyers
| Decision | Court · date | Amount | What it was | Read from |
|---|---|---|---|---|
| Couvrette v. Wisnovsky | D. Or. · Dec. 12, 2025 and Mar. 23, 2026 | $110,204.38 | $15,500 to the court, the briefs struck, and the claims dismissed with prejudice (December); then $94,704.38 in the defendants’ fees and costs, 85% against pro hac vice counsel and 15% against local counsel who had not read the briefs (March) | Both orders |
| ByoPlanet International v. Johansson | S.D. Fla. · July 31, 2025 | $85,567.75 | Fees and costs to three defendants ($36,663 and $48,904.75), due in ninety days; a payment schedule was refused | Order |
| LiveVideo.AI Corp. v. Redstone | S.D.N.Y. · June 9, 2026 | $85,056 | Fees and costs under § 1927 and inherent power, against the client and a lawyer the same court had sanctioned before | Order |
| Jordan v. Chicago Housing Authority | Cir. Ct. Cook County · Dec. 5, 2025 | $59,500 | $10,000 from a lawyer and $49,500 from his firm to plaintiffs’ counsel, plus sections of a post-trial motion struck; the verdict at stake exceeded $24 million | Order |
| Heimkes v. Fairhope Motorcoach Resort | S.D. Ala. · Mar. 31, 2026 | $55,597 | Attorney fees to the opposing party | Order |
| Rivera v. Triad Properties | N.D. Ala. · Mar. 31, 2026 | $47,056.90 | $11,453 from the firm to one set of defendants and $35,603.90, jointly and severally with the lawyer, to another; plus a public reprimand, disqualification, publication of the order, and a bar referral | Order |
| Kleyman Law Group v. Kaloidis | N.Y. Sup. Ct. · Aug. 4, 2026 | $46,511.35 | $10,000 to the Lawyers’ Fund for Client Protection and $36,511.35 in fees to the defendant’s counsel | Order |
| Lacey v. State Farm | C.D. Cal. · May 2025 | $31,100 | Special-master and defense fees, jointly and severally against two firms | Order |
| Whiting v. City of Athens | 6th Cir. · Mar. 13, 2026 | $30,000 + fees | $15,000 from each of two lawyers, plus the appellees’ full appellate fees and double costs | Order |
| In re Rosslyn2016 | Bankr. S.D. Tex. · July 14, 2026 | $29,877 | The trustee’s counsel fees, after a contempt finding | Order |
| Mattox v. Product Innovations Research | E.D. Okla. · Oct. 22, 2025 | $6,000 + $23,495.90 | Fines of $3,000, $2,000, and $1,000 calibrated to three lawyers’ responsibility, plus the opponent’s fees and costs | Order |
Every figure above was read out of the order itself. The database records Rivera at $35,603 (the larger of its two awards), LiveVideo at $80,056 (the order says $85,056), and Mattox as a single $28,495.
Money is the minority outcome
The ceiling so far
- Suspension from practice before a court (9 of 450 orders, 2%): six months (Ninth Circuit; Supreme Court of Georgia); one year from the bar of the Middle District of Florida (In re Neusom, 2024); two years from any case in the Northern District of Mississippi (Withers, 2026), and two years from cases assigned to one judge of that district (Billups, 2025).
- Bar suspension on the merits: one, in Colorado in 2023 (one year and one day, ninety days served). A California State Bar Court recommendation of February 2026 (a stayed one-year suspension) awaits the Supreme Court of California.
- Disbarment: none found in any U.S. jurisdiction as of September 2, 2026 (search scope in the sources). The Seventh Circuit told one lawyer in June 2026 that “the next time any incident occurs, he could be subject to disbarment before this court.”
Reported outcomes after referral to the bar
| Court order | What the bar did | Read from |
|---|---|---|
| Dehghani v. Castro (D.N.M. Apr. 2, 2025): the lawyer was ordered to report the New York attorney who ghost-wrote his brief | May 14, 2026: the Appellate Division, First Department, suspended that attorney on an interim basis for not cooperating with the investigation (Matter of Lewis) | Published slip opinion |
| Noland v. Land of the Free (Cal. Ct. App. Sept. 12, 2025): $10,000 and a referral to the State Bar | Feb. 26, 2026: a State Bar Court recommendation of a stayed one-year suspension, pending before the Supreme Court of California | California Courts Newsroom; not a final order |
| Johnson v. Dunn (N.D. Ala. July 2025): three lawyers disqualified and referred to the bar | Reciprocal discipline in Texas (Nov. 4, 2025), Tennessee (Dec. 15, 2025), and Alabama (Mar. 6, 2026); a public reprimand from the Oklahoma Supreme Court (May 27, 2026), which wrote: “If a lawyer knowingly uses AI to generate citations or analysis for a pleading and knowingly does not verify the accuracy before including it in the pleading, then the lawyer has knowingly made a false statement.” | Oklahoma opinion; the three earlier orders as recited in it |
- Candor sets the price. The Ninth Circuit’s six-month suspensions were imposed less for the fabricated citations than for the lawyers’ “repeated failure of candor” about them; a prompt admission and apology, the court said, might have warranted less. The Eastern District of Oklahoma credited a lawyer’s “candor” and chose $3,000 over what it called “professional ruin.”
- Pro hac vice revocations have proved durable. In Mavy v. Commissioner (D. Ariz. Jan. 2026), a district judge vacated a magistrate judge’s Rule 11 finding and most of the sanctions, and left in place the two that require no bad faith: the brief stayed struck and the lawyer stayed out.
- Clients are being told. Forty-two orders required the lawyer to send the client a copy; seven ordered fees refunded or forfeited, including an appointed appellate lawyer in Illinois who disgorged the full fee the county had paid.
- Unverified but reported: a thirty-day suspension of a Minnesota lawyer (Minnesota Public Radio, Aug. 21, 2026) and a six-month suspension from practice in the Middle District of Pennsylvania (a Pennsylvania litigation blog, July 2026). We could not obtain either order.
Opposing counsel has a verification duty too
- Missed the defects. Noland v. Land of the Free (Cal. Ct. App. Sept. 12, 2025): $10,000 against the appellant’s lawyer for a brief in which 21 of 23 quotations were fabricated — and no fees to the respondents, who had not noticed and “appear to have become aware of the issue only when the court issued its order to show cause.”
- Warned, not sanctioned. Nuvola, LLC v. Wright (Minn. Dist. Ct. Nov. 20, 2025): $1,000 against the lawyer who filed the fake cases, and, while expressly declining to sanction his opponent, a reminder that the duty to check runs to the cases in a brief you are answering.
- Both sides sanctioned. Withers v. City of Aberdeen (N.D. Miss. June 8, 2026): four lawyers sanctioned, two per side, after both lead counsel filed AI-drafted documents with hallucinated cases and both local counsel signed without reading. “This case presents the Court with an unusual scenario—attorneys for both litigants engaged in similar sanctionable conduct.” The trial, set for March, was cancelled.
Sources for this page
- Database as of Sept. 2, 2026, Monetary Penalty field, U.S. rows with a dollar amount (185; 178 labeled USD and seven bare numbers). Where an order sanctions several lawyers the database usually records the sum. Rows recording only that a penalty existed (66 worldwide) are not plotted. Lawyer cases (Lawyer, Lawyer (mixed), Government lawyer, Paralegal): 147 amounts, total $1,181,605, median $2,500; 74 at or under $2,500 (50%); 62 at $5,000 or more (42%). Buckets: under $1,000, 9; $1,000–4,999, 76; $5,000–9,999, 34; $10,000–24,999, 16; $25,000–49,999, 7; $50,000+, 5. Half-year amounts against lawyers, medians, and 75th percentiles (interpolated): 2025 H1, 17 amounts, $1,500 / $3,961; 2025 H2, 56, $3,515 / $7,479; 2026 H1, 57, $2,712 / $7,500; July–August 2026, 14, $3,250 / $12,875. Largest in each: $31,100; $85,568; $110,204 (Couvrette, two orders); $46,511.
- Coded set (see The circumstances): sanction counts — nothing yet 124; warning 93; penalty to court 88; bar referral 87; fees to opponent 70; reprimand 56; filing struck 48; certification on future filings 43; copy to client 42; CLE 41; order distributed 28; dismissal 13; self-report ordered 13; suspension from court 9; disqualified 8; fee refund 7; pro hac vice revoked 4; contempt 4. CLE hours stated in 31 orders: 1 ×4, 2 ×5, 3 ×10, 4 ×2, 6 ×7, 8 ×2, 12 ×1.
- Table: ByoPlanet Int’l, LLC v. Johansson (S.D. Fla. July 31, 2025) ($36,663.00 and $48,904.75; payment schedule denied); LiveVideo.AI Corp. v. Redstone (S.D.N.Y. June 9, 2026) (“the Court awards $85,056”); Jordan v. Chicago Housing Authority (Cir. Ct. Cook County, Ill. Dec. 5, 2025) ($10,000 and $49,500; “the overturning of an award of more than 24 million dollars”); Heimkes v. Fairhope Motorcoach Resort Condo. Owners Ass’n (S.D. Ala. Mar. 31, 2026); Kleyman Law Group, P.C. v. Kaloidis (N.Y. Sup. Ct. Aug. 4, 2026); Lacey v. State Farm Gen. Ins. Co., No. 2:24-cv-05205 (C.D. Cal. May 6, 2025) (Doc. 119); Whiting v. City of Athens, 170 F.4th 455 (6th Cir. 2026); In re Rosslyn2016, LLC (Bankr. S.D. Tex. July 14, 2026); Mattox v. Product Innovations Research, LLC (E.D. Okla. Oct. 22, 2025); Couvrette v. Wisnovsky, No. 1:21-cv-00157-CL (D. Or.): Opinion and Order of Dec. 12, 2025, 2025 WL 4109655, ECF No. 215 (“[Counsel] is ordered to pay the Clerk of the Court $15,500 within 30 days”; briefs stricken; claims dismissed with prejudice; fees awarded), and Opinion and Order of Mar. 23, 2026, ECF No. 225 (“finds the requested amount of $94,704.38 reasonable”; $80,498.72 against pro hac vice counsel and $14,205.66 against local counsel). Rivera v. Triad Properties Corp., No. 2:24-cv-01802-AMM (N.D. Ala. Mar. 31, 2026), Doc. 116 at 102–05 (“The court ORDERS [the firm] to pay the Triad Defendants $11,453. The court further ORDERS [the lawyer] and [the firm] to pay, jointly and severally, $35,603.90 to the Fite Defendants.”).
- Range: Lnu v. Blanche, No. 24-4790 (9th Cir. June 3, 2026) ($2,500 each; “suspended from practice before this Court for a period of six months”; “The gravity of discipline we impose, including the temporary suspension of practice, is owed to this repeated failure of candor.”); Payne v. State, No. S26A0459 (Ga. May 5, 2026); Withers v. City of Aberdeen (N.D. Miss. June 8, 2026) (two-year bar; pro hac vice revoked; local counsel disqualified; CLE “on artificial intelligence with an ethics component”); Billups v. Louisville Municipal School District, No. 1:24-cv-00074 (N.D. Miss. Dec. 19, 2025) (Doc. 79; “shall not enter an appearance in any other case assigned to the undersigned for a period of two (2) years”); In re Neusom, No. 2:24-mc-2 (M.D. Fla. Mar. 8, 2024) (Doc. 6; one-year suspension from the bar of that court; the database dates the entry May 8, 2025); People v. Crabill, No. 23PDJ067 (Colo. O.P.D.J. Nov. 22, 2023); California State Bar Court recommendation of Feb. 26, 2026, per the California Courts Newsroom (not a final order); Perez-Castillo v. Blanche (7th Cir. June 1, 2026) ($5,000 under Fed. R. App. P. 46(c)). Disbarment search (through Sept. 2, 2026; all U.S. jurisdictions; any discipline record, bar notice, or court order citing AI-fabricated authority): news, bar, and court sources; the American University library guide to disciplinary actions; the database itself. Absence from those sources is not proof of absence.
- Chains: Dehghani v. Castro, No. 2:25-cv-0052 (D.N.M. Apr. 2, 2025); Matter of Lewis, 2026 NY Slip Op 03074 (1st Dep’t May 14, 2026) (interim suspension under 22 NYCRR 1240.9(a)(3)); Noland v. Land of the Free, L.P., 114 Cal. App. 5th 426 (2025); Johnson v. Dunn, 792 F. Supp. 3d 1241 (N.D. Ala. 2025); State ex rel. Oklahoma Bar Ass’n v. Reeves (Okla. May 27, 2026) (reciprocal discipline following Texas (Nov. 4, 2025), Tennessee (Dec. 15, 2025), and Alabama (Mar. 6, 2026)). Mattox, above (“The Court credits his candor”; “presents a rare opportunity for public correction rather than professional ruin”). Mavy v. Comm’r of Soc. Sec. Admin., No. CV-25-00689 (D. Ariz. Jan. 13, 2026). In re Baby Boy (Ill. App. Ct. 4th Dist. July 21, 2025) (disgorgement of $6,925.62). Minnesota: MPR News, Aug. 21, 2026. Pennsylvania: Tort Talk (July 2026), reporting Twigg v. BSN Sports, Inc., No. 4:23-cv-00067 (M.D. Pa. June 18, 2026).
- Noland, above (“respondents did not alert the court to the fabricated citations and appear to have become aware of the issue only when the court issued its order to show cause”); Nuvola, LLC v. Wright (Minn. Dist. Ct., Hennepin County, Nov. 20, 2025) (“The Court does not find [opposing counsel’s] conduct to be sanctionable”); Withers, above (trial “previously set to occur on March 23, 2026”).
The courts did not lose patience. They started with little.
Orders were firm from the start. The stern-or-exasperated share has stayed near 63% since early 2025.
How the warning changed, 2025–26
Five sentences, verbatim and in date order, from a district court’s first warning of 2025 to the latest appellate one.
“Counsel is warned that any future filings with citations to nonexistent cases may result in sanctions.”
“If fines and public embarrassment were effective deterrents, there would not be so many cases to cite.”
“It has become clear that basic reprimands and small fines are not sufficient to deter this type of misconduct because if it were, we would not be here.”
“It is a problem that is getting worse—not better.”
“Consequently, we may not be so gentle on attorney offenders in the future.”
What the sharp language is for
- The harshest orders go to lawyers who were not candid: who denied using AI and then admitted it, who answered a show-cause order with a second filing full of invented quotations, or who blamed a paralegal, a relative, or a software update. Lack of candor was the aggravating factor courts noted most often (144 of 450), tied with the burden on the court.
- Seventeen of the 22 orders (77%) in which the lawyer admitted the problem at once were coded measured, and several say so. The Eastern District of Oklahoma credited a lawyer’s “candor” and chose a $3,000 fine over “professional ruin.” The Ninth Circuit said a prompt admission and apology might have warranted less than the six-month suspension it imposed.
- Later orders repeatedly cite a small group of earlier sanctions decisions when selecting a remedy: 243 of 450 (54%) cite at least one.
What each is cited for
In the citing courts’ own parentheticals where we have them.
| Decision | Orders citing it | Cited for |
|---|---|---|
| Mata v. Avianca, Inc., 678 F. Supp. 3d 443 (S.D.N.Y. 2023) | 115 | The gatekeeping duty; the catalogue of harms; $5,000 and letters to the client and to each judge falsely named as an author |
| Park v. Kim, 91 F.4th 610 (2d Cir. 2024) | 57 | Rule 11 requires that attorneys “read, and thereby confirm the existence and validity of,” the authorities they cite; referral to the grievance panel |
| Wadsworth v. Walmart Inc., 348 F.R.D. 489 (D. Wyo. 2025) | 56 | Signers who did not know AI was used are still liable; the three-factor penalty calculation; the remediation checklist; pro hac vice revoked |
| Benjamin v. Costco Wholesale Corp., 779 F. Supp. 3d 341 (E.D.N.Y. 2025) | 47 | $1,000, “lower than in many other similar cases in part because of [counsel’s] candor and sincere regret”; one-time use; voluntary CLE |
| Johnson v. Dunn, 792 F. Supp. 3d 1241 (N.D. Ala. 2025) | 38 | Disqualification of three lawyers, public reprimand, and bar referral; “even the most cursory of investigations, or a spot check” would have found the problem |
| United States v. Hayes, 763 F. Supp. 3d 1054 (E.D. Cal. 2025) | 39 | Bad faith found where counsel called the fabrications an inadvertent citation error and offered explanations the court rejected; the order served on counsel’s bar and on every judge in the district |
| Gauthier v. Goodyear Tire & Rubber Co., 2024 WL 4882651 (E.D. Tex. Nov. 25, 2024) | 31 | $2,000, a generative-AI CLE, and a copy of the order to the client |
| Mid Central Operating Engineers Health & Welfare Fund v. HoosierVac LLC (S.D. Ind. 2025) | 30 | $15,000 recommended and $6,000 imposed; prior penalties “have evidently failed to act as a deterrent” |
| Noland v. Land of the Free, L.P., 114 Cal. App. 5th 426 (2025) | 23 | Published; $10,000 for a brief in which twenty-one of twenty-three quotations were fabricated; no fees to respondents who had not caught it |
| Versant Funding LLC v. Teras Breakbulk Ocean Navigation Enterprises, LLC (S.D. Fla. May 20, 2025) | 21 | Local counsel sanctioned for “filing a response without ensuring the accuracy of the case citation” although he took no part in drafting |
| Dehghani v. Castro, No. 2:25-cv-0052 (D.N.M. Apr. 2, 2025) | 20 | $1,500, a one-hour CLE, self-report to two bars, and an order to report the ghost-writer to a third |
| ByoPlanet International, LLC v. Johansson (S.D. Fla. July 31, 2025) | 15 | $85,567.75 in fees and costs to three defendants, due in ninety days |
| Lacey v. State Farm General Insurance Co. (C.D. Cal. May 6, 2025) | 15 | $31,100 in special-master and defense fees, jointly and severally against two national firms |
| Garner v. Kadince, Inc., 2025 UT App 80 | 15 | Petition drafted by an unlicensed clerk using ChatGPT; fees, a client refund, and a $1,000 donation to “and Justice for all,” a Utah legal-aid organization |
| Sanders v. United States, 176 Fed. Cl. 163 (2025) | 13 | “It is no secret that generative AI programs are known to ‘hallucinate’ nonexistent cases”; the menu of available sanctions |
| Bevins v. Colgate-Palmolive Co. (E.D. Pa. Apr. 10, 2025) | 12 | Two nonexistent cases and no satisfactory explanation; counsel’s appearance struck, a bar referral, and an order to notify the client, with a standing AI order in the case as an aggravating factor |
In one court’s words
“We expect that when lawyers submit briefs, they give us their best view of what the law is, and how that law supports their clients. We read those briefs carefully—not just because they are the product of counsel’s time, effort, and skill, but because they help us as we try to reach the right answer. All that is lost if a lawyer decides that it is not worthwhile to do the work to persuade us—if he is willing to sign his name on whatever a machine churns out without so much as checking it for accuracy. We cannot do our job the same way unless lawyers do theirs. Whatever the merits of artificial intelligence, it is no substitute for actual intelligence.”Akerlund v. Atlas Air, Inc., No. 24-11033 (11th Cir. July 10, 2026) (Grant, J.), a published opinion, which announced a referral of the lawyer to the court’s Committee on Lawyer Qualifications and Conduct
Has any one judge seen enough of these to change tone?
Not yet. In the 450 orders, one decision-maker appears five times, the general counsel of the Government Accountability Office in bid protests, and three judges appear four times: district judges in the Western District of Texas, the District of Columbia, and the District of Kansas. At four or five orders there is no trend to report. What the repeats show is judges settling on a standard paragraph: the District of Columbia judge’s four orders, over ten months, each advise the lawyer in nearly the same words that “it is not acceptable to submit filings to the Court containing nonexistent cases and quotations.”
Sources for this page
- Tone codes, 450 orders on lawyers: stern 235, measured 167, exasperated or sarcastic 48. By half-year, stern or exasperated: 13 of 21; 93 of 141; 132 of 215; 43 of 67. Explicit escalation statements: 7, 36, 49, 13 (105 of 450). Mata cited in 115; at least one later AI-sanctions decision cited in 243 of 450.
- Warnings (the five shown were chosen from these twelve, each matched to the order text): Arajuo v. Wedelstadt (E.D. Wis. Jan. 22, 2025); Mid Central Operating Engineers Health & Welfare Fund v. HoosierVac LLC (S.D. Ind. May 28, 2025); Johnson v. Dunn, 792 F. Supp. 3d 1241 (N.D. Ala. 2025); Brooks v. Patel (Minn. Dist. Ct., Hennepin County, Sept. 8, 2025); United States v. McGee (S.D. Ala. Oct. 10, 2025); Ringer v. Bank of America, N.A. (N.D. Ga. Dec. 30, 2025); Offen Petroleum LLC v. L&J Express LLC (D. Ariz. Feb. 4, 2026); Clinco v. Commissioner (T.C. Feb. 9, 2026); Fletcher v. Experian Information Solutions, Inc., 168 F.4th 231 (5th Cir. 2026); Kettering Adventist Healthcare v. Collier (S.D. Ohio Feb. 25, 2026); Miller v. Regions Bank (N.D. Ala. May 21, 2026); Capital Standard, LLC v. U.S. Bank Nat’l Ass’n (Fla. 2d DCA Aug. 21, 2026).
- Akerlund v. Atlas Air, Inc., No. 24-11033 (11th Cir. July 10, 2026) (Grant, J.), at 12–13 (the passage is quoted without omission). Repeat decision-makers in the 450 orders: the GAO’s General Counsel, five bid-protest decisions (Jan. 28, Feb. 12, Feb. 13, Feb. 18, and June 16, 2026); Judge Robert Pitman (W.D. Tex.: Jan. 29, 2025; Jan. 20, Feb. 4, and Aug. 18, 2026); Judge Rudolph Contreras (D.D.C.: Oct. 22, 2025 (two orders); Nov. 19, 2025; July 23, 2026), the quoted words from the Nov. 19, 2025 order (Ekeocha v. U.S. Department of State); Chief Judge John W. Broomes (D. Kan.: Jan. 6, Feb. 18, Apr. 29, and June 29, 2026). Counted from the coded orders’ signature blocks; the database itself has no judge field, so the count covers the 450 orders read, not all 2,008 decisions.
- Aggravating factors: lack of candor or delay 144; burden on the court 144; repeat conduct 103; errors in the show-cause response 48; experienced lawyer who should have known 36; prior warnings in the same case 21; harm to the client 17. Mattox v. Product Innovations Research, LLC (E.D. Okla. Oct. 22, 2025) (“The Court credits his candor.”); Lnu v. Blanche, No. 24-4790 (9th Cir. June 3, 2026) (“lesser sanctions may have been warranted”).
- Citation counts are of orders in the coded set citing the decision under any spelling or citation form, counted once per order (e.g., Wadsworth combines seven variants; HoosierVac fourteen; “U.S. v. Hayes” and “Matthew Garner v. Kadince” are folded in); Mata is the coder’s flag for any citation of that decision. Ferris v. Amazon.com Services, LLC (N.D. Miss. 2025), cited in 15 orders, is omitted from the table because we have not read it; its tooltip quotes a citing court’s parenthetical. Descriptions in quotation marks are the citing courts’ own parentheticals; the rest are from our reading of the decision or, for Gauthier, Hayes, and Bevins, from other courts’ descriptions and the database’s own entry. Which bar the Hayes order was served on is described differently by two courts citing it; we have not read the order. Sanders is quoted as reproduced in Dineen v. Kotchka (Ariz. Ct. App. July 15, 2026). ByoPlanet and Lacey figures are read from the orders, as on the cost page.
- Chart tooltips: each excerpt is a verbatim citation and parenthetical from one order in the coded set, matched to the order text: Elizondo v. City of Laredo (S.D. Tex. 2025); Kaur v. Desso (N.D.N.Y. 2025); Jackson v. Auto-Owners Ins. Co. (M.D. Ga. 2025); Amarsingh v. Frontier Airlines (10th Cir. 2026); In re Baby Boy (Ill. App. Ct. 2025); Thackston v. Driscoll (W.D. Tex. 2025); N.Z. v. Fenix International (C.D. Cal. 2025); Capital Standard v. U.S. Bank (Fla. 2d DCA 2026); Appeals of Huffman Construction (ASBCA 2025); Lewis v. Eagle County (D. Colo. 2025); Brooks v. Patel (Minn. Dist. Ct. 2025); McCormick v. Texakoma Financial (E.D. Tex. 2026); Lifetime Well v. IBSpot.com (E.D. Pa. 2026). Full case names and dates are kept with the project’s data files.
No new rules required here
Rule 11, § 1927, inherent authority, and the professional-conduct rules already reach false citations. AI-specific rules mostly restate the duty to verify.
The rules and authorities that matter
The ABA Model Rules are models; the version adopted in the lawyer’s jurisdiction governs, and the numbering and wording vary.
Which authority applies: five questions
Using AI neither establishes nor excuses a violation; it bears on the remedy. A sanctions order, and the response to a show-cause order, turn on five questions that decide which authority applies and what the court has to find.
| Question | Authority | Why it matters |
|---|---|---|
| Did the other side move, or did the court act on its own? | Fed. R. Civ. P. 11(c)(2); 11(c)(3); 11(c)(5)(B) | On its own initiative the court must first order the lawyer to show cause why “conduct specifically described in the order” has not violated Rule 11(b), and may not impose a monetary sanction unless that order issued before voluntary dismissal or settlement. |
| Is it a paper Rule 11 reaches, or a discovery paper? | Fed. R. Civ. P. 11(d); 26(g); 37 | Rule 11 “does not apply to disclosures and discovery requests, responses, objections, and motions under Rules 26 through 37”; for those the court proceeds under Rule 26(g), Rule 37, § 1927, or its inherent power. |
| A penalty into court, or fees to the other side? | Fed. R. Civ. P. 11(c)(4); 28 U.S.C. § 1927; inherent power (Chambers v. NASCO; Goodyear v. Haeger) | Rule 11 allows a fee award to the other side only “if imposed on motion”; otherwise fees require § 1927 or a bad-faith finding under the inherent power, and are limited to the fees the other side would not have incurred but for the misconduct. A penalty into court punishes and deters; a fee award compensates. |
| The lawyer, or the firm? | Fed. R. Civ. P. 11(c)(1); § 1927 | Under Rule 11 a firm “must be held jointly responsible” for its lawyer’s violation “absent exceptional circumstances”; whether § 1927 reaches a firm varies by circuit. |
| Which circuit’s standard? | Circuit law on § 1927 and on inherent-power sanctions | The mental state § 1927 requires and the bad-faith showing the inherent power requires differ by circuit; the order should state the controlling test before applying it. |
The remediation checklist courts keep reproducing comes from Wadsworth v. Walmart: withdraw promptly, be candid about the AI use, pay the other side’s fees for the tainted filing, adopt training and safeguards.
What the ABA and the state bars said
“[A] lawyer’s reliance on, or submission of, a GAI tool’s output—without an appropriate degree of independent verification or review of its output—could violate the duty to provide competent representation as required by Model Rule 1.1.”ABA Formal Op. 512 (July 29, 2024)
“In doing so, the lawyer must not entirely rely on the Generative AI tool used to draft the document in the first place to verify the accuracy of its research or analysis.”State Bar of New Mexico, Formal Op. 2024-004 (Sept. 24, 2024) — the only opinion in the set that says not to ask the model to check itself
“Current GAI for a general audience is not a reliable substitute for traditional fact- and cite-checking, and lawyers who blindly rely on outputs produced by GAI do so at considerable peril.”D.C. Bar, Ethics Op. 388 (Apr. 2024)
“[W]hether a baseless argument is made with the assistance of AI or not is irrelevant; the lawyer is responsible.”Pennsylvania Bar Ass’n and Philadelphia Bar Ass’n, Joint Formal Op. 2024-200 (2024)
Browse state and court guidance (21 bodies)
| Jurisdiction | Issuing body · opinion | Date | On citations |
|---|---|---|---|
| ABA | Standing Comm. on Ethics & Prof’l Responsibility, Formal Op. 512 | July 29, 2024 | Verify; names “citations to nonexistent opinions” |
| Arizona | Supreme Court Steering Committee on AI and the Courts, Generative AI: Ethical Best Practices for Lawyers and Judges | Nov. 14, 2024 | Verify |
| California | State Bar COPRAC, Practical Guidance for the Use of Generative AI; proposed rule amendments | Nov. 2023; revised May 14, 2026 | “must review all outputs … including … citations to authority”; proposed amendments to the conduct rules circulated Mar. 2026 |
| District of Columbia | D.C. Bar, Ethics Op. 388 | Apr. 2024 | Verify |
| Florida | The Florida Bar, Ethics Op. 24-1 | Jan. 19, 2024 | Verify |
| Florida (courts) | Supreme Court of Florida, amended Rule 2.515(d)(2), No. SC2026-0673 | May 28, 2026; eff. June 15, 2026 | A signature represents that “the legal authorities identified exist and are accurately cited”; sanctions after notice and a hearing |
| Illinois | Supreme Court AI Policy | Eff. Jan. 1, 2025 | Review duty; no disclosure requirement |
| Kentucky | Kentucky Bar Ass’n, Op. KBA E-457 | Mar. 15, 2024 | Verify |
| Michigan | State Bar of Michigan, AI FAQs (lawyers); Judicial Ethics Op. JI-155 (judges) | Nov. 18, 2024; Oct. 27, 2023 | Verify (FAQs) |
| Missouri | Office of Legal Ethics Counsel, Informal Op. 2024-11 | Apr. 25, 2024 | General accuracy duty |
| New Jersey | Supreme Court, Preliminary Guidelines | Jan. 24, 2024 | “check and verify all information generated by AI” |
| New Mexico | State Bar Ethics Advisory Committee, Formal Op. 2024-004 | Sept. 24, 2024 | Verify, and not with the same tool |
| New York (city) | NYC Bar, Formal Op. 2024-5 | Aug. 7, 2024 | Verify |
| New York (state) | NYSBA Task Force on AI, Report and Recommendations | Apr. 6, 2024 | Verify |
| New York (courts) | Rules of the Chief Administrator, Part 161 | Eff. June 1, 2026 | Model local rule: filer must “independently ensure that it contains no fabricated or fictitious cases, statutes, or other material” |
| North Carolina | N.C. State Bar, 2024 Formal Ethics Op. 1 | Nov. 1, 2024 | Review duty |
| Oklahoma (criminal appeals) | Court of Criminal Appeals, Rule 1.17, 2026 OK CR 7 | Feb. 18, 2026 | AI-produced portions must be “verified as accurate by a person responsible for the document”; waiver, striking, or contempt |
| Oregon | Oregon State Bar, Formal Op. 2025-205 | 2025 | “review for accuracy any GAI output … providing a case citation, quotation, or conclusion” |
| Pennsylvania / Philadelphia | PBA and Philadelphia Bar, Joint Formal Op. 2024-200 | 2024 | Verify |
| Texas | Committee on Professional Ethics, Op. 705 | Feb. 2025 | Verify |
| Virginia | Virginia State Bar, LEO 1901 | Approved Nov. 24, 2025 | Not addressed; the opinion is about billing for AI-assisted work (Rule 1.5) |
What the courts did with their rules
- Certification by rule. A Northern District of Texas judge began requiring a generative-AI certificate in May 2023, weeks before Mata was decided. The Oklahoma Court of Criminal Appeals adopted Rule 1.17 in February 2026.
- Deliberately declined. The Fifth Circuit proposed a certification rule in late 2023 and dropped it in June 2024. Illinois’s policy (effective January 1, 2025) says AI use “should not be discouraged” and “Disclosure of AI use should not be required in a pleading,” while making users “accountable for their final work product.” New York’s Part 161 (June 1, 2026) takes the same line and supplies a model verification rule.
- The common ground. Some courts require disclosure or certification; others decline. Both approaches leave a named person responsible for verifying the filing, and Nwaubani and Prososki treat the wrong as filing false law, whichever tool was used.
- Two statewide rules in 2026. New York’s Part 161 (a rule of the court system’s Chief Administrative Judge, not the bar; effective June 1, 2026) permits AI use and requires no disclosure statewide, and supplies an optional model local rule, which a court may adopt, under which the signer certifies a review for “fabricated or fictitious cases, statutes, or other material.” Florida’s Supreme Court amended Rule 2.515(d)(2) on its own motion (May 28, 2026; effective June 15): every signature now represents that “the legal authorities identified exist and are accurately cited,” with sanctions available after notice and a hearing, replacing the circuit-by-circuit administrative orders.
What the bars have done
- Referrals, mostly. 110 of 546 U.S. decisions on lawyers (20%) record a referral or notice to disciplinary authorities. The outcome of most of those referrals is unknown. The documented chains (New Mexico to New York; California’s State Bar Court; Alabama to Texas, Tennessee, and Oklahoma) are on the cost page.
- Technology CLE is rare. The only states we found requiring a general technology credit are Florida (three hours per three-year cycle since 2017) and North Carolina (one hour). New Jersey has adopted a one-credit technology requirement taking effect in 2027, whose proposed definition names artificial intelligence. No state we could find requires an AI-specific hour.
- Training is being ordered after the fact. Forty-one of 450 coded orders (9%) required CLE; where hours were stated, the median was three. The Georgia prosecutor suspended in 2026 and lawyers sanctioned in Texas, Pennsylvania, and New Mexico in 2024 and 2025 all ended up with a court-ordered course.
- The gap in the guidance. Almost every bar opinion warns about “nonexistent” cases. Few say that a real case with a fabricated quotation is the harder failure, but it’s the one that survives an existence check.
Sources for this page
- Chart tooltips quote each rule from its official or LII text as read on Sept. 5, 2026: Fed. R. Civ. P. 11(b)(2), 11(c)(1); 28 U.S.C. § 1927; Model Rules 1.1, 3.3(a)(1), 8.4(c)–(d); Chambers v. NASCO, Inc., 501 U.S. 32, 45–46 (1991) (quoting Alyeska and Roadway Express); 22 NYCRR 130-1.1(c); Fed. R. Bankr. P. 9011(b)(2); Cal. Rules of Court, rule 8.276(a); Cal. Code Civ. Proc. § 128.7(b)(2); Fed. R. App. P. 38, 46(c). Authority counts (of 450 orders; 335 state an authority): Fed. R. Civ. P. 11, 188 · Rule 3.3, 96 · inherent authority, 95 · local rule or standing order, 75 · § 1927, 36 · Rule 1.1, 36 · Rule 8.4, 17 · 22 NYCRR 130-1.1, 15 · Rules 5.1 and 5.3, 13 · Fed. R. Bankr. P. 9011, 10 · Cal. Rules of Court 8.276, 8 · Cal. Code Civ. Proc. § 128.7, 6 · Fed. R. App. P. 46, 5 · Fed. R. App. P. 38, 4. Coded field “authorities relied on for the power to sanction,” normalized by category (analysis/authorities.py); an order citing several subdivisions of Rule 11 counts once; state Rule 11 analogues (e.g., Minn. R. Civ. P. 11.03, NRCP 11) are not counted as Rule 11. Fed. R. Civ. P. 11(b), 11(b)(2), 11(c)(1), law.cornell.edu; 28 U.S.C. § 1927; Chambers v. NASCO, Inc., 501 U.S. 32 (1991); Goodyear Tire & Rubber Co. v. Haeger, 581 U.S. 101 (2017); Model Rules of Prof’l Conduct r. 1.1 & cmt. 8, 3.3(a)(1), 5.1, 5.3, 8.4(c)–(d). The forty-state count for Comment 8 is Robert Ambrogi’s running tally, lawnext.com/tech-competence. In re Nwaubani, No. 25-9517 (4th Cir. Mar. 11, 2026) (applying the rule in the form “conduct that seriously interferes with the administration of justice,” without deciding whether AI was involved).
- ABA Standing Comm. on Ethics & Prof’l Responsibility, Formal Op. 512, Generative Artificial Intelligence Tools (July 29, 2024), americanbar.org. State opinions as listed in the table, each read at the issuing body’s site. Pennsylvania Bar Ass’n Comm. on Legal Ethics & Prof’l Responsibility and Philadelphia Bar Ass’n Prof’l Guidance Comm., Joint Formal Op. 2024-200, Ethical Issues Regarding the Use of Artificial Intelligence (2024), at 4 and 10 (the quoted sentence follows “In essence, the AI tool gives lawyers exactly what they were seeking, and the lawyers, having obtained positive results, fail to perform due diligence on those results.”). California: State Bar of California, 2026 Practical Guidance for the Use of Generative Artificial Intelligence in the Practice of Law (approved May 14, 2026); COPRAC, Proposed Amendments to the Rules of Professional Conduct Related to Artificial Intelligence (approved for comment Mar. 13, 2026; comments closed May 4, 2026); whether the Supreme Court of California has adopted them was not confirmed when this site was published.
- Court rules: Eugene Volokh, Volokh Conspiracy (May 30, 2023) (reproducing Judge Brantley Starr’s certification requirement; whether it remains in force in its 2023 form was not confirmed); In re Addition of a New Rule to the Rules of the Court of Criminal Appeals, 2026 OK CR 7 (Okla. Crim. App. Feb. 18, 2026) (Rule 1.17(A), (C)); King & Spalding client alert (June 2024) (Fifth Circuit’s June 12, 2024 statement); Illinois Supreme Court, Artificial Intelligence Policy (eff. Jan. 1, 2025); In re Amendments to Florida Rule of General Practice and Judicial Administration 2.515, No. SC2026-0673 (Fla. May 28, 2026) (effective June 15, 2026), as reported by The Florida Bar News (May 28, 2026) and the court’s opinion; N.Y. Rules of the Chief Administrator, Part 161, § 161.3 and Appendix A (eff. June 1, 2026), nycourts.gov; Prososki v. Regan, 321 Neb. 38 (2026).
- Five questions: Chambers v. NASCO, Inc., 501 U.S. 32 (1991); Goodyear Tire & Rubber Co. v. Haeger, 581 U.S. 101 (2017); Fed. R. Civ. P. 11(c)(1)–(6), 11(d), 26(g), 37; 28 U.S.C. § 1927, as in force in 2026; Wadsworth v. Walmart Inc., 348 F.R.D. 489 (D. Wyo. 2025).
- Bars: referral count from the database’s Outcome and Professional Sanction fields (110 of 546). CLE: The Florida Bar News, Court approves CLE tech component (Oct. 15, 2016) (In re Amendments, No. SC16-574, eff. Jan. 1, 2017); N.C. State Bar Rule .1518; Supreme Court of New Jersey, Notices to the Bar (Apr. 2, 2025; Dec. 30, 2025) (proposed CLE Regulation 103:1(t), effective on or after Jan. 1, 2027). CLE ordered: 41 of 450 coded orders, hours stated in 31 (median 3). Payne v. State, No. S26A0459 (Ga. May 5, 2026) (twelve hours); Gauthier v. Goodyear Tire & Rubber Co. (E.D. Tex. Nov. 25, 2024) (CLE ordered, as described by later courts and the database entry); Bunce v. Visual Technology Innovations (E.D. Pa. Feb. 27, 2025) ($2,500 and mandatory CLE on AI and legal ethics, per the database entry); Dehghani v. Castro (D.N.M. Apr. 2, 2025) (CLE and self-reporting ordered; affirmed, 782 F. Supp. 3d 1051 (D.N.M. 2025), as described in Dodge v. FirstService Residential Arizona LLC (D. Ariz. Dec. 8, 2025)).
False authority has a history.
A reader asked how often lawyers filed fake cites and misquoted precedent before ChatGPT. Public records establish that the problem existed. The sources we found do not establish a comparable before-and-after rate.
What these examples establish—and what they do not
Courts were sanctioning lawyers for misquoted, misattributed, and misstated authority decades before generative AI.1234 Our search also verified a pre-2022 finding that a lawyer relied on a statute that never existed.5 We found no pre-2022 decision in which a lawyer cited a fabricated case.
The two made-up-case accounts involve prisoners: one court finding about a pro se filing,6 and one historical anecdote from a 1968 article, quoted in a 1972 dissent.7 The anecdote is not a judicial finding. Neither is counted as a lawyer matter.
Absence from this search is not proof of absence. Unpublished orders and disciplinary records could contain additional examples. No state bar disciplinary database, Westlaw, or Lexis was searched.
They document reported decisions about alleged or identified AI-related defects, at the September 2, 2026 snapshot. They do not tell us the total filings checked or missed. Our search did not identify a comparable pre-ChatGPT collection using the same inclusion and verification rules.
Explore the current database’s coverage →Calculate separately for each period.
- Sample both periods.Use a defined sampling frame of court filings before and after November 30, 2022. Keep lawyers and pro se filers separate.
- Check with one method.Verify citations and quotations against sources. Include clean filings. Have two reviewers code judgment calls without seeing the year.
- Report the limits.Report rates per filing and per citation, uncertainty, missing documents, and changes in court or case mix.
The practice lesson is already usable. Verify the case, the quoted words, and the proposition the source actually supports. The historical baseline matters for measuring change; a filing still needs to be accurate today.
Try the litigation labs →The matters, in full
| Year | Matter | What the court found | Consequence |
|---|---|---|---|
| 1984 | Smith v. United Transportation Union Local No. 81594 F. Supp. 96 (S.D. Cal. May 21, 1984)Lawyer | Vacated opinion cited as good law. Counsel cited a vacated panel decision as an en banc opinion, “which reveals that they knew that there had been an en banc decision in that case,” and did not cite the en banc opinion that vacated it. | $1,500 Rule 11 sanction, paid to opposing counsel. Open the source ↗ |
| 1986 | Sobol v. Capital Management Consultants, Inc.102 Nev. 444, 726 P.2d 335 (Oct. 8, 1986)Lawyer | Dissent quoted as the holding. The brief quoted language from a C.C.P.A. case “as though it were the holding of the case, when in fact the language comes from the dissent.” | $5,000 ordered paid by the party to a law-library fund. Open the source ↗ |
| 1988 | Beam v. IPCO Corp.838 F.2d 242 (7th Cir. Jan. 29, 1988)Lawyer | Concurrence quoted; majority’s rejection omitted. “This excerpt from a minority opinion neglects to mention that the majority had rejected the ‘second guideline.’” The court was “troubled … by counsel’s apparent attempt to mislead this court as to the holding.” | None. Fees and costs denied. Open the source ↗ |
| 1989 | Mays v. Chicago Sun-Times865 F.2d 134 (7th Cir. Jan. 4, 1989)Lawyer | Position falsely attributed to the court. “We can think of no better example of a pleading not well grounded in fact or law than a brief that falsely imputes a particular position to this court.” | $1,000 against the attorney under Fed. R. App. P. 46(c), plus costs under Rule 38. Open the source ↗ |
| 1993 | Bruther v. General Electric Co.818 F. Supp. 1238, 1242–43 n.2 (S.D. Ind. Jan. 19, 1993)Lawyer | Case described as deciding the opposite. The court “was shocked to find the following language” in the cited decision and called the party’s explanation of it “imprecise, if not outright deceptive.” | None. A warning. Open the source ↗ |
| 1996 | In re Shepperson164 Vt. 636, 674 A.2d 1273 (Jan. 24, 1996)Lawyer | Law in cited cases misrepresented. Briefs “inaccurately represented the law contained in the cited cases,” with “numerous citation errors.” The court found “no indication that respondent’s conduct was intentional or based on corrupt motives.” | Suspension of not less than six months, until fitness is shown. Open the source ↗ |
| 2003 | Precision Specialty Metals, Inc. v. United States315 F.3d 1346, 1348–49 (Fed. Cir. Jan. 13, 2003)Lawyer (government) | Quotation cut so its meaning changed. The brief, filed May 22, 2000, “omitted directly relevant language from what was represented as precedential authority, which effectively changed the meaning of at least one quotation, and which intentionally or negligently misled the court.” | Formal Rule 11 reprimand; no money. Open the source ↗ |
| 2011 | In re SchivoNo. BK-S-05-28163-BAM, n.13 (Bankr. D. Nev., entered Oct. 13, 2011) (motion filed Oct. 13, 2010)Lawyer (seeking relief from an earlier sanctions order) | Statute that never existed. Counsel, seeking relief from an earlier sanctions order, moved to reopen the case on a purported press release, dated April 1, describing a federal law Congress never passed. The court found the Rule 9011 inquiry unreasonable: a research subscription was not needed to confirm whether the law existed. | Public reprimand, pre-screening of future motions, and referral to the state bar; no money. Open the source ↗ |
| Year | Matter | What the court found | Consequence |
|---|---|---|---|
| 1984 | Amstar Corp. v. Envirotech Corp.730 F.2d 1476, 1486 (Fed. Cir. Mar. 27, 1984)Lawyer | Quotation from the patent prosecution history cropped. Counsel cropped a quotation from the prosecution history so as to “distort the meaning and relevance of the quotation as to render it misleading.” “Distortion of the record, by deletion of critical language in quoting from the record, reflects a lack of the candor required by the Model Rules of Professional Conduct, Rule 3.3 (1983).” | Double costs on appeal. Open the source ↗ |
| 1988 | Sigmond v. Brown837 F.2d 869, 871 (9th Cir. Jan. 21, 1988)Lawyer | Appellate record and exhibits misrepresented. Ten misrepresentations in the appellate brief, found material “in that they were directed to showing that there were disputable facts preventing summary judgment.” “The vice of misrepresentation is not that it is likely to succeed but that it imposes an extra burden on the court.” | Six-month suspension from practice before the Ninth Circuit. Open the source ↗ |
| 1994 | St. Lucie Harvesting and Caretaking Corp. v. Cervantes639 So. 2d 37, 41 n.1 (Fla. 4th DCA Apr. 13, 1994)Lawyer | Trial testimony put in quotation marks that no witness gave. Counsel put the word “directed” in quotation marks followed by eleven record citations. “No witness testified that the defendants’ foreman directed that the goat be taken to the next grove.” “With or without quotation marks this was a mischaracterization of the testimony which was central to the issue on appeal.” | None. Criticism in the opinion; counsel’s explanation published on rehearing. Open the source ↗ |
| 2021 | Pirri v. Cheek851 F. App’x 183 (Fed. Cir. Mar. 22, 2021) (nonprecedential)Lawyer | Lower court’s ruling misdescribed; letter quoted that counsel had never seen. The appellant, through counsel, “distorts the factual and legal bases for the district court’s fee award,” and the representations about a letter were made “despite having never seen it.” | Appellate fees and double costs under Fed. R. App. P. 38, party and counsel jointly and severally. Open the source ↗ |
| Year | Matter | What the source reports | Consequence |
|---|---|---|---|
| 1968 article · 1972 dissent | Cruz v. Beto (Rehnquist, J., dissenting), quoting Larsen, A Prisoner Looks at Writ-Writing405 U.S. 319, 328 n.7 (1972), quoting 56 Calif. L. Rev. 343, 355 (1968)Prisoner writ-writer (anecdote)Anecdote quoted in a dissent, not a court finding | Invented cases and an invented reporter. A 1968 article by a prisoner described a writ-writer who “simply made up his own legal citations” — Aesop v. Fables, Dogood v. The Planet Earth, “901 Penal Review, page 17,240” — with composed “decisions” that “freely circulated among other writ-writers.” An anecdote, not a court finding. | None. Not a case. Open the source ↗ |
| 2009 | Gonzalez-Ayala v. United StatesNo. 3:05-cv-01291-DRD, ECF No. 8, at 1 & n.2 (D.P.R. Dec. 2, 2009)Pro se prisonerCourt finding | Nonexistent Supreme Court case. “Petitioner relies upon a non-existent Supreme Court case.” The citation given, 162 U.S. 480, is an 1896 probate case. | None. Motion denied on the merits. Open the source ↗ |
Sources for this page
- Smith v. United Transp. Union Local No. 81, 594 F. Supp. 96, 100 (S.D. Cal. May 21, 1984). law.justia.com
- Sobol v. Capital Management Consultants, Inc., 102 Nev. 444, 726 P.2d 335 (1986). The $5,000 was ordered paid by the party to the Clark County Law Library Contribution Fund. Justia’s page title spells the caption “Sabol”; the Pacific Reporter citation uses “Sobol.” law.justia.com
- In re Shepperson, 164 Vt. 636, 674 A.2d 1273 (Jan. 24, 1996). The court found “no indication that respondent’s conduct was intentional or based on corrupt motives.” law.justia.com
- Precision Specialty Metals, Inc. v. United States, 315 F.3d 1346, 1348–49 (Fed. Cir. Jan. 13, 2003) (quoting the Court of International Trade; the brief was filed May 22, 2000). law.justia.com
- In re Schivo, No. BK-S-05-28163-BAM, n.13 (Bankr. D. Nev., entered Oct. 13, 2011) (Markell, J.). The motion, filed October 13, 2010, sought relief from an earlier sanctions order; the opinion was entered a year later. The nonexistent authority was a statute described in a hoax press release, not a case counsel invented. Sanctions under Rule 9011: public reprimand, pre-screening of future motions, and referral to the State Bar of Nevada; no money. nvb.uscourts.gov
- Gonzalez-Ayala v. United States, No. 3:05-cv-01291-DRD (D.P.R. Dec. 2, 2009), ECF No. 8, at 1 & n.2 (“Petitioner relies upon a non-existent Supreme Court case”; “The actual case at 162 U.S. 480 is Campbell v. Porter, an 1896 case dealing with probate of a will”). ECF No. 5 in the same case describes the petitioner’s request as pro se. This is the single pre-2022 example a 2026 Princeton benchmark paper cites for the proposition that such fabrications “existed but were rare”; the paper does not say the filer was not a lawyer. courtlistener.com
- Cruz v. Beto, 405 U.S. 319, 328 n.7 (1972) (Rehnquist, J., dissenting), quoting Larsen, A Prisoner Looks at Writ-Writing, 56 Calif. L. Rev. 343, 355 (1968). Verified against the official U.S. Reports. The article’s author was an inmate; the passage describes “one writ-writer” among “a small minority.” tile.loc.gov · lawcat.berkeley.edu
- ABA Survey on Lawyer Discipline Systems (caseload, sanctions, staffing, and budget; no breakdown by rule or misconduct type). americanbar.org
- Gerald F. Hess, Rule 11 Practice in Federal and State Court: An Empirical, Comparative Study, 75 Marq. L. Rev. 313 (1992) (“In federal court during 1990, 708 civil cases were filed, 1,013 were terminated, and 28 had formal Rule 11 activity”; no coding by type of violation). Hess reports the three figures as annual totals; the 28 cases are not shown to be a subset of the 708. The Federal Judicial Center’s Rule 11 studies of 1985, 1988, 1991, and 1995 are described in the literature as counting sanctions activity without coding the defect; we did not independently reopen them. scholarship.law.marquette.edu
- Amanda Bienz, Carl Pearson & Simon Garcia de Gonzalo, The Case of the Mysterious Citations, arXiv:2602.05867v1 (Feb. 5, 2026) (“While none of the 2021 papers contained mysterious citations, every 2025 proceeding did, impacting 2-6% of published papers”). One verification process applied to the same four venues’ 2021 and 2025 proceedings; not a legal rate, and the study did not test what caused the difference. arxiv.org
- Patty Liu, Dominik Stammbach & Peter Henderson, Who Checks the Citations? Benchmarking Legal Hallucination Detection, arXiv:2606.21155v2, §8.4 and Appendix Table 3 (The source corpus is 245 federal appellate briefs filed January 2012–December 2021 (§3.2); Table 3 lists 17 errors found during review of selected model false positives, not a systematic audit of all 245 briefs; the benchmark’s injected errors are not a historical count). arxiv.org
- Method and limits. Three parallel researchers (historical primary records; empirical literature and tracking; commentary and source tracing, starting from Carolyn Elefant’s December 2023 comment letter to the Fifth Circuit) worked on September 7, 2026. An independent verifier then opened the court decisions and principal sources proposed for this page and recorded, item by item, what was verified and what was not; the Federal Judicial Center studies and the Larsen article itself were not independently reopened, and the Larsen passage is verified as quoted in the U.S. Reports. The cutoff is a filing before November 30, 2022, the date of OpenAI’s ChatGPT launch announcement; filing and decision dates are recorded separately in the ledger. Searched: CourtListener and RECAP, Justia, OpenJurist, court websites, the Library of Congress U.S. Reports, law review archives, the Fifth Circuit’s compiled public comments, and the ABA’s discipline surveys. Not searched: any state bar disciplinary database, Westlaw, or Lexis. Excluded by definition: citation typos, plagiarism, omitted adverse authority, and merely unsuccessful arguments. Matters that commentary offered as pre-ChatGPT examples but that failed verification (a reporter typo, an omitted-authority case, a pro se filer, a 2023 decision) are in the downloadable ledger with the verifier’s notes.
Read the file.
Decide what to do next.
Six decisions a litigator makes with an AI draft in front of them. Read the file, choose the next action, then compare your reasoning with a concrete repair. The scenarios and the source text are written for these exercises; the rules are real. The second tab holds nine passages from real filings that courts found defective.
The filing decision lab
Only exercise choices are saved in this browser, on this device. No names, work documents, or scores are sent anywhere. These are practice exercises; no CLE credit or proficiency certification is offered. Printing this section prints the exercise on screen; for all 12 exercises with the answer key, use the download above.
Nine passages from real filings that courts found defective, reproduced verbatim or as the court described them. Every case name looks real; some are. Select every citation you think is wrong, then check. The litigation and contract labs use separate, explicitly fictional materials.
Find the bad citations
Each passage is presented as it was filed, or as the court reproduced it. A citation can fail four ways:
- the case does not exist;
- the case exists but the quotation is not in it;
- the case exists and is quoted correctly but does not stand for the point;
- the citation itself is wrong even though the authority is real.
The tells, and the checks
Eight patterns that gave the filings away in the orders we read, each paired with the check that would have caught it. Tap a card to turn it over.
Sources for this page
- Passages 1–2: Wadsworth v. Walmart Inc., No. 2:23-cv-00118 (D. Wyo.), ECF No. 141 (Plaintiffs’ Motions in Limine, Jan. 22, 2025) and ECF No. 156 (Order to Show Cause, Feb. 6, 2025) (“The problem with these cases is that none exist, except United States v. Caraway, 534 F.3d 1290 (10th Cir. 2008).”); sanctions from 348 F.R.D. 489 (D. Wyo. 2025); the sanctions order is D. Wyo. No. 2:23-cv-118-KHR, entered Feb. 24, 2025. Passage 3: Johnson v. Dunn, No. 2:21-cv-01701 (N.D. Ala.), ECF No. 174 (Motion for Leave to Depose Incarcerated Persons, May 7, 2025) at 2; ECF No. 186; ECF No. 204 (July 23, 2025) at 4–5 (N.D. Ala. No. 2:21-cv-01701), published at 792 F. Supp. 3d 1241. All retrieved from the RECAP archive on CourtListener.
- Passages 4–5: Tercero v. Sacramento Logistics LLC, No. 2:24-cv-00953 (E.D. Cal.), ECF No. 34 (Plaintiff’s Motion for Reconsideration, Mar. 26, 2025) at 8–11, text from the RECAP archive; findings and sanction from ECF No. 50 (Order on Sanctions, Sept. 8, 2025) at 9–13 (two nonexistent cases; “ten citations” attributing invented language as quotations; “twelve cases” cited for propositions they do not support; $1,500 to the Clerk; copies to the client and the State Bar of California). The order itemizes Gersh, Klein, Loudermilch, Atlantic Marine, Ackermann, Beggerly, and Tittjung; for Vaden, Gonzalez, Phelps, and Klapprott the finding is ours, made by searching each opinion on CourtListener for the quoted words on Sept. 2, 2026 (Vaden; Gonzalez; Phelps; Klapprott).
- Passages 6–8: Mundy v. Clickstop, Inc. (Neb. Dist. Ct. Oct. 17, 2025), 2025 WL 3073933, at *2–*4 (“Below are the most problematic portions of Plaintiffs’ briefing,” each sentence introduced by the court with the lawyer’s name and “writes,” followed by the court’s finding), *9–*10 (the sanction) and nn.1–4. The sentences are reproduced as the court printed them; the lawyer’s name is omitted under this site’s rule.
- Passage 9: Parker v. Labat, No. 1:25-cv-03809 (N.D. Ga. Jan. 21, 2026) (Final Report and Recommendation) at 28–30 (the six items, quoted from the show-cause order of Jan. 5, 2026, Doc. 28 at 4–6), 31–35 (no response to the show-cause order; recommended sanctions: a six-hour CLE course, a $1,500 fine, or a three-year certification requirement, one or more).
- The tells: Prososki v. Regan, 321 Neb. 38 (2026) (the chart); Whiting v. City of Athens, 170 F.4th 455 (6th Cir. 2026) (Nos. 25-5424 and 25-5425, decided Mar. 13, 2026) (Tenn. Code Ann. § 29-12-119); Axis Dynamics, Inc. v. Knox County (E.D. Tenn. 2025) (Ala. Code § 7-5-116(4)); In re Wise (Bankr. W.D. La. 2026) (La. R.S. 9:5774); Mundy, above (the Restatement passage; the Westlaw number); Wadsworth, ECF No. 169, ¶ 12.
Read the clause.
Check what the AI returned.
Six exercises for transactional lawyers. Read the clause or the drafting instruction, read what the AI returned, and choose the repair. Every agreement, clause, version, and instruction here is fictional; the rules and the failure patterns are real.
Why an AI draft goes wrong in a contract
A language model predicts the next words; it does not look anything up. Why AI hallucinates explains the mechanism and cites the research. In deal work it shows up in four ways, and the six exercises below are built on them.
- Quotations. An exact clause is an arbitrary string. Asked to quote it, a model can produce a fluent sentence that means something slightly different, with the quotation marks intact.
- Names and numbers. A defined term, a section number, a dollar figure, and a notice period are low-frequency facts, the kind OpenAI’s own explanation says models cannot predict from patterns. They can come back changed, and a “cleanup” pass can change them while it fixes the commas.
- Rights. Asked what an agreement allows, a model can answer with what agreements usually allow. A termination right that is standard elsewhere can appear in a memo about a contract that has none.
- Versions and parts. A model summarizes the file it was given, not the file that was signed, and assembles the pieces it has, not the pieces the agreement incorporates. Wrong-version and missing-schedule errors are ordinary outputs, not glitches.
What the record says about deal work
Every order in this study is a court filing. The database collects decisions, so it is a record of litigation. It holds no drafting review, no executed agreement, and no measure of how often AI-assisted contract work goes out wrong. There is no rate here for transactional practice, and nothing on this page should be read as one.
The database is a record of courtrooms because a courtroom is where a false citation gets caught: opposing counsel found the problem in 42% of the 450 orders on lawyers, the court itself in 52%. Counterparty counsel and internal reviewers can catch a contract error before signing, but this database does not record that review or measure the errors that survive it. Four things in the record bear on deal work.
What to check, translated from the orders
- Every authority, the same three steps. Does the statute, rule, or case exist; does it say what the draft says; does it support the point. Of the 450 orders, 128 recorded defects but no invented case (five more recorded no typed defect); 101 of the 128 carry a real-case defect: misquoted, cited for something it does not hold, matched to the wrong reporter citation, or pinned to the wrong page.
- Every cross-reference and defined term. A cross-reference is a citation to the document itself. After any AI pass, confirm that each “Section 9.4” exists and says what the sentence assumes, that each capitalized term is defined, and that no defined term was silently renamed. Do it on the final text, not the draft the model was given.
- Every summary against the text. A number, a deadline, a notice period, or a carve-out in an AI summary is a quotation without quotation marks. Check each one against the clause it stands for before it reaches a client or a signing memo.
- Precedent clauses and “market” claims. A model asked for a customary clause will produce a plausible one, and asked whether a term is market will answer. Pull the clause from a real precedent you can open, and treat a “market” claim as an assertion with no source until you find one.
- Keep the drafts. The mutation cases were caught because someone could compare the version that went into the model with the version that came out. Keep both, and diff them.
- Supervision is the same duty. The signing partner’s obligation to check the associate’s brief (Rules 5.1 and 5.3, and the show-cause orders that enforce them) applies to the associate’s markup. Delegating to a tool is delegating.
Three things to do today
The checklist and the workbench are on the Verification workbench page. Applicable court rules, client instructions, and jurisdiction-specific ethics rules control. Practice exercises; no CLE credit or proficiency certification is offered.
Sources for this page
- Figures in “What the record says about deal work”: fabricated or misquoted statute or rule, 31 of 450 coded orders; “Legal Norm” subcategory, 232 of 2,008 database rows; legal field “contract,” 449 of 2,008 rows and 188 of 809 rows on lawyers (the database’s Legal Field Primary column); detection shares from the coded set (235 and 188 of 450); AI used to edit or format citations (8) or to check the lawyer’s own work (12), 20 of 450; orders with no invented case, 128 of 450 (101 with a real-case defect). TOV Realty, LLC v. Suarez (Conn. July 31, 2026); Concord Music Grp., Inc. v. Anthropic PBC (N.D. Cal. May 23, 2025); ABA Formal Opinion 512 (July 29, 2024).
- The exercises are fictional; the rules and ethics sources they cite are listed with each exercise and in the downloadable exercise pack.
Give every claim a source.
Give every check an owner.
Use this workspace to compare text and record your review. The checklists are practice aids; completion records the checks you marked, not a determination that a filing or contract is ready.
These tools run in your browser. Text stays in the current page and is not transmitted or saved by this site. Refreshing clears the workbench. Downloads are created only when you request them.
Does the quoted text actually match?
Paste the relevant source excerpt and the claimed quotation. This checks text identity, and nothing else. You still need to check that the source is the one cited, the surrounding context, the legal proposition, the cited page or paragraph, the subsequent treatment, and the document version.
Case, punctuation, numbers, and words still matter. This tool does not treat ellipses, brackets, or changed curly quotation marks as automatic matches. It reads plain text only: it never sees italics or bold, so it cannot tell you whether emphasis was added, and it cannot tell you whether the source is the right case or the pincite is right. Maximum 20,000 characters per field.
A review checklist you can take with you.
Select a workflow and check each item only after doing it. Download the current record, or use the blank version as a team handoff.
Leave evidence of the check.
A useful handoff lets the next lawyer retrace the work. Keep a short row for each authority, factual claim, or material contract provision in your own approved matter system.
| Claim or provision | Source and location | Review and status |
|---|---|---|
| What the draft asserts; exact quotation where used | Independently retrieved document, controlling version, page or section | Reviewer, date, result, unresolved issue, and escalation owner |
Educational workflow recommendations informed by Federal Rule of Civil Procedure 11 and ABA Formal Opinion 512. Applicable jurisdictional rules and matter-specific duties control. Read the rules in context →
Use the tools. Verify the filing.
The recurring failure is filing work nobody checked. Start with three checks. The work decides how much review each one needs. The rest of this page is what those steps mean for each role, and where the citation checkers fit.
The check, in three steps
- Confirm the authority exists. Find it on CourtListener, Google Scholar, the court’s own website, or a subscription service, under the citation given.
- Compare the quotations and pincites. Every quoted phrase must appear on the page cited; every pincite must land on the words it stands for.
- Read for the proposition and the treatment. The source must support the point in context, and you must know how it has been treated since. No checker replaces this step.
By role
Open yours.
Junior lawyers
You will be handed AI-assisted work, and you will produce it. Treat every citation as unverified until you have opened the source and read the cited pages.
- Open the case. Find the quoted words on the page cited. Read far enough to know the proposition survives the next paragraph.
- Keep the transcript when you use a tool; courts have asked for it.
- If a draft comes down with citations you cannot find, say so before it is filed. Lacey and Johnson v. Dunn both had people who could have.
- Never ask the model that drafted the brief to check the brief. New Mexico’s ethics committee says why: it “can be misled by [its] own prior hallucination.”
Signing lawyers
Signing lawyers remain responsible even when they did not draft the filing or know AI was used. The signing lawyers in Wadsworth v. Walmart and Johnson v. Dunn did not know AI had been used; they were sanctioned for not checking.
- Build one step into every filing: the signer, or someone the signer names, opens every citation.
- Treat a research platform’s AI output like a summer associate’s memo: useful, fast, and yours once you sign.
- If you learn of an error after filing, correct it before the court finds it. Lack of candor or delay in admitting was the aggravating factor courts noted most often, tied with the burden on the court (144 of 450 orders each, 32%).
Senior attorneys: partners, general counsel, chief public defenders, United States Attorneys
Rules 5.1 and 5.3 are the operative provisions, and Formal Opinion 512 says what “reasonable efforts” look like: clear policies, training that covers “the capabilities and limitations of the tools,” and supervision that actually checks.
- A verification checklist attached to every filing, signed by a named person.
- A rule that any document that touched a generative model — research, drafting, editing, formatting — gets a cite-check by someone who did not draft it.
- A gate before any draft goes into a third-party tool, including a citation checker: the vendor’s retention and training terms, the client’s confidentiality (Rule 1.6), and privilege. Formal Opinion 512 treats this as part of the same duty.
- A no-blame channel for reporting a hallucination before the court finds it. The Wadsworth remediation steps — withdraw promptly, be candid about the AI use, pay the other side’s fees for the tainted motion, adopt training and safeguards — are the template courts keep citing.
Paralegals and litigation-support professionals
Court orders also identify interns, clerks, and paralegals: the Colorado lawyer suspended in 2023 blamed an intern; a Utah petition was drafted by an unlicensed clerk using ChatGPT. The lawyer remains responsible, but an order may still describe who prepared the work.
- Use only tools your office has approved.
- Label anything AI-assisted as AI-assisted when you hand it over.
- Never let a citation you have not opened leave your desk marked as checked.
In-house counsel
Two jobs. Your own submissions — regulatory responses, demand letters, board memos — carry the same duties and the company’s name. And you are the client in outside counsel’s filings.
- Ask your firms what their verification policy is, and whether it covers editing and formatting passes, not only research.
- Forty-two of the 450 orders (9%) required the lawyer to send the client a copy. In Coomer v. Lindell, the court asked whether the client had been told its lawyers were using AI. Expect to be asked.
Government lawyers
Prosecutors, agency counsel, and public defenders are in the database, and the consequences have been among the heaviest: a Georgia assistant district attorney suspended from practice before the state supreme court for six months, with a murder-appeal order vacated; two New Orleans city attorneys who resigned after fines of $250 and $1,000; the Alabama Department of Corrections’ outside counsel disqualified.
- Free verification sources matter where commercial access is limited; the free checkers below exist for that reason.
- The Princeton benchmark’s finding that verification “disadvantages both AI systems and litigants who lack subscriptions to commercial legal databases” is a budget argument, not a technology one.
Pro se litigants
You are the majority of this database. Nothing about being unrepresented changes the rule that a court must not be given law that does not exist.
- If a chatbot gives you a case, find it on a free source — CourtListener, a court’s own website, Google Scholar — and read it before you cite it. Do not cite anything you have not opened.
- If you cannot find a reliable source for it, do not cite it. Ask a court self-help center, a legal aid office, or a law library for help finding authority you can open and read.
Citation checkers have proliferated
- Most check existence; few check the quotation or the proposition. Seventeen products are listed below, alphabetically, with what each says it checks. Step 1 is well covered; steps 2 and 3 — the failures that have drawn level with the invented case in lawyer filings — are not.
- Nothing here was tested. Entries reflect vendor descriptions and the identified reporting as reviewed through September 6, 2026; each source note gives the relevant review date. Vendor accuracy claims are not repeated. Before uploading a filing to any of them, read the retention and training terms and consider client confidentiality and privilege.
- Foundation models are not a complete answer either. In the one independent benchmark (Princeton, June 2026), the best-recall system caught about 84% of planted citation errors but raised many false alarms (F1 55%); the best-balanced system caught 63% (F1 69%); every model did worst on wrong pincites. A checker is a screen for step 1, not a substitute for steps 2 and 3.
Feature and pricing descriptions are the inherited vendor-source snapshot through September 6, 2026. These products were not independently tested for this study. A filtered match can include partial, conditional, or vendor-claimed support; read the cell and the source before choosing.
| Tool · maker | Access | Price | Case exists? | Quote matches? | Supports the point? | Pincite? | Citator? |
|---|---|---|---|---|---|---|---|
| Beyond Assure · Benchly | Word | With an ezBriefs subscription (as reported) | Yes | — | Context mismatch | — | — |
| Brief Analysis · LexisNexis | Upload | Subscription | Yes | Quote Check | — | — | Shepard’s |
| Brief Analyzer · Bloomberg Law | Upload | Subscription | Yes | — | — | — | BCite |
| CaseStrainer · open source (hosted on a University of Washington law-school server) | Web, self-host | Free | Yes | — | — | — | — |
| Citation Lookup & Verification · Free Law Project (CourtListener) | Web form and API | Free | Yes | — | — | — | — |
| Cite Check Report · Clearbrief | Word add-in | Solo $300 per user per month | Yes | Yes | Semantic score | — | — |
| CiteCheck AI · LawDroid | Upload Word/PDF | Free for five reports, then from $25 a month (as reported at launch) | Cases only | — | — | — | — |
| CiteSentinel · BrentWorks | Upload | From $19.99 per document (as reported) | Yes | — | In development (per press) | — | — |
| Descrybe Review · Descrybe, LLC | Web; paste or upload one PDF or Word file; 15 citations on trial, 50 paid per run | $50 a month; first month 50% off | Yes | Yes | Yes | When available | Cytator |
| Hallucination Shield · CaseRead.ai | Paste or upload; 25 citations per run | Free | Yes | — | Claimed | — | — |
| Is This Case Real? · Law Professors Who Do Tech Things LLC | Web; twenty citations at a time | Free | Yes | No (stated) | No (stated) | — | — |
| Litigation Document Analyzer · Thomson Reuters (Westlaw Advantage) | Upload | Subscription | Yes | Yes | Partly — “potential misrepresentations of law” | — | KeyCite |
| PelAIkan · marketed by Damien Charlotin | Web, desktop, Word | Free for three documents a month; paid tiers not published | Yes | Yes | “Congruence” check | — | — |
| Quick Check · Thomson Reuters (Westlaw) | Upload | Subscription | Yes | Quotation analysis | — | — | KeyCite |
| RealityCheck · BriefCatch | Word add-in | $60–$75 per seat per month, annual | Yes | Yes | Yes | Yes | — |
| Sentinel Citation · Fusion Collective | Web; federal filings only | $99 per filing; first filing free | Yes | Yes | Yes | — | — |
| Shepard’s Verify · LexisNexis (Lexis+ with Protégé) | In platform | Subscription | Yes | — | Not per reporting | — | Shepard’s |
No products match these filters. Try another search or capability.
“Yes” is the vendor’s description; “as reported” means independent press coverage. Where reporting and the product page differ (Shepard’s Verify: “cited authority exists and is retrievable” in reporting, versus “flagging unsupported statements” on the product page), the table follows the reporting. No tool in the table can take on the filer’s responsibility to verify.
Sources for this page
- State Bar of N.M. Ethics Advisory Comm., Formal Op. 2024-004 (Sept. 24, 2024); ABA Formal Op. 512 (July 29, 2024); Wadsworth v. Walmart Inc., 348 F.R.D. 489 (D. Wyo. 2025) (listing the remedial steps the court credited); Coomer v. Lindell, No. 1:22-cv-01129 (D. Colo.), Order to Show Cause (Apr. 23, 2025); Lacey v. State Farm Gen. Ins. Co., No. 2:24-cv-05205 (C.D. Cal. May 6, 2025); Johnson v. Dunn, 792 F. Supp. 3d 1241 (N.D. Ala. 2025). Client-notification count: 42 of 450 coded orders.
- People v. Crabill, No. 23PDJ067 (Colo. O.P.D.J. Nov. 22, 2023) (stipulation to discipline); Garner v. Kadince, Inc., 2025 UT App 80, ¶ 5; Payne v. State, No. S26A0459 (Ga. May 5, 2026); ABA Journal, 2 New Orleans government attorneys resign over use of fake AI citations (Apr. 2, 2026) (single press source); Liu, Stammbach & Henderson, arXiv:2606.21155 (2026) (abstract: “GPT-5 achieves 84.4% recall and a 55.0% F1 score in an agentic framework”; Table 2: Claude Code (Opus 4.8) precision 76.1, recall 62.8, F1 68.8; 1,300 brief excerpts with injected errors). This site was built with Claude models; the comparison is reported as the paper reports it.
- Tools: Bob Ambrogi, LawSites (June 27, 2025) (CiteCheck AI) and (May 7, 2026) (Lexis+ with Protégé); BriefCatch, RealityCheck, briefcatch.com/realitycheck (press release Mar. 10, 2026; pricing as read Sept. 2, 2026); Descrybe, Descrybe Review user guide and pricing (read Sept. 6, 2026); Thomson Reuters, Westlaw Advantage help page for Litigation Document Analyzer; Free Law Project, Citation Lookup and Verification API documentation, and Michael Lissner, Combat Hallucinations and Look Up Citations with our New API (Apr. 16, 2024); Nicole Black, ABA Journal (June 22, 2026); Ross Prolic & Rachel Wertheim, CALL Bulletin (Nov. 12, 2025); vendor pages for Clearbrief, Benchly, BrentWorks, Fusion Collective (product page, and Business Wire, June 24, 2026), CaseRead.ai, CaseStrainer (GitHub and the hosted instance), Is This Case Real? (isthiscasereal.com; “We use data and tools from … Free Law Project”), LexisNexis Brief Analysis, Bloomberg Law, and PelAIkan (pelaikan.com), each as read Sept. 2, 2026. The PelAIkan page does not name its maker; the attribution is Charlotin’s own, from his database FAQ (“I am marketing one such tool, PelAIkan”).
The database, the method, the credits
The site combines the 2,008-row database, as it stood on September 2, 2026, with a coded reading of 450 U.S. court orders on lawyers. Here is what that method includes, and leaves out.
The database
- What it is. Damien Charlotin’s AI Hallucination Cases is a public list of court and tribunal decisions “where the use of AI, whether established or merely alleged, is addressed in more than a passing reference by the court or tribunal,” limited to cases where the court “explicitly found (or implied)” that a party relied on hallucinated content. Its earliest entry is a Brazilian electoral-court decision of April 2023; the first American entries follow that June. It now covers 40 countries.
- Who decides. Charlotin does not decide whether a filing was hallucinated; the courts do. In his words: “I am not making that judgment, I let the courts and judges make or imply it, which is why the database is necessarily an undercount.” The briefs quietly withdrawn, the fabrications nobody checked, the footnote mentions: none of those are here.
- What each row holds. Case name, court, state, date, the party responsible (pro se, lawyer, judge, expert), the product where named, an itemized list of what was false (fabricated, misrepresented, false quotes, outdated), the outcome, the monetary penalty, whether a professional sanction followed, and a link to the decision where one is available.
- Flags. Nineteen rows (1% of 2,008) are marked as alleged rather than established; twelve (0.6%) carry a vendor-dispute flag; no row carries both. All 31 are counted in the totals, as the database counts them.
- Disclosure. Charlotin also markets a citation-checking tool, PelAIkan. It appears in the checker roundup on the same terms as everything else. He has not reviewed this site and is not responsible for anything in it.
Method
- The reading. Each of the 477 orders was read under a written codebook asking the same fixed questions (who used the AI, how, what explanation was offered, who caught it, what the court did, what authorities it relied on, what other decisions it cited, and what its register was), by one model reader, one pass per order, with the key answers required to quote the passage that supported them. No order was coded twice; register, motive, and explanation fields are one reader’s judgment.
- The checking. 1,565 of the 1,586 quotations the reader produced matched the order text after both were reduced to letters only; the 21 that did not are not used anywhere. Every case name, citation, date, dollar figure, and quotation in the prose was then checked again against the order itself, the docket on CourtListener’s RECAP archive, a court’s own website, or the issuing body’s publication, and the built site was audited and proofread by a second model. Where only press coverage could be found, the text says so. Where nothing could be found, the claim was dropped.
Detailed method
- The counts. Every figure on the milestone, who and where, and cost pages that is not attributed to the coded set is computed from the database as of September 2, 2026: 2,008 rows, last decision date August 31, 2026 (the export of September 1, with the two rows added and eight rows edited by the next day, each verified against the live download). For the study charts and coded analysis, where the database and a court’s order disagree, the order governs and the disagreement is stated. Countries, courts, parties, outcomes, and monetary penalties are the database’s own fields; the mapping of free-text court names to states and court types is ours, checked against the linked orders (the database’s “SC” codes mean Superior Court in some states and Supreme Court in others; the reading of every label family and 17 per-row corrections are recorded with the project).
- The pipeline. Of the 2,008 rows, 1,378 are American. For every American row tagged as involving a lawyer, prosecutor, government lawyer, federal defender, paralegal, judge, expert, or arbitrator (560), the database’s own document (483) was downloaded on September 1 (481; the two rows added afterward, a party’s motion in a Tennessee case and an Ohio order from March 2025, are not in the coded set) and converted to text (479). One turned out to be a different case and one was unreadable; both were set aside, leaving 477, of which 450 are orders on lawyers. Measured against the database’s 546 U.S. rows on lawyers, the coded set covers 449; the 97 not covered are 73 rows with no retrievable court document (59 link to press or a blog, 14 to nothing), the 2 added after the coding, 12 in which the order or the docket showed the filer was pro se (nine from the orders; three more found on the dockets in the firm-size research below and recoded on September 2, 2026), 8 in which the user could not be determined, and the two set aside. Across the whole database, the original pipeline classified 1,800 rows as relative links to its document host; 1,798 were downloaded and all but two converted to text.
- The reading, in detail. The reading was done by Claude (Sonnet) in batches under the written codebook, one pass per order. No inter-coder agreement was measured. Quotations were checked by normalizing both the quotation and the source to letters only, after removing line numbers, running page headers, and hyphenation breaks, and requiring an exact match; that test establishes that the words appear in the order, not who said them or what they meant, and the quotations used in the prose were read in context.
- The review passes. Five separate adversarial passes by Claude models (not human reviewers), working from the assumption that anything might be invented, followed by a sixth pass over what they changed; then an independent audit of the built site by a different model (OpenAI Codex 5.6 Sol), whose findings produced the corrections in the third revision, and a reader’s-eye proofread by the same model, applied in the seventh.
- The firm-size research. Conducted by OpenAI Codex 5.6 Sol over the coded orders: dockets and filings on CourtListener’s RECAP archive and state portals, firm and government pages, bar directories, and archived rosters, under a rule that a lawyer counts only where the record ties that person to the defective filing. It identified a responsible lawyer in 391 of the 450 decisions: 420 people once 14 pairs of name variants were matched to one person by bar registration number, firm, and case, of whom 395 in private practice were placed in one firm-size band; 59 decisions remain without a named lawyer for documented access or attribution reasons. The same docket work showed that three orders coded as lawyer cases had in fact been filed by pro se litigants; they were recoded on September 2, 2026 and the study’s charts and coded-analysis figures recomputed (the coded set went from 453 to 450). The workbook and source files are kept with the project and not published.
- The years-since-admission research. Conducted by OpenAI Codex 5.6 Sol on September 3, 2026 for the same 420 lawyers: the earliest verified admission the research found, from official bar records first, then official court or government sources, official firm or employer biographies, and structured directories, with a court decision or other public report where it stated the date. The research checked more than one license for 149 of the 394 lawyers resolved; it is not an exhaustive search of every jurisdiction, so an earlier admission the research did not find would make that lawyer’s figure larger, not smaller. A year was never inferred from a law-school graduation year, a bar number, an age, a first appearance, or a firm’s founding date; 26 lawyers were left unresolved rather than estimated. Experience is years between that admission and the date of the first of the 450 orders against the lawyer, in completed years where the date is known (110) and as the difference between the two years where only the admission year is (284). Claude checked the arithmetic and the distribution against the table and two of the sources; the rest of the 394 sources were not independently re-verified. Aggregates only are published; the table names lawyers.
- Charts. Drawn as inline SVG, without a charting library, from data injected into the page at build time. The categorical palette was validated for the three common forms of color-vision deficiency and for contrast on both the dark and light surfaces. Every chart has a caption, a source note, or a hidden data table that says the same thing in numbers.
- Tools. pandas for the counts; pdftotext for text extraction; Claude Fable 5.1 for research, drafting, and the build, with Claude Sonnet for the batch reading and Claude Opus for source research; OpenAI Codex 5.6 Sol for the audits; CourtListener’s RECAP archive and citation-lookup API for filings and citation checks.
Scope and limitations
- An undercount, and a lag. The database is one person’s reading of the world’s courts, in the languages he reads, from the sources that reach him; in his own words, an undercount. Counts by decision date understate the most recent weeks, which are still being added. The projections on the milestone page are arithmetic on trailing rates, not forecasts of behavior.
- One reader, 450 orders. The coded set covers 449 of 546 U.S. rows on lawyers (82%). The register of an order is a reader’s judgment: the coding was done by a model and checked by quotation, not by a second human reader, and the categories are the ones the codebook offered.
- Left out on purpose. Names of the lawyers sanctioned, except where a case caption is itself a lawyer’s name and the matter is bar discipline of public record (captions are cited as they appear on the public docket, and a caption that names a firm or a party is not redacted); names of small firms and solo practices; any claim about a lawyer’s intent beyond what a court found; any figure from a vendor about its own product’s accuracy; any citation this site could not open.
- Firm size and experience are distributions, not rates. The firm-size and years-since-admission figures on The circumstances describe the lawyers identified in the collected cases. The database has no denominator for briefs filed, lawyers practicing, or AI-assisted work produced, so those figures cannot say which lawyers are more likely to file false authority. The database also tags three rows as lawyer cases that the dockets show were pro se filings; the study charts and coded analysis count them as pro se.
- Searches, not proofs. Negative findings (“no disbarment,” “no AI-specific CLE requirement”) cover public news, bar, and court sources through September 2, 2026, and absence from those sources is not proof of absence. Two claims in circulation were searched for and not found: that a lawyer has been disbarred for this, and that fee awards in early 2026 reached a particular six-figure sum. Two reported suspensions we could not verify (Minnesota; the Middle District of Pennsylvania) are mentioned on the cost page with their source and nothing more.
The expanded edition
The original study was published on September 5, 2026, built by Kyle Bahr with Claude Fable 5.1 and OpenAI Codex 5.6 Sol. While it was being finalized, OpenAI released GPT-6 Astra. Kyle gave the new model the finished site and one instruction:
“[M]ake the HTML massively better and more valuable for the audience in all respects: design, content, filling data gaps (one LinkedIn commenter wondered what the gender breakdown was of the US lawyers, for example), tasteful interactive elements, training modules, etc. make the site awesome, and a valuable contribution to solving the issue of attorneys filing briefs with fabrications.”
Codex GPT-6 Astra Extra High rebuilt the site, then collaborated with Claude Cowork Fable 5.1 Extra High from September 7 to 9, 2026: each reviewed the other’s work, disagreements were argued out in a shared written log, and every new claim was checked against its source before it stayed. Kyle set the editorial rules and made the final calls. The data did not change: the 2,008-decision snapshot of September 2, 2026 and the 450-order coding are the original’s.
What this edition adds, twelve fictional training exercises among it:
- What about gender? The pronouns that court documents and professional biographies use for the 420 entries in the study’s identified-lawyer roster, with the limits stated. Inspired by a LinkedIn comment from Carolyn Elefant.
- Before ChatGPT. What the public record can and cannot say about false authority and factual-record errors before generative AI: fourteen selected historical examples (including a quoted anecdote), six sources compared, and a proposal to estimate a before-and-after rate. Inspired by a LinkedIn comment from Doug Hall.
- Litigation labs. Six exercises on fictional AI output, each a decision a litigator has to make, with the exact repair. The original real-briefs training text is kept.
- Contract review. Six exercises and a checklist for transactional lawyers, and why a model’s draft goes wrong in deal work. Inspired by a LinkedIn comment from Rafie Faruq.
- Verification workbench. Compare a quotation with its source word by word, work the filing checklist, keep a handoff record, and download the templates and the team exercise pack.
- The reading experience. A section rail, search (Ctrl or Cmd-K), source notes on every page, and layouts for phones, in dark and light themes.
The original edition remains at kylebahr.netlify.app/2000/original/. The switch in the top bar moves between the two editions at the same section wherever one exists.
Document counts use two definitions. The original download pipeline counted 1,800 relative document paths and 153 other links, where normalizing the URLs by host gives 1,833 links to the database’s own document host, 120 other external links, and 55 unlinked rows; the difference is 33 full URLs to the same host that the original pipeline grouped as external. The historical downloaded/read totals have not changed.
Method: source-used pronouns
The database does not measure gender identity. The supplemental review screens the 420 distinct lawyer entries in the study’s existing identified-person roster, spanning 391 of the 450 coded U.S. lawyer orders. Repeat appearances and 14 confirmed alias groups count once. The 59 orders without an identified responsible lawyer are outside this person-level denominator; they are not 59 additional people. This new review does not independently re-establish responsibility for every filing; inherited role attributions can be uncertain.
Sources use he/him-family wording for 269 roster entries, she/her-family wording for 104, and no acceptable wording was found for 47. Percentages use all 420. Selected evidence for 253 entries comes from captured case documents, for 110 from primary professional biographies, and for 10 from other primary documents. Names, photographs, titles, and automated gender guesses were not used for classification.
All 420 entries were screened against the captured order corpus. Accepted passages were reviewed for their referent. Screening does not mean every page was read line by line or every public source was searched. Eight supplemental passages are explicitly recorded as index-only, and 93 of the 120 supplemental records do not distinguish direct retrieval from indexed text. In total, 99 selected sources were undated. The local-source quotations and hashes were mechanically checked. The new research was performed by AI assistants; the private evidence ledger and the independent review of initially role-linked passages remain available for Kyle’s review.
Source language may be outdated or incorrect and is not necessarily self-selected. No accepted category establishes a person’s gender identity; the absence of another category does not establish that an identity is absent. The selected record cannot establish gender-specific incidence, relative risk, or causation. The pronoun review publishes anonymous aggregates only.
Method: practice exercises and tools
The litigation lab contains six independent fictional scenarios and the contract lab six. The contract answers follow the supplied clauses, versions, and instructions, not a claim about enforceability or market practice. The litigation exercises state their assumptions and link the relevant rule or ethics source. The existing nine real-brief exercises remain available as a separate track.
The workbench compares text supplied by the reader; it does not retrieve or authenticate a source, determine legal support, or certify a document. Checklists and protocols are suggested working aids. Only learning choices and the theme may be stored on the device; workbench text and checklist states stay in page memory. The HTML contains no analytics or network submission code.
Credits
Typefaces and font licenses
Newsreader, Source Serif 4, and IBM Plex Mono are embedded for offline reading. Copyright notices and the SIL Open Font License are included below.
Embedded typefaces in Two Thousand Decisions v27 Newsreader Copyright 2020 The Newsreader Project Authors http://github.com/productiontype/Newsreader Source Serif 4 Copyright 2014 - 2021 Adobe Systems Incorporated http://www.adobe.com/ Reserved Font Name: Source Project: https://github.com/adobe-fonts/source-serif IBM Plex Mono Copyright 2017 IBM Corp. All rights reserved. Reserved Font Name: Plex All three typefaces are distributed under the SIL Open Font License 1.1. The embedded WOFF containers preserve the original font tables and metadata. No glyphs, font names, or original table contents were changed. License sources: https://raw.githubusercontent.com/google/fonts/main/ofl/newsreader/OFL.txt https://raw.githubusercontent.com/google/fonts/main/ofl/sourceserif4/OFL.txt https://raw.githubusercontent.com/google/fonts/main/ofl/ibmplexmono/OFL.txt https://openfontlicense.org/ofl-faq/#22-can-i-make-and-use-woff-web-open-font-format-versions-of-ofl-fonts ----------------------------------------------------------- SIL OPEN FONT LICENSE Version 1.1 - 26 February 2007 ----------------------------------------------------------- PREAMBLE The goals of the Open Font License (OFL) are to stimulate worldwide development of collaborative font projects, to support the font creation efforts of academic and linguistic communities, and to provide a free and open framework in which fonts may be shared and improved in partnership with others. The OFL allows the licensed fonts to be used, studied, modified and redistributed freely as long as they are not sold by themselves. The fonts, including any derivative works, can be bundled, embedded, redistributed and/or sold with any software provided that any reserved names are not used by derivative works. The fonts and derivatives, however, cannot be released under any other type of license. The requirement for fonts to remain under this license does not apply to any document created using the fonts or their derivatives. DEFINITIONS "Font Software" refers to the set of files released by the Copyright Holder(s) under this license and clearly marked as such. This may include source files, build scripts and documentation. "Reserved Font Name" refers to any names specified as such after the copyright statement(s). "Original Version" refers to the collection of Font Software components as distributed by the Copyright Holder(s). "Modified Version" refers to any derivative made by adding to, deleting, or substituting -- in part or in whole -- any of the components of the Original Version, by changing formats or by porting the Font Software to a new environment. "Author" refers to any designer, engineer, programmer, technical writer or other person who contributed to the Font Software. PERMISSION & CONDITIONS Permission is hereby granted, free of charge, to any person obtaining a copy of the Font Software, to use, study, copy, merge, embed, modify, redistribute, and sell modified and unmodified copies of the Font Software, subject to the following conditions: 1) Neither the Font Software nor any of its individual components, in Original or Modified Versions, may be sold by itself. 2) Original or Modified Versions of the Font Software may be bundled, redistributed and/or sold with any software, provided that each copy contains the above copyright notice and this license. These can be included either as stand-alone text files, human-readable headers or in the appropriate machine-readable metadata fields within text or binary files as long as those fields can be easily viewed by the user. 3) No Modified Version of the Font Software may use the Reserved Font Name(s) unless explicit written permission is granted by the corresponding Copyright Holder. This restriction only applies to the primary font name as presented to the users. 4) The name(s) of the Copyright Holder(s) or the Author(s) of the Font Software shall not be used to promote, endorse or advertise any Modified Version, except to acknowledge the contribution(s) of the Copyright Holder(s) and the Author(s) or with their explicit written permission. 5) The Font Software, modified or unmodified, in part or in whole, must be distributed entirely under this license, and must not be distributed under any other license. The requirement for fonts to remain under this license does not apply to any document created using the Font Software. TERMINATION This license becomes null and void if any of the above conditions are not met. DISCLAIMER THE FONT SOFTWARE IS PROVIDED "AS IS", WITHOUT WARRANTY OF ANY KIND, EXPRESS OR IMPLIED, INCLUDING BUT NOT LIMITED TO ANY WARRANTIES OF MERCHANTABILITY, FITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT OF COPYRIGHT, PATENT, TRADEMARK, OR OTHER RIGHT. IN NO EVENT SHALL THE COPYRIGHT HOLDER BE LIABLE FOR ANY CLAIM, DAMAGES OR OTHER LIABILITY, INCLUDING ANY GENERAL, SPECIAL, INDIRECT, INCIDENTAL, OR CONSEQUENTIAL DAMAGES, WHETHER IN AN ACTION OF CONTRACT, TORT OR OTHERWISE, ARISING FROM, OUT OF THE USE OR INABILITY TO USE THE FONT SOFTWARE OR FROM OTHER DEALINGS IN THE FONT SOFTWARE.
This project is built on Damien Charlotin’s freely available AI Hallucination Cases database and the years of work behind it. The 2,000-decision milestone belongs to that record.
- Thanks to Mary E. Matuszak, Director of Library Services at the New York County District Attorney’s Office, whose posts on these decisions as they arrive keep the profession reading them.
- Thanks to Mark Pike, whose Oyez AI? game in the amicus project, which shows one Supreme Court case caption a day and asks whether it is real or generated, inspired the training exercises on this site.
- Original edition (September 5, 2026): built by Kyle Bahr, Claude Fable 5.1, and OpenAI Codex 5.6 Sol. Kyle set the scope and the editorial rules; Claude researched, coded, drafted, and checked; Codex independently audited the built site, proofread it, and researched firm size and years since bar admission beyond the orders; Kyle reviewed the published versions.
- Expanded edition (September 7–9, 2026): built by Kyle Bahr with OpenAI Codex GPT-6 Astra and Claude Fable 5.1. Codex rebuilt the site, ran the source-pronoun review, and designed the Before ChatGPT page; Claude rewrote the exercises for clarity, ran the pre-ChatGPT research with an independent verification pass, and built the contract review page; each reviewed the other’s work; Kyle reviewed every version and decided what stayed.
- Three additions began as LinkedIn comments on the original: thanks to Carolyn Elefant (gender), Doug Hall (Before ChatGPT), and Rafie Faruq (contract review).
- Original edition published September 5, 2026, with corrections through September 6. Expanded edition built September 7–9, 2026.
Sources for this page
- Damien Charlotin, AI Hallucination Cases, damiencharlotin.com/hallucinations (showing “2005 cases identified so far,” “Last updated: 1 September 2026,” as fetched Sept. 2, 2026); Damien Charlotin, Hallucinations Case Database FAQ, Artificial Authority (Nov. 14, 2025; last updated June 8, 2026), artificialauthority.ai (inclusion rule; “necessarily an undercount”; “I am marketing one such tool, PelAIkan”).
- Documents: the original pipeline counted 1,800 relative document paths, 153 other links, and 55 unlinked rows. See the method note above for the normalized-host classification and the 33 absolute document URLs. Mark Pike, amicus, github.com/markpikemarkpike/amicus.
- Expanded edition additions: training sources are listed with each exercise and in the downloadable exercise pack (Federal Rules of Civil Procedure, Dec. 1, 2025; ABA Formal Op. 512 (July 29, 2024); ABA Model Rules 1.1, 1.6, 3.3, 5.1, 5.3; Mata v. Avianca, Inc., No. 22-cv-1461, ECF No. 54 (S.D.N.Y. June 22, 2023)). The source-pronoun aggregates come from the project’s research files; the person-level pronoun evidence ledger is private and is not published.
- Before ChatGPT: the historical matters, studies, and the downloadable evidence ledger come from the project’s pre-ChatGPT baseline research (three researchers and an independent verifier, September 7, 2026); every cited document was reopened by the verifier. The research memo, search log, and study inventory are in the project’s research files.
- The two unverified suspensions: Minnesota Public Radio (Aug. 21, 2026); Tort Talk (July 2026) and The Legal Intelligencer (June 22, 2026) (headline only), reporting Twigg v. BSN Sports, Inc., No. 4:23-cv-00067 (M.D. Pa.), whose sanctions order we could not retrieve.