We asked 4 AI platforms to recommend the best Law firm in 10 major US cities, then asked them to describe 20 specific Law firms in detail. Every recommendation was verified against Google Places. Every factual claim was extracted and categorized.
“Who is the best Law firm in [city]?” — asked to ChatGPT, Claude, Perplexity, and Gemini
AI platforms rarely agree on who to recommend. Only 6.6% of recommended Law firmswere cited by two or more platforms. Ask ChatGPT and Perplexity the same question and you’ll likely get completely different answers.
Most recommendations can’t be independently verified. Only 49.3% of recommended firms were confirmed as real, operating in the specified city, via Google Places. The rest are in nearby suburbs, have mismatched names, or can’t be found at all.
Claude declined to recommend specific firms in most cities. With a 100.0% decline rate, Claude explicitly cited its inability to verify current information. The other three platforms recommended confidently — with no way for users to verify those recommendations either.
| Platform | Avg. Recommendations | Verification Rate | Hedging Rate | Decline Rate |
|---|---|---|---|---|
| ChatGPT | 4.4 | 52.3% | 60.0% | 0.0% |
| Claude | 0.6 | 33.3% | 100.0% | 100.0% |
| Perplexity | 6.1 | 67.2% | 70.0% | 30.0% |
| Gemini | 5.1 | 31.4% | 80.0% | 0.0% |
“Tell me about [specific Law firm]. How long have they been in business? What services do they offer? What certifications do they have?”
62.5% of AI-stated facts about Law firms can't be verified. We extracted 1,613 specific factual claims from 76 AI descriptions of 20 firms, then graded each one against BBB records, state licensing boards, and company websites. Only 26.7% could be confirmed correct. The rest are either wrong or impossible to verify from public sources.
Gemini was the least accurate (49.3%, 85 confirmed wrong). 102 total claims were provably incorrect across all platforms. Perplexity generated the most claims per business (51.2 on average). More data isn’t better when there’s no verified source to draw from.
Ask two AI platforms the same question about the same business and they disagree 77.8% of the time. Across 36 fact comparisons, platforms gave different founding years, different owners, different employee counts for the same firm. 33 of those disagreements included at least one provably wrong answer.
| Platform | Avg. Claims / Business | Decline Rate | Accuracy | Unverifiable | Wrong |
|---|---|---|---|---|---|
| ChatGPT | 18.6 | 15.0% | 82.9% | 78 | 8 |
| Claude | 6.4 | 84.2% | 85.4% | 31 | 3 |
| Perplexity | 51.2 | 0.0% | 82.4% | 504 | 6 |
| Gemini | 42.2 | 5.0% | 49.3% | 395 | 85 |
“Accuracy” = correct claims / (correct + incorrect + partially correct). Claims graded against BBB, state records, and company websites. “Unverifiable” = claims that could not be confirmed or denied from available public sources.
Specific claims that directly contradict verified sources (BBB records, state licensing boards, company websites).
When we asked each platform the same question about the same business, they often gave different answers. Here are side-by-side comparisons with the verified answer.
Across 36 fact comparisons where 2+ platforms stated an answer, platforms disagreed 77.8% of the time. 33 comparisons included at least one provably wrong answer.
How many factual claims each platform made when asked to describe a specific Law firm.
| Business | City | ChatGPT | Claude | Perplexity | Gemini |
|---|---|---|---|---|---|
| Thompson Law Injury Lawyers | Dallas | 9 / 24 | Declined | 56 / 62 | 33 / 42 |
| Tate Law Offices, PC | Dallas | 10 / 19 | Declined | 39 / 44 | 49 / 57 |
| Atlanta Divorce Law Group | Atlanta | 3 / 23 | Declined | 33 / 40 | 28 / 44 |
| The Fairell Firm | Atlanta | 13 / 21 | Declined | 27 / 29 | 27 / 35 |
| Franklin D. Azar & Associates, P.C. | Denver | 15 / 22 | - | 53 / 69 | 30 / 48 |
| The Sawaya Law Firm | Denver | 11 / 18 | Declined | 31 / 43 | 38 / 47 |
| Sternberg Law Office | Phoenix | Declined | Declined | 29 / 46 | 37 / 41 |
| Tiffany & Bosco, P.A. | Phoenix | 10 / 20 | Declined | - | 49 / 63 |
| Staver Accident Injury Lawyers, P.C. | Chicago | 11 / 20 | 9 / 11 | 51 / 60 | 23 / 39 |
| Willens & Baez Personal Injury Lawyers | Chicago | 12 / 21 | Declined | - | 40 / 47 |
| Mavrides, Silva & Associates | Boston | 10 / 20 | Declined | 53 / 61 | 38 / 45 |
| Wilkinson & Finkbeiner, LLP | Boston | 13 / 27 | Declined | 46 / 55 | Declined |
| McKinley Irvin | Seattle | 24 / 38 | 36 / 51 | 38 / 47 | 36 / 56 |
| Washington Law Group | Seattle | Declined | Declined | 55 / 57 | 17 / 29 |
| Prosper Shaked Accident Injury Attorneys PA | Miami | 4 / 19 | Declined | 46 / 52 | 38 / 41 |
| The Perazzo Law Firm | Miami | 9 / 16 | Declined | 55 / 58 | 22 / 33 |
| Heimerl & Lammers, LLC | Minneapolis | 7 / 20 | Declined | - | 14 / 25 |
| Spears Family Law PLLC | Minneapolis | Declined | Declined | 32 / 33 | 32 / 43 |
| Bart Durham Injury Law | Nashville | 12 / 21 | 16 / 25 | 49 / 59 | 34 / 58 |
| Larry R. Williams, PLLC | Nashville | 8 / 17 | Declined | 50 / 56 | 22 / 40 |
Bold number = specific claims. After slash = total claims including vague statements.
Only 6.6% of recommended Law firms appeared on more than one platform. Which AI your customer uses determines which firmthey find.
62.5% of specific AI claims about Law firms couldn't be confirmed or denied from any public source. 102 claims were confirmed wrong.
AI doesn’t lack information — it lacks verified information. When there’s no authoritative source, AI guesses. Structured data from systems-of-record is how it gets the answer right.
Asked in each of 10 cities. Each response parsed for business names, evidence cited, hedging language. Each business verified via Google Places API.
20 verified Law firms (2 per city, selected by Google review volume). Every factual claim extracted and categorized into 9 categories: founding year, services, certifications, location, reputation, staff, pricing, affiliations, other.
Each specific claim was then graded against ground truth collected from BBB profiles, state licensing boards, Google Places, and company websites. Claims were graded as correct, incorrect, partially correct, or unverifiable.
For the cross-platform disagreement analysis, structured facts (founding year, address, BBB rating, owner name, employee count) were extracted from each response and compared side-by-side. A disagreement is recorded when two or more platforms state different values for the same fact about the same business.
Dallas, Texas · Atlanta, Georgia · Denver, Colorado · Phoenix, Arizona · Chicago, Illinois · Boston, Massachusetts · Seattle, Washington · Miami, Florida · Minneapolis, Minnesota · Nashville, Tennessee
Google Places API (Find Place from Text). Each recommended business was searched by name + city + state. Verified = found on Google Places with name match >= 50% and address in specified metro area.
Raw data, parsed responses, and verification results are available for download. Contact hello@usetruesignal.com for the full dataset.
62.5% of what AI says about Law firms in this study couldn't be verified from any public source. A TrustRecord replaces guesswork with verified operational data from your own systems-of-record.
Activate Your TrustRecord