Get It In Writing

Using AI to “Review” Your Contract? Here’s What It Can’t See

Pasting a contract into AI before you sign feels like due diligence. You get a fast summary, a list of “concerns,” maybe a clause explained in plain English. It’s better than not reading it at all. But as a business attorney, I keep watching that fast summary miss the exact thing that ends up mattering — not because the AI is careless, but because it can only see the words on the page, and half of what makes a contract dangerous isn’t on the page.

Here are three real situations that show what I mean.

Blind spot 1: It doesn’t know what you actually agreed to

I had a client who verbally settled a case with the other side. Straightforward, everyone shook hands on the terms. Then the written settlement agreement came back with extra language added — language that exempted the other side from having to comply within the agreed timeframe, because they were a large company, plus a few other terms that quietly favored them.

Read in isolation, that settlement agreement looks like a normal document. Nothing about the text itself screams “problem” — it reads clean, it’s internally consistent, an AI summary would probably call it reasonable. The problem only exists when you compare it to the conversation that happened before the document was drafted, and AI wasn’t in that conversation. It only ever sees what’s typed in front of it.

Blind spot 2: It doesn’t know your actual situation

I recently reviewed an operating agreement for someone with a small ownership interest in a business where she also works. The real question wasn’t “what does this document say” — it was “what happens to my interest if I leave this job, given the non-compete language, given that a different state’s law might actually control here, and given that what she wants is to negotiate an exit where she keeps her interest.”

An AI reading that operating agreement can summarize the termination clause. It has no way to know she’s an employee and an owner, no way to weigh which state’s law actually wins a conflict-of-laws fight, and no way to know her goal isn’t “understand this clause” but “structure an exit that gets me what I want.” That’s not a reading comprehension problem. It’s a missing-context problem, and more context doesn’t fully fix it — some of it only exists in your head, not in the document.

Blind spot 3: Even purpose-built AI review tools still need a human

This one might surprise you: it’s not just general chatbots. My son works on AI products, and we’ve been building tools together — one that compares documents substantively (not just tracking redlines) and one that fills in probate forms. These aren’t generic chatbots; they’re built specifically for this kind of document work. And there’s still a lot of attorney input required, even for the forms. If a tool built for exactly this purpose still needs a human in the loop, a general-purpose AI asked to “review this contract” needs one more.

Why this keeps happening

In all three cases, the AI wasn’t wrong about what it could see. It’s that a contract’s real risk usually lives in the gap between the document and everything around it: the verbal conversation that preceded it, the personal situation of the person signing it, the law that actually governs when two states could both claim jurisdiction. AI reviews the document. A lawyer reviews the deal — the document plus everything AI can’t access.

(If you’re on the drafting side of this same problem, the failure mode is related — see can I use ChatGPT to write a business contract?. And if you’re thinking of pasting a real agreement in to get that AI summary, there’s a separate risk worth knowing about first: is it safe to upload a contract to ChatGPT?)

How to actually use AI review well

  • Use it to get oriented, not to clear a document. A plain-English summary before a call with your attorney is useful. A summary instead of that call is not.
  • Write down what was actually agreed before you read the document — verbally, in emails, in your head — so you have something to compare the written version against. AI can’t do that comparison for you.
  • Tell it what it doesn’t know, and treat that as a warning sign, not a formality. If a clause depends on your employment status, your other agreements, or which state’s law applies, that’s exactly where AI review runs out of road.
  • For anything that actually matters, close the loop with a human who can ask you the questions AI doesn’t know to ask.

The bottom line

AI can read a contract. It can’t read the deal. The riskiest sentence in any contract is often the one that looks completely fine on its own — and only becomes a problem once you know what was actually promised, who you actually are, and which law actually applies. That’s the part no AI review catches, because it was never written down for it to see in the first place.

Want to know where your business is actually exposed? Grab the free Get-It-In-Writing Business Audit — 15 things that should be in writing, but usually aren’t. Get the checklist →

This article is general education, not legal advice, and does not create an attorney-client relationship. Laws vary by state and situation — for your circumstances, talk to a licensed attorney.