Course · Law and Data
Checking Legal AI Tools
Test and supervise legal AI tools: planted errors, recall and precision, sampling, acceptance rates, extraction checks, playbooks and governance.
Pay once, keep it forever · secure payment by Stripe
Tools that review contracts, draft clauses and pull out obligations are arriving in every firm and every legal department. Their makers publish how many suggestions people accept and how well they find what matters. This course teaches the skill nobody sells: how to test a tool, read its numbers honestly, catch its mistakes, and decide whether to rely on it. Every tool output is written by us with mistakes planted in it, so the lessons are exact and repeatable.
The Curriculum
What the tools do and how they fail→
The five jobs, the common ways they go wrong, and why a smooth answer proves nothing. Lab: Find the Error.
Measuring a tool→
The confusion table, recall, precision and elusion, and why accuracy misleads. Labs: Review Scorer and Why Accuracy Misleads.
Sampling and validation→
How to test on a random sample, how big, and how sure you can be. Lab: Sampling Simulator.
Acceptance-rate analytics→
Tracking accepted, rejected and edited suggestions to find a tool's weak spots. Lab: Acceptance Dashboard.
Checking extraction→
Comparing an extracted obligations table with the source. Lab: Extraction Checker.
Playbooks and instructions→
Preferred, fallback and red-line positions that a tool can follow. Lab: Playbook Tester.
Governance, confidentiality and ethics→
What never to paste, which questions to ask a vendor, and when not to use a tool. Lab: Vendor Questions and Go or No-Go checklist.
Capstone: Evaluate a tool→
Test a simulated review tool on a batch of contracts and decide go or no-go.
What It Covers
“The skill nobody sells: how to test a legal AI tool and decide, with evidence, whether to rely on it.”
- No tool is run: every output is authored with planted mistakes, so every lesson is exact and repeatable.
- Spreadsheet-level maths only, and it works in any country.
- A capstone where you evaluate a simulated review tool and decide go or no-go.
Included With All-Access · Or Buy It Alone
Introductory PriceChoose how you unlock Checking Legal AI Tools
Subscribe for every course and most tools, or buy just this one course on its own.
The one-time prices below are early, introductory rates for a brand-new catalog — expected to rise as we add more content. Buy now and it’s yours at today’s rate, forever.
Buying a course needs no account: you pay, and we email you a one-click sign-in. Subscriptions need a free account.
Look first, then buy. Free previews on every product page. Secure payment by Stripe. Pay once, keep it forever. Details
Other Scrolls in This Chamber
Legal Risk Quantification$15 →Turn legal judgement into numbers a client can use: probabilities, ranges, expected cost, decision trees, simulation and risk registers.
Contract Analytics for Lawyers$15 →Turn contracts into data: a clause library, cleaning, portfolio questions, renewals and notice deadlines, benchmarks and honest reading of results.
The Legal AI Lab$49 →Working tools for lawyers who use AI: a contract pipeline, verification, stress tests and more. The first exercise of each tool is free.Module 1 is free to try. Sign in, pass each module quiz and the course average, and your Certificate of Completion is emailed to you automatically. This course teaches a method with invented figures and fictional parties; it is not legal advice.
Teaching? Share this with your class
Free to use in class. The free parts open for everyone, no account needed.