AI legal platforms contain dual use data that can be turned against lawyers.
The same AI legal platform that lets one associate review 300 contracts can also prove they barely read them. I build AI legal tools. That’s the paradox that keeps me up at night.
Do we instrument the “lawyer in the loop”? Log which documents they opened, which flagged clauses they actually dwelled on, how long passed before they hit approve and sent the email? One minute to approve hundreds of contract reviews or a major brief is not a good look!
The moment we build that telemetry or clickstream, we built a forensic record of lawyer supervision — which is also a forensic record of non-supervision. Shield and sword, the same feature.
Better than a camera following the lawyer around the office, because it captures not just that they were there, but what they touched and for how long and in many cases it’s logged, time stamped, and stored in a database.
There’s a word for that type of trail: clickstream. I have some history with it. More than 25 years ago I was co-lead counsel in one of the first internet privacy class actions in the US — In re DoubleClick — where “clickstream” was central to the case: the behavioral trail companies were quietly recording about ordinary users. I never expected to spend my older years writing the code that records a clickstream on lawyers instead. Similar mechanism, different target — except this time I’m the one building it.
So here are the eleven questions that are important to the future of AI legal workflow usage I keep circling:
1.What level of supervision including lawyer clickstream monitoring is actually required — and does “reasonable assurance” of review now mean assurance you can demonstrate?
2.Should a firm turn this monitoring on at all, knowing the same record that proves diligence also exposes rubber-stamping?
3.Can a firm turn it off — and is disabling a capability you have worse than never having built it in the first place?
4.Are the AI legal platform vendors required to offer this monitoring, or do they build it purely to sell defensibility and shift liability onto the firm?
5.Will malpractice insurers require it — and won’t they move faster than the bar, since coverage conditions bite harder than ethics rules?
6.Where does the insurer draw the coverage line: any use of AI, undocumented use, or only over-delegation severe enough to be recharacterized as unauthorized practice of law and excluded?
7.Why don’t the lines match — the bar drawing it at the substance of judgment, regulators at system design, and liability courts retrospectively on whatever record happens to exist?
8. How does “AI-native” marketing change the math, when boasting about rigorous human oversight is itself a standard-of-care admission you then have to back up?
9.What happens when client promises convert these soft professional norms into hard contractual obligations you can be sued on?
10. Is any of this protecting clients — or just protecting firms and their insurers?
11.The endpoint: do we turn the AI workflow back on the lawyer — gating the final document until the human “complies” with the system’s requirements? At which point supervision of the AI quietly becomes the AI supervising the lawyer.
We asked for a human in the loop. We might end up with a loop that keeps the human in line.