Discussion about this post

User's avatar
Jack Maris's avatar

I'm interested in whether specific AI systems develop 'moats' in the legal system, or if instead we end up with a "bring your own model" approach. I'd bet on the former

Human expert witnesses gain credibility through their credentials (e.g., did you pass the bar?) But it wouldn't be difficult to make an LLM a) extremely legally competent (passes any test you ask, evinces no bias in subjects outside the case) and b) tailored to respond in some way in one particular case. Imagine: "Respond as an expert in forensics, who is convinced against any exculpatory evidence that the defendant was at the saloon on that night".

So to counter this there'd be a small set of 'industry-standard' off-the-shelf models, _or_ if you wanted to use a specific domain expert model that it'd require a length process where both sides agree on what data goes into the training set, how to avoid bias, etc.

Expand full comment
1 more comment...

No posts