blobfishai/litigation
Law
Professional
Executable litigation environments for agent training and evaluation. 100 long-horizon tasks, a median of 108 verified tool-calling steps each, worked across eight systems of record (Clio Manage, iManage Work, CM/ECF, Google Calendar, Docusign, Relativity, CourtListener and nine litigation sub-systems). Graded by deterministic state-diff and trace assertions — no LLM judge on the reward path.
Run this task
CLI:
inspect eval inspect_harbor/blobfishai_litigation --model openai/gpt-5Python:
from inspect_ai import eval
from inspect_harbor import blobfishai_litigation
eval(blobfishai_litigation(), model="openai/gpt-5")Dataset information
| Harbor registry | blobfishai/litigation |
| Inspect task | blobfishai_litigation |
| Latest digest | sha256:53d0cd3433b743c42671d10ef1b4de874c447b4994020f702cb5a31e7bf1ba0c |
| Samples | 100 |
See Task Parameters for the parameter set shared across all Harbor tasks.