lcb/longswebench-32k
Coding
LongCodeBench (LCB) LongSWE-Bench tasks — 32k context window bucket.
Run this task
CLI:
inspect eval inspect_harbor/lcb_longswebench_32k --model openai/gpt-5Python:
from inspect_ai import eval
from inspect_harbor import lcb_longswebench_32k
eval(lcb_longswebench_32k(), model="openai/gpt-5")Dataset information
| Harbor registry | lcb/longswebench-32k |
| Inspect task | lcb_longswebench_32k |
| Latest digest | sha256:dde4db0e62775d1ad50bfc6590214ad4e4bd601b313fdbd1a7437c4cd5f4d8fd |
| Samples | 3 |
| Paper | arxiv |
| Source | https://github.com/Zteefano/long-code-bench |
See Task Parameters for the parameter set shared across all Harbor tasks.