autocodebench@lite200

Coding

Adapter for AutoCodeBench.

← Back to Registry

Run this task

CLI:

inspect eval inspect_harbor/autocodebench_lite200 --model openai/gpt-5

Python:

from inspect_ai import eval
from inspect_harbor import autocodebench_lite200

eval(autocodebench_lite200(), model="openai/gpt-5")

Dataset information

Harbor registry autocodebench@lite200
Inspect task autocodebench_lite200
Version lite200
Samples 200
Paper arxiv

See Task Parameters for the parameter set shared across all Harbor tasks.