kumo/kumo-easy
Reasoning
KUMO (easy split): easier-difficulty procedurally-generated reasoning tasks from KUMO’s benchmark across 100 domains.
Run this task
CLI:
inspect eval inspect_harbor/kumo_easy --model openai/gpt-5Python:
from inspect_ai import eval
from inspect_harbor import kumo_easy
eval(kumo_easy(), model="openai/gpt-5")Dataset information
| Harbor registry | kumo/kumo-easy |
| Inspect task | kumo_easy |
| Latest digest | sha256:139cb4201654f1e12a110554b8c8630fa3d7759464436f9b48692d56fdc3d6d8 |
| Samples | 1000 |
| Paper | arxiv |
| Source | https://github.com/linhaowei1/kumo |
See Task Parameters for the parameter set shared across all Harbor tasks.