swe-lancer-diamond@manager
Coding
Adapter for SWE-Lancer. Only the manager tasks.
Run this task
CLI:
inspect eval inspect_harbor/swe_lancer_diamond_manager --model openai/gpt-5Python:
from inspect_ai import eval
from inspect_harbor import swe_lancer_diamond_manager
eval(swe_lancer_diamond_manager(), model="openai/gpt-5")Dataset information
| Harbor registry | swe-lancer-diamond@manager |
| Inspect task | swe_lancer_diamond_manager |
| Version | manager |
| Samples | 265 |
| Paper | arxiv |
See Task Parameters for the parameter set shared across all Harbor tasks.