swe-lancer-diamond@all
Coding
Adapter for SWE-Lancer. Both manager and individual contributor tasks.
Run this task
CLI:
inspect eval inspect_harbor/swe_lancer_diamond_all --model openai/gpt-5Python:
from inspect_ai import eval
from inspect_harbor import swe_lancer_diamond_all
eval(swe_lancer_diamond_all(), model="openai/gpt-5")Dataset information
| Harbor registry | swe-lancer-diamond@all |
| Inspect task | swe_lancer_diamond_all |
| Version | all |
| Samples | 463 |
| Paper | arxiv |
See Task Parameters for the parameter set shared across all Harbor tasks.