swe-lancer-diamond@ic
Coding
Adapter for SWE-Lancer. Only the individual contributor SWE tasks.
Run this task
CLI:
inspect eval inspect_harbor/swe_lancer_diamond_ic --model openai/gpt-5Python:
from inspect_ai import eval
from inspect_harbor import swe_lancer_diamond_ic
eval(swe_lancer_diamond_ic(), model="openai/gpt-5")Dataset information
| Harbor registry | swe-lancer-diamond@ic |
| Inspect task | swe_lancer_diamond_ic |
| Version | ic |
| Samples | 198 |
| Paper | arxiv |
See Task Parameters for the parameter set shared across all Harbor tasks.