gorilla/bfcl_parity

Assistants

Stratified parity subset of BFCL validating that Harbor’s adapter matches the upstream implementation.

← Back to Registry

Run this task

CLI:

inspect eval inspect_harbor/gorilla_bfcl_parity --model openai/gpt-5

Python:

from inspect_ai import eval
from inspect_harbor import gorilla_bfcl_parity

eval(gorilla_bfcl_parity(), model="openai/gpt-5")

Dataset information

Harbor registry gorilla/bfcl_parity
Inspect task gorilla_bfcl_parity
Latest digest sha256:0aafa971771f90b11cd77026ed9373b2f555facb23ab135122003c30a1678520
Samples 123
Source https://github.com/ShishirPatil/gorilla

See Task Parameters for the parameter set shared across all Harbor tasks.