Inspect Viz Examples

These examples demonstrate various plotting and interactivity features. If you are just beginning to use Inspect Viz you review the Getting Started article before exploring these examples.

Inspect

These examples demonstrates creating visualisations from Inspect log files (leveraging the functions in inspect_ai.analysis module for creation of data frames from logs).

Scores by Task	Bar plot summarizing eval scores by model and task.
Scores by Factor	Bar plot for comparing eval scores by model and a boolean factor (e.g. no hint vs. hint).
Scores by Model	Visualise model scores on a single evaluation, with one or more baselines.
Scores by Limit	Line plot for evaluating how a model’s success rate changes as token or time limits increase.
Scores Timeline	Eval scores for various models, with release date on the x-axis.
Scores Heatmap	Heatmap with values for comparing scores across model and task.
Tool Calls	Visualise tool usage over a series of turns.

General

These examples demonstrate general plotting techniques using a variety of other examples datasets.

Penguins Explorer	Dot plots, tables, color and symbol channels, filtering inputs.
Bias Parameter	Area plots; slider inputs; channel expressions.
Seattle Weather	Dot plots; bar plots; color and radius channels; x-interval selections, interactive legend.
Athletes (Regression)	Dot plots; regression lines; tables, filtering inputs, xy selections.
Athletes (Error Bars)	Error bars; text annotations; params, slider inputs.