Data to …… trials

Run camp-interactive-lookalike-super-003

PASSED

What this run revealed, then every individual trial as evidence.

watch live →compare across models →
20
3 errors
Trials
100%
17/17 scored
over trials
Pass rate
0
0%
Failures
$0.1590
Run cost

Run camp-interactive-lookalike-super-003: passed essentially everything (100%) -- this test did not challenge the model.

Of 17 scored trials (interactive query kind), the model passed 100%. That's saturation: the difficulty range probed here isn't finding this model's limits. Consider a harder preset (breaking_point or adversarial_belief) or a wider dimension range.

3 additional trial(s) ended in ERROR (infra failures, cost cap, or cancellation) and are excluded from the pass rate above.

Trials20 trials
Per-trial table (20 trials -- prompt, reasoning, verdict, answer key)
modelverdictkinddifficultycost ($)tokens in/out
nvidia/nemotron-3-super-120b-a12b✓PASSanswered "[{"step": 1, "tool": "build_art_o0", "args": {"artifact":..."interactive-0.00745877283/2835full transcript →
nvidia/nemotron-3-super-120b-a12b✓PASSanswered "[{"step": 1, "tool": "set_flag_o0", "args": {"flag": "fla..."interactive-0.00735072667/3415full transcript →
nvidia/nemotron-3-super-120b-a12b✓PASSanswered "[{"step": 1, "tool": "build_art_0", "args": {"artifact": ..."interactive-0.00846482057/4221full transcript →
nvidia/nemotron-3-super-120b-a12b✓PASSanswered "[{"step": 1, "tool": "set_flag_o0", "args": {"flag": "fla..."interactive-0.00707372512/2827full transcript →
nvidia/nemotron-3-super-120b-a12b✓PASSanswered "[{"step": 1, "tool": "adva_nce_0", "args": {"service": "s..."interactive-0.00871281858/4808full transcript →
nvidia/nemotron-3-super-120b-a12b✓PASSanswered "[{"step": 1, "tool": "adva-nce_0", "args": {"service": "s..."interactive-0.013656127621/7658full transcript →
nvidia/nemotron-3-super-120b-a12b✓PASSanswered "[{"step": 1, "tool": "adva-nce_0", "args": {"service": "s..."interactive-0.00714972516/2994full transcript →
nvidia/nemotron-3-super-120b-a12b✓PASSanswered "[{"step": 1, "tool": "set_-flag_0", "args": {"flag": "fla..."interactive-0.00736272724/3431full transcript →
nvidia/nemotron-3-super-120b-a12b✓PASSanswered "[{"step": 1, "tool": "set_-flag_0", "args": {"flag": "fla..."interactive-0.00718372652/3046full transcript →
nvidia/nemotron-3-super-120b-a12b✓PASSanswered "[{"step": 1, "tool": "advance_o0", "args": {"service": "s..."interactive-0.018032150397/13334full transcript →
nvidia/nemotron-3-super-120b-a12b✓PASSanswered "[{"step": 1, "tool": "set_flag_o0", "args": {"flag": "fla..."interactive-0.00787682156/2897full transcript →
nvidia/nemotron-3-super-120b-a12b✓PASSanswered "[{"step": 1, "tool": "set_flag_o0", "args": {"flag": "fla..."interactive-0.00732272442/3392full transcript →
nvidia/nemotron-3-super-120b-a12b✓PASSanswered "[{"step": 1, "tool": "set_-flag_0", "args": {"flag": "fla..."interactive-0.00742977497/2731full transcript →
nvidia/nemotron-3-super-120b-a12b✓PASSanswered "[{"step": 1, "tool": "advance_o0", "args": {"service": "s..."interactive-0.00976691472/5440full transcript →
nvidia/nemotron-3-super-120b-a12b✓PASSanswered "[{"step": 1, "tool": "set_-flag_0", "args": {"flag": "fla..."interactive-0.00811977159/4326full transcript →
nvidia/nemotron-3-super-120b-a12b✓PASSanswered "[{"step": 1, "tool": "set_flag_0", "args": {"flag": "flag..."interactive-0.00723972548/3189full transcript →
nvidia/nemotron-3-super-120b-a12b✓PASSanswered "[{"step": 1, "tool": "advance_o0", "args": {"service": "s..."interactive-0.00728372540/3288full transcript →
nvidia/nemotron-3-super-120b-a12b✕ERRORtool_callsinteractive-0.00440142220/2274full transcript →
nvidia/nemotron-3-super-120b-a12b✕ERRORtool_callsinteractive-0.00716472720/2993full transcript →
nvidia/nemotron-3-super-120b-a12b✕ERRORinfra failureinteractive-0.0000000/0full transcript →