Data to …… trials

Run camp-interactive-fault-super-001

PASSED

What this run revealed, then every individual trial as evidence.

watch live →compare across models →
35
2 errors
Trials
100%
33/33 scored
over trials
Pass rate
0
0%
Failures
$0.1527
Run cost

Run camp-interactive-fault-super-001: passed essentially everything (100%) -- this test did not challenge the model.

Of 33 scored trials (interactive query kind), the model passed 100%. That's saturation: the difficulty range probed here isn't finding this model's limits. Consider a harder preset (breaking_point or adversarial_belief) or a wider dimension range.

2 additional trial(s) ended in ERROR (infra failures, cost cap, or cancellation) and are excluded from the pass rate above.

Trials35 trials
Per-trial table (35 trials -- prompt, reasoning, verdict, answer key)
modelverdictkinddifficultycost ($)tokens in/out
nvidia/nemotron-3-super-120b-a12b✓PASSanswered "[{"step": 1, "tool": "advance_0", "args": {"service": "sv..."interactive-0.00139413502/697full transcript →
nvidia/nemotron-3-super-120b-a12b✓PASSanswered "[{"step": 1, "tool": "advance_0", "args": {"service": "sv..."interactive-0.00138213495/671full transcript →
nvidia/nemotron-3-super-120b-a12b✓PASSanswered "[{"step": 1, "tool": "advance_0", "args": {"service": "sv..."interactive-0.00153513487/1013full transcript →
nvidia/nemotron-3-super-120b-a12b✓PASSanswered "[{"step": 1, "tool": "build_art_0", "args": {"artifact": ..."interactive-0.00144513503/810full transcript →
nvidia/nemotron-3-super-120b-a12b✓PASSanswered "[{"step": 1, "tool": "build_art_0", "args": {"artifact": ..."interactive-0.00154513487/1036full transcript →
nvidia/nemotron-3-super-120b-a12b✓PASSanswered "[{"step": 1, "tool": "build_art_0", "args": {"artifact": ..."interactive-0.00231521025/1407full transcript →
nvidia/nemotron-3-super-120b-a12b✓PASSanswered "[{"step": 1, "tool": "set_flag_0", "args": {"flag": "flag..."interactive-0.00238620928/1581full transcript →
nvidia/nemotron-3-super-120b-a12b✓PASSanswered "[{"step": 1, "tool": "build_art_0", "args": {"artifact": ..."interactive-0.00266221147/2156full transcript →
nvidia/nemotron-3-super-120b-a12b✓PASSanswered "[{"step": 1, "tool": "advance_0", "args": {"service": "sv..."interactive-0.00236020974/1516full transcript →
nvidia/nemotron-3-super-120b-a12b✓PASSanswered "[{"step": 1, "tool": "set_flag_0", "args": {"flag": "flag..."interactive-0.00234921043/1480full transcript →
nvidia/nemotron-3-super-120b-a12b✓PASSanswered "[{"step": 1, "tool": "set_flag_0", "args": {"flag": "flag..."interactive-0.00304630880/1278full transcript →
nvidia/nemotron-3-super-120b-a12b✓PASSanswered "[{"step": 1, "tool": "build_art_0", "args": {"artifact": ..."interactive-0.00327030748/1801full transcript →
nvidia/nemotron-3-super-120b-a12b✓PASSanswered "[{"step": 1, "tool": "set_flag_0", "args": {"flag": "flag..."interactive-0.00324530871/1722full transcript →
nvidia/nemotron-3-super-120b-a12b✓PASSanswered "[{"step": 1, "tool": "advance_0", "args": {"service": "sv..."interactive-0.00331630807/1891full transcript →
nvidia/nemotron-3-super-120b-a12b✓PASSanswered "[{"step": 1, "tool": "set_flag_0", "args": {"flag": "flag..."interactive-0.00328230565/1860full transcript →
nvidia/nemotron-3-super-120b-a12b✓PASSanswered "[{"step": 1, "tool": "set_flag_0", "args": {"flag": "flag..."interactive-0.00398937990/2110full transcript →
nvidia/nemotron-3-super-120b-a12b✓PASSanswered "[{"step": 1, "tool": "set_flag_0", "args": {"flag": "flag..."interactive-0.00444738227/3086full transcript →
nvidia/nemotron-3-super-120b-a12b✓PASSanswered "[{"step": 1, "tool": "set_flag_0", "args": {"flag": "flag..."interactive-0.00433438010/2873full transcript →
nvidia/nemotron-3-super-120b-a12b✓PASSanswered "[{"step": 1, "tool": "set_flag_0", "args": {"flag": "flag..."interactive-0.00386038268/1774full transcript →
nvidia/nemotron-3-super-120b-a12b✓PASSanswered "[{"step": 1, "tool": "set_flag_0", "args": {"flag": "flag..."interactive-0.00416938025/2504full transcript →
nvidia/nemotron-3-super-120b-a12b✓PASSanswered "[{"step": 1, "tool": "set_flag_0", "args": {"flag": "flag..."interactive-0.00556354687/2641full transcript →
nvidia/nemotron-3-super-120b-a12b✓PASSanswered "[{"step": 1, "tool": "build_art_0", "args": {"artifact": ..."interactive-0.00589154552/3394full transcript →
nvidia/nemotron-3-super-120b-a12b✓PASSanswered "[{"step": 1, "tool": "set_flag_0", "args": {"flag": "flag..."interactive-0.00642058233/3915full transcript →
nvidia/nemotron-3-super-120b-a12b✓PASSanswered "[{"step": 1, "tool": "set_flag_0", "args": {"flag": "flag..."interactive-0.00583254255/3314full transcript →
nvidia/nemotron-3-super-120b-a12b✓PASSanswered "[{"step": 1, "tool": "set_flag_0", "args": {"flag": "flag..."interactive-0.00559154709/2699full transcript →
nvidia/nemotron-3-super-120b-a12b✓PASSanswered "[{"step": 1, "tool": "set_flag_0", "args": {"flag": "flag..."interactive-0.00712373662/2733full transcript →
nvidia/nemotron-3-super-120b-a12b✓PASSanswered "[{"step": 1, "tool": "set_flag_0", "args": {"flag": "flag..."interactive-0.00740373984/3299full transcript →
nvidia/nemotron-3-super-120b-a12b✓PASSanswered "[{"step": 1, "tool": "set_flag_0", "args": {"flag": "flag..."interactive-0.00769273592/4011full transcript →
nvidia/nemotron-3-super-120b-a12b✓PASSanswered "[{"step": 1, "tool": "set_flag_0", "args": {"flag": "flag..."interactive-0.00713474360/2634full transcript →
nvidia/nemotron-3-super-120b-a12b✓PASSanswered "[{"step": 1, "tool": "build_art_0", "args": {"artifact": ..."interactive-0.00766473823/3907full transcript →
nvidia/nemotron-3-super-120b-a12b✓PASSanswered "[{"step": 1, "tool": "set_flag_0", "args": {"flag": "flag..."interactive-0.00917399308/2729full transcript →
nvidia/nemotron-3-super-120b-a12b✓PASSanswered "[{"step": 1, "tool": "advance_0", "args": {"service": "sv..."interactive-0.00962999219/3758full transcript →
nvidia/nemotron-3-super-120b-a12b✓PASSanswered "[{"step": 1, "tool": "set_flag_0", "args": {"flag": "flag..."interactive-0.010145106046/3691full transcript →
nvidia/nemotron-3-super-120b-a12b✕ERRORinfra failureinteractive-0.0000000/0full transcript →
nvidia/nemotron-3-super-120b-a12b✕ERRORtool_callsinteractive-0.0010759135/764full transcript →