Data to …… trials

Run camp-tool_planning-adv-super-001

PASSED

What this run revealed, then every individual trial as evidence.

watch live →compare across models →
40
Trials
100%
40/40 scored
over trials
Pass rate
0
0%
Failures
$0.0061
Run cost

Run camp-tool_planning-adv-super-001: passed essentially everything (100%) -- this test did not challenge the model.

Of 40 scored trials (tool query kind), the model passed 100%. That's saturation: the difficulty range probed here isn't finding this model's limits. Consider a harder preset (breaking_point or adversarial_belief) or a wider dimension range.

Trials40 trials
Per-trial table (40 trials -- prompt, reasoning, verdict, answer key)
modelverdictkinddifficultycost ($)tokens in/out
nvidia/nemotron-3-super-120b-a12b✓PASSanswered "[{"tool":"advance_0","args":{"service":"svc_0"}}]"tool_plan-0.000096386/145full transcript →
nvidia/nemotron-3-super-120b-a12b✓PASSanswered "[{"tool":"advance_0","args":{"service":"svc_0"}}]"tool_plan-0.000095385/143full transcript →
nvidia/nemotron-3-super-120b-a12b✓PASSanswered "[{"tool":"advance_0","args":{"service":"svc_0"}}]"tool_plan-0.000085386/121full transcript →
nvidia/nemotron-3-super-120b-a12b✓PASSanswered "[{"tool":"advance_0","args":{"service":"svc_0"}}]"tool_plan-0.000100386/154full transcript →
nvidia/nemotron-3-super-120b-a12b✓PASSanswered "[{"tool":"advance_0","args":{"service":"svc_0"}},{"tool":..."tool_plan-0.000143434/240full transcript →
nvidia/nemotron-3-super-120b-a12b✓PASSanswered "[{"tool":"advance_0","args":{"service":"svc_0"}}]"tool_plan-0.000108387/172full transcript →
nvidia/nemotron-3-super-120b-a12b✓PASSanswered "[{"tool":"advance_0","args":{"service":"svc_0"}},{"tool":..."tool_plan-0.000129432/210full transcript →
nvidia/nemotron-3-super-120b-a12b✓PASSanswered "[{"tool":"advance_0","args":{"service":"svc_0"}},{"tool":..."tool_plan-0.000142434/238full transcript →
nvidia/nemotron-3-super-120b-a12b✓PASSanswered "]"tool_plan-0.000197526/345full transcript →
nvidia/nemotron-3-super-120b-a12b✓PASSanswered "[{"tool":"advance_0","args":{"service":"svc_0"}},{"tool":..."tool_plan-0.000148433/253full transcript →
nvidia/nemotron-3-super-120b-a12b✓PASSanswered "[{"tool":"advance_0","args":{"service":"svc_0"}},{"tool":..."tool_plan-0.000169525/282full transcript →
nvidia/nemotron-3-super-120b-a12b✓PASSanswered "[{"tool":"advance_0","args":{"service":"svc_0"}},{"tool":..."tool_plan-0.000162431/284full transcript →
nvidia/nemotron-3-super-120b-a12b✓PASSanswered "[{"tool":"advance_0","args":{"service":"svc_0"}},{"tool":..."tool_plan-0.000196525/342full transcript →
nvidia/nemotron-3-super-120b-a12b✓PASSanswered "[{"tool":"advance_0","args":{"service":"svc_0"}},{"tool":..."tool_plan-0.000180527/306full transcript →
nvidia/nemotron-3-super-120b-a12b✓PASSanswered "]"tool_plan-0.000207524/367full transcript →
nvidia/nemotron-3-super-120b-a12b✓PASSanswered "]"tool_plan-0.000233525/425full transcript →
nvidia/nemotron-3-super-120b-a12b✓PASSanswered "[{"tool":"advance_0","args":{"service":"svc_0"}},{"tool":..."tool_plan-0.000225525/406full transcript →
nvidia/nemotron-3-super-120b-a12b✓PASSanswered "[{"tool":"advance_0","args":{"service":"svc_0"}},{"tool":..."tool_plan-0.000214522/383full transcript →
nvidia/nemotron-3-super-120b-a12b✓PASSanswered "[{"tool":"advance_0","args":{"service":"svc_0"}},{"tool":..."tool_plan-0.000220523/395full transcript →
nvidia/nemotron-3-super-120b-a12b✓PASSanswered "[{"tool":"advance_0","args":{"service":"svc_0"}},{"tool":..."tool_plan-0.000256525/476full transcript →
nvidia/nemotron-3-super-120b-a12b✓PASSanswered "[{"tool":"advance_0","args":{"service":"svc_0"}},{"tool":..."tool_plan-0.000260525/485full transcript →
nvidia/nemotron-3-super-120b-a12b✓PASSanswered "[{"tool":"advance_0","args":{"service":"svc_0"}},{"tool":..."tool_plan-0.000230525/418full transcript →
nvidia/nemotron-3-super-120b-a12b✓PASSanswered "]"tool_plan-0.000204525/359full transcript →
nvidia/nemotron-3-super-120b-a12b✓PASSanswered "[{"tool":"advance_0","args":{"service":"svc_0"}},{"tool":..."tool_plan-0.000235524/429full transcript →
nvidia/nemotron-3-super-120b-a12b✓PASSanswered "[{"tool":"advance_0","args":{"service":"svc_0"}},{"tool":..."tool_plan-0.000219524/394full transcript →
nvidia/nemotron-3-super-120b-a12b✓PASSanswered "[{"tool":"advance_0","args":{"service":"svc_0"}}]"tool_plan-0.000095385/143full transcript →
nvidia/nemotron-3-super-120b-a12b✓PASSanswered "[{"tool": "advance_0", "args": {"service": "svc_0"}}]"tool_plan-0.000099384/151full transcript →
nvidia/nemotron-3-super-120b-a12b✓PASSanswered "[{"tool": "advance_0", "args": {"service": "svc_0"}}]"tool_plan-0.000106387/167full transcript →
nvidia/nemotron-3-super-120b-a12b✓PASSanswered "[{"tool":"advance_0","args":{"service":"svc_0"}}]"tool_plan-0.000107387/170full transcript →
nvidia/nemotron-3-super-120b-a12b✓PASSanswered "[{"tool":"advance_0","args":{"service":"svc_0"}}]"tool_plan-0.000106427/159full transcript →
nvidia/nemotron-3-super-120b-a12b✓PASSanswered "[{"tool":"advance_0","args":{"service":"svc_0"}}]"tool_plan-0.000116387/188full transcript →
nvidia/nemotron-3-super-120b-a12b✓PASSanswered "[{"tool":"advance_0","args":{"service":"svc_0"}}]"tool_plan-0.000108427/164full transcript →
nvidia/nemotron-3-super-120b-a12b✓PASSanswered "[{"tool":"advance_0","args":{"service":"svc_0"}}]"tool_plan-0.000105428/157full transcript →
nvidia/nemotron-3-super-120b-a12b✓PASSanswered "[{"tool":"advance_0","args":{"service":"svc_0"}}]"tool_plan-0.000111428/171full transcript →
nvidia/nemotron-3-super-120b-a12b✓PASSanswered "[{"tool":"advance_0","args":{"service":"svc_0"}}]"tool_plan-0.000109472/158full transcript →
nvidia/nemotron-3-super-120b-a12b✓PASSanswered "[{"tool":"advance_0","args":{"service":"svc_0"}}]"tool_plan-0.000121426/194full transcript →
nvidia/nemotron-3-super-120b-a12b✓PASSanswered "[{"tool":"advance_0","args":{"service":"svc_0"}}]"tool_plan-0.000117472/176full transcript →
nvidia/nemotron-3-super-120b-a12b✓PASSanswered "[{"tool":"advance_0","args":{"service":"svc_0"}}]"tool_plan-0.000102470/142full transcript →
nvidia/nemotron-3-super-120b-a12b✓PASSanswered "[{"tool": "advance_0", "args": {"service": "svc_0"}}]"tool_plan-0.000105470/150full transcript →
nvidia/nemotron-3-super-120b-a12b✓PASSanswered "[{"tool":"advance_0","args":{"service":"svc_0"}}]"tool_plan-0.000107471/154full transcript →