Data to …… trials

Run camp-tool_planning-super-001

PASSED

What this run revealed, then every individual trial as evidence.

watch live →compare across models →
40
Trials
100%
40/40 scored
over trials
Pass rate
0
0%
Failures
$0.0059
Run cost

Run camp-tool_planning-super-001: passed essentially everything (100%) -- this test did not challenge the model.

Of 40 scored trials (tool query kind), the model passed 100%. That's saturation: the difficulty range probed here isn't finding this model's limits. Consider a harder preset (breaking_point or adversarial_belief) or a wider dimension range.

Trials40 trials
Per-trial table (40 trials -- prompt, reasoning, verdict, answer key)
modelverdictkinddifficultycost ($)tokens in/out
nvidia/nemotron-3-super-120b-a12b✓PASSanswered "[{"tool": "advance_0", "args": {"service": "svc_0"}}]"tool_plan-0.000080384/110full transcript →
nvidia/nemotron-3-super-120b-a12b✓PASSanswered "[{"tool":"advance_0","args":{"service":"svc_0"}}]"tool_plan-0.000091387/133full transcript →
nvidia/nemotron-3-super-120b-a12b✓PASSanswered "[{"tool":"advance_0","args":{"service":"svc_0"}}]"tool_plan-0.000095385/142full transcript →
nvidia/nemotron-3-super-120b-a12b✓PASSanswered "[{"tool":"advance_0","args":{"service":"svc_0"}}]"tool_plan-0.000096387/144full transcript →
nvidia/nemotron-3-super-120b-a12b✓PASSanswered "[{"tool":"advance_0","args":{"service":"svc_0"}}]"tool_plan-0.000098387/149full transcript →
nvidia/nemotron-3-super-120b-a12b✓PASSanswered "[{"tool":"advance_0","args":{"service":"svc_0"}},{"tool":..."tool_plan-0.000160434/278full transcript →
nvidia/nemotron-3-super-120b-a12b✓PASSanswered "[{"tool":"advance_0","args":{"service":"svc_0"}},{"tool":..."tool_plan-0.000120433/189full transcript →
nvidia/nemotron-3-super-120b-a12b✓PASSanswered "[{"tool":"advance_0","args":{"service":"svc_0"}},{"tool":..."tool_plan-0.000129431/211full transcript →
nvidia/nemotron-3-super-120b-a12b✓PASSanswered "[{"tool":"advance_0","args":{"service":"svc_0"}},{"tool":..."tool_plan-0.000139431/233full transcript →
nvidia/nemotron-3-super-120b-a12b✓PASSanswered "[{"tool":"advance_0","args":{"service":"svc_0"}},{"tool":..."tool_plan-0.000168435/295full transcript →
nvidia/nemotron-3-super-120b-a12b✓PASSanswered "[{"tool":"advance_0","args":{"service":"svc_0"}},{"tool":..."tool_plan-0.000207525/366full transcript →
nvidia/nemotron-3-super-120b-a12b✓PASSanswered "[{"tool":"advance_0","args":{"service":"svc_0"}},{"tool":..."tool_plan-0.000204524/361full transcript →
nvidia/nemotron-3-super-120b-a12b✓PASSanswered "[{"tool":"advance_0","args":{"service":"svc_0"}},{"tool":..."tool_plan-0.000209525/371full transcript →
nvidia/nemotron-3-super-120b-a12b✓PASSanswered "[{"tool":"advance_0","args":{"service":"svc_0"}},{"tool":..."tool_plan-0.000191526/332full transcript →
nvidia/nemotron-3-super-120b-a12b✓PASSanswered "[{"tool":"advance_0","args":{"service":"svc_0"}},{"tool":..."tool_plan-0.000216525/387full transcript →
nvidia/nemotron-3-super-120b-a12b✓PASSanswered "[{"tool":"advance_0","args":{"service":"svc_0"}},{"tool":..."tool_plan-0.000214526/381full transcript →
nvidia/nemotron-3-super-120b-a12b✓PASSanswered "[{"tool":"advance_0","args":{"service":"svc_0"}},{"tool":..."tool_plan-0.000246525/453full transcript →
nvidia/nemotron-3-super-120b-a12b✓PASSanswered "[{"tool":"advance_0","args":{"service":"svc_0"}},{"tool":..."tool_plan-0.000194527/338full transcript →
nvidia/nemotron-3-super-120b-a12b✓PASSanswered "[{"tool":"advance_0","args":{"service":"svc_0"}},{"tool":..."tool_plan-0.000183523/313full transcript →
nvidia/nemotron-3-super-120b-a12b✓PASSanswered "[{"tool":"advance_0","args":{"service":"svc_0"}},{"tool":..."tool_plan-0.000178527/302full transcript →
nvidia/nemotron-3-super-120b-a12b✓PASSanswered "[{"tool":"advance_0","args":{"service":"svc_0"}},{"tool":..."tool_plan-0.000216522/388full transcript →
nvidia/nemotron-3-super-120b-a12b✓PASSanswered "[{"tool":"advance_0","args":{"service":"svc_0"}},{"tool":..."tool_plan-0.000205526/363full transcript →
nvidia/nemotron-3-super-120b-a12b✓PASSanswered "[{"tool":"advance_0","args":{"service":"svc_0"}},{"tool":..."tool_plan-0.000243525/446full transcript →
nvidia/nemotron-3-super-120b-a12b✓PASSanswered "[{"tool":"advance_0","args":{"service":"svc_0"}},{"tool":..."tool_plan-0.000255527/472full transcript →
nvidia/nemotron-3-super-120b-a12b✓PASSanswered "[{"tool":"advance_0","args":{"service":"svc_0"}},{"tool":..."tool_plan-0.000207526/366full transcript →
nvidia/nemotron-3-super-120b-a12b✓PASSanswered "[{"tool":"advance_0","args":{"service":"svc_0"}}]"tool_plan-0.000086384/122full transcript →
nvidia/nemotron-3-super-120b-a12b✓PASSanswered "[{"tool":"advance_0","args":{"service":"svc_0"}}]"tool_plan-0.000089387/128full transcript →
nvidia/nemotron-3-super-120b-a12b✓PASSanswered "[{"tool": "advance_0", "args": {"service": "svc_0"}}]"tool_plan-0.000092386/135full transcript →
nvidia/nemotron-3-super-120b-a12b✓PASSanswered "[{"tool":"advance_0","args":{"service":"svc_0"}}]"tool_plan-0.000093383/139full transcript →
nvidia/nemotron-3-super-120b-a12b✓PASSanswered "[{"tool":"advance_0","args":{"service":"svc_0"}}]"tool_plan-0.000100384/155full transcript →
nvidia/nemotron-3-super-120b-a12b✓PASSanswered "[{"tool":"advance_0","args":{"service":"svc_0"}}]"tool_plan-0.000104425/155full transcript →
nvidia/nemotron-3-super-120b-a12b✓PASSanswered "[{"tool":"advance_0","args":{"service":"svc_0"}}]"tool_plan-0.000110469/160full transcript →
nvidia/nemotron-3-super-120b-a12b✓PASSanswered "[{"tool":"advance_0","args":{"service":"svc_0"}}]"tool_plan-0.000105471/150full transcript →
nvidia/nemotron-3-super-120b-a12b✓PASSanswered "[{"tool":"advance_0","args":{"service":"svc_0"}}]"tool_plan-0.000111428/170full transcript →
nvidia/nemotron-3-super-120b-a12b✓PASSanswered "[{"tool":"advance_0","args":{"service":"svc_0"}}]"tool_plan-0.000108426/165full transcript →
nvidia/nemotron-3-super-120b-a12b✓PASSanswered "[{"tool":"advance_0","args":{"service":"svc_0"}}]"tool_plan-0.000114425/178full transcript →
nvidia/nemotron-3-super-120b-a12b✓PASSanswered "[{"tool":"advance_0","args":{"service":"svc_0"}}]"tool_plan-0.000107424/163full transcript →
nvidia/nemotron-3-super-120b-a12b✓PASSanswered "[{"tool":"advance_0","args":{"service":"svc_0"}}]"tool_plan-0.000112471/165full transcript →
nvidia/nemotron-3-super-120b-a12b✓PASSanswered "[{"tool":"advance_0","args":{"service":"svc_0"}}]"tool_plan-0.000108472/155full transcript →
nvidia/nemotron-3-super-120b-a12b✓PASSanswered "[{"tool":"advance_0","args":{"service":"svc_0"}}]"tool_plan-0.000108469/157full transcript →