Run camp-tool-confuse-super-001
PASSEDWhat this run revealed, then every individual trial as evidence.
56
Trials
100%
56/56 scored
over trials
Pass rate
0
Failures
$0.0296
Run cost
Run camp-tool-confuse-super-001: passed essentially everything (100%) -- this test did not challenge the model.
Of 56 scored trials (tool query kind), the model passed 100%. That's saturation: the difficulty range probed here isn't finding this model's limits. Consider a harder preset (breaking_point or adversarial_belief) or a wider dimension range.
Trials
Per-trial table
| model | verdict | kind | difficulty | cost ($) | tokens in/out | |
|---|---|---|---|---|---|---|
| nvidia/nemotron-3-super-120b-a12b | ✓PASSanswered "]" | tool_plan | - | 0.000395 | 716/751 | full transcript → |
| nvidia/nemotron-3-super-120b-a12b | ✓PASSanswered "[{"tool":"advance_0","args":{"service":"svc_0"}},{"tool":..." | tool_plan | - | 0.000327 | 716/600 | full transcript → |
| nvidia/nemotron-3-super-120b-a12b | ✓PASSanswered "[{"tool":"advance_0","args":{"service":"svc_0"}},{"tool":..." | tool_plan | - | 0.000441 | 709/853 | full transcript → |
| nvidia/nemotron-3-super-120b-a12b | ✓PASSanswered "[{"tool":"advance_0","args":{"service":"svc_0"}},{"tool":..." | tool_plan | - | 0.000456 | 715/886 | full transcript → |
| nvidia/nemotron-3-super-120b-a12b | ✓PASSanswered "[{"tool":"advance_0","args":{"service":"svc_0"}},{"tool":..." | tool_plan | - | 0.000450 | 718/872 | full transcript → |
| nvidia/nemotron-3-super-120b-a12b | ✓PASSanswered "]" | tool_plan | - | 0.000565 | 715/1128 | full transcript → |
| nvidia/nemotron-3-super-120b-a12b | ✓PASSanswered "[{"tool":"advance_0","args":{"service":"svc_0"}},{"tool":..." | tool_plan | - | 0.000391 | 719/742 | full transcript → |
| nvidia/nemotron-3-super-120b-a12b | ✓PASSanswered "]" | tool_plan | - | 0.000403 | 1044/709 | full transcript → |
| nvidia/nemotron-3-super-120b-a12b | ✓PASSanswered "[{"tool":"advance_0","args":{"service":"svc_0"}},{"tool":..." | tool_plan | - | 0.000418 | 1049/743 | full transcript → |
| nvidia/nemotron-3-super-120b-a12b | ✓PASSanswered "[{"tool":"advance_0","args":{"service":"svc_0"}},{"tool":..." | tool_plan | - | 0.000442 | 1050/795 | full transcript → |
| nvidia/nemotron-3-super-120b-a12b | ✓PASSanswered "]" | tool_plan | - | 0.000508 | 1050/943 | full transcript → |
| nvidia/nemotron-3-super-120b-a12b | ✓PASSanswered "]" | tool_plan | - | 0.000555 | 1042/1047 | full transcript → |
| nvidia/nemotron-3-super-120b-a12b | ✓PASSanswered "]" | tool_plan | - | 0.000503 | 1034/934 | full transcript → |
| nvidia/nemotron-3-super-120b-a12b | ✓PASSanswered "]" | tool_plan | - | 0.000621 | 1055/1192 | full transcript → |
| nvidia/nemotron-3-super-120b-a12b | ✓PASSanswered "]" | tool_plan | - | 0.000458 | 1367/775 | full transcript → |
| nvidia/nemotron-3-super-120b-a12b | ✓PASSanswered "]" | tool_plan | - | 0.000527 | 1337/934 | full transcript → |
| nvidia/nemotron-3-super-120b-a12b | ✓PASSanswered "]" | tool_plan | - | 0.000429 | 1348/714 | full transcript → |
| nvidia/nemotron-3-super-120b-a12b | ✓PASSanswered "[{"tool":"advance_0","args":{"service":"svc_0"}},{"tool":..." | tool_plan | - | 0.000437 | 1356/729 | full transcript → |
| nvidia/nemotron-3-super-120b-a12b | ✓PASSanswered "]" | tool_plan | - | 0.000494 | 1330/862 | full transcript → |
| nvidia/nemotron-3-super-120b-a12b | ✓PASSanswered "]" | tool_plan | - | 0.000516 | 1335/909 | full transcript → |
| nvidia/nemotron-3-super-120b-a12b | ✓PASSanswered "[{"tool":"advance_0","args":{"service":"svc_0"}},{"tool":..." | tool_plan | - | 0.000502 | 1335/878 | full transcript → |
| nvidia/nemotron-3-super-120b-a12b | ✓PASSanswered "]" | tool_plan | - | 0.000466 | 1686/735 | full transcript → |
| nvidia/nemotron-3-super-120b-a12b | ✓PASSanswered "]" | tool_plan | - | 0.000479 | 1711/760 | full transcript → |
| nvidia/nemotron-3-super-120b-a12b | ✓PASSanswered "]" | tool_plan | - | 0.000481 | 1664/773 | full transcript → |
| nvidia/nemotron-3-super-120b-a12b | ✓PASSanswered "]" | tool_plan | - | 0.000559 | 1700/940 | full transcript → |
| nvidia/nemotron-3-super-120b-a12b | ✓PASSanswered "]" | tool_plan | - | 0.000569 | 1678/966 | full transcript → |
| nvidia/nemotron-3-super-120b-a12b | ✓PASSanswered "[{"tool":"advance_0","args":{"service":"svc_0"}},{"tool":..." | tool_plan | - | 0.000569 | 1669/968 | full transcript → |
| nvidia/nemotron-3-super-120b-a12b | ✓PASSanswered "]" | tool_plan | - | 0.000482 | 1678/773 | full transcript → |
| nvidia/nemotron-3-super-120b-a12b | ✓PASSanswered "[{"tool":"advance_0","args":{"service":"svc_0"}},{"tool":..." | tool_plan | - | 0.000460 | 2025/663 | full transcript → |
| nvidia/nemotron-3-super-120b-a12b | ✓PASSanswered "[{"tool":"advance_0","args":{"service":"svc_0"}},{"tool":..." | tool_plan | - | 0.000508 | 1999/773 | full transcript → |
| nvidia/nemotron-3-super-120b-a12b | ✓PASSanswered "]" | tool_plan | - | 0.000562 | 2009/892 | full transcript → |
| nvidia/nemotron-3-super-120b-a12b | ✓PASSanswered "[{"tool":"advance_0","args":{"service":"svc_0"}},{"tool":..." | tool_plan | - | 0.000540 | 2020/841 | full transcript → |
| nvidia/nemotron-3-super-120b-a12b | ✓PASSanswered "]" | tool_plan | - | 0.000562 | 1990/894 | full transcript → |
| nvidia/nemotron-3-super-120b-a12b | ✓PASSanswered "]" | tool_plan | - | 0.000622 | 2009/1024 | full transcript → |
| nvidia/nemotron-3-super-120b-a12b | ✓PASSanswered "]" | tool_plan | - | 0.000487 | 2026/723 | full transcript → |
| nvidia/nemotron-3-super-120b-a12b | ✓PASSanswered "]" | tool_plan | - | 0.000497 | 2371/682 | full transcript → |
| nvidia/nemotron-3-super-120b-a12b | ✓PASSanswered "]" | tool_plan | - | 0.000546 | 2388/788 | full transcript → |
| nvidia/nemotron-3-super-120b-a12b | ✓PASSanswered "]" | tool_plan | - | 0.000576 | 2344/863 | full transcript → |
| nvidia/nemotron-3-super-120b-a12b | ✓PASSanswered "]" | tool_plan | - | 0.000571 | 2423/838 | full transcript → |
| nvidia/nemotron-3-super-120b-a12b | ✓PASSanswered "[{"tool":"advance_0","args":{"service":"svc_0"}},{"tool":..." | tool_plan | - | 0.000616 | 2344/953 | full transcript → |
| nvidia/nemotron-3-super-120b-a12b | ✓PASSanswered "]" | tool_plan | - | 0.000671 | 2345/1075 | full transcript → |
| nvidia/nemotron-3-super-120b-a12b | ✓PASSanswered "]" | tool_plan | - | 0.000613 | 2387/937 | full transcript → |
| nvidia/nemotron-3-super-120b-a12b | ✓PASSanswered "]" | tool_plan | - | 0.000562 | 2666/774 | full transcript → |
| nvidia/nemotron-3-super-120b-a12b | ✓PASSanswered "]" | tool_plan | - | 0.000546 | 2635/745 | full transcript → |
| nvidia/nemotron-3-super-120b-a12b | ✓PASSanswered "[{"tool":"advance_0","args":{"service":"svc_0"}},{"tool":..." | tool_plan | - | 0.000593 | 2688/839 | full transcript → |
| nvidia/nemotron-3-super-120b-a12b | ✓PASSanswered "[{"tool":"advance_0","args":{"service":"svc_0"}},{"tool":..." | tool_plan | - | 0.000619 | 2700/896 | full transcript → |
| nvidia/nemotron-3-super-120b-a12b | ✓PASSanswered "]" | tool_plan | - | 0.000581 | 2654/819 | full transcript → |
| nvidia/nemotron-3-super-120b-a12b | ✓PASSanswered "[{"tool":"advance_0","args":{"service":"svc_0"}},{"tool":..." | tool_plan | - | 0.000613 | 2633/895 | full transcript → |
| nvidia/nemotron-3-super-120b-a12b | ✓PASSanswered "]" | tool_plan | - | 0.000710 | 2709/1097 | full transcript → |
| nvidia/nemotron-3-super-120b-a12b | ✓PASSanswered "]" | tool_plan | - | 0.000529 | 2863/666 | full transcript → |
| nvidia/nemotron-3-super-120b-a12b | ✓PASSanswered "]" | tool_plan | - | 0.000581 | 2940/768 | full transcript → |
| nvidia/nemotron-3-super-120b-a12b | ✓PASSanswered "]" | tool_plan | - | 0.000571 | 2868/759 | full transcript → |
| nvidia/nemotron-3-super-120b-a12b | ✓PASSanswered "[{"tool":"advance_0","args":{"service":"svc_0"}},{"tool":..." | tool_plan | - | 0.000592 | 2916/797 | full transcript → |
| nvidia/nemotron-3-super-120b-a12b | ✓PASSanswered "]" | tool_plan | - | 0.000610 | 2861/846 | full transcript → |
| nvidia/nemotron-3-super-120b-a12b | ✓PASSanswered "]" | tool_plan | - | 0.000656 | 2875/947 | full transcript → |
| nvidia/nemotron-3-super-120b-a12b | ✓PASSanswered "]" | tool_plan | - | 0.000601 | 2898/820 | full transcript → |