Data to …… trials

Run camp-tool_planning-gemma4qat-001

PASSED

What this run revealed, then every individual trial as evidence.

watch live →compare across models →
105
Trials
100%
105/105 scored
over trials
Pass rate
0
0%
Failures
$0.0074
Run cost

Run camp-tool_planning-gemma4qat-001: passed essentially everything (100%) -- this test did not challenge the model.

Of 105 scored trials (tool query kind), the model passed 100%. That's saturation: the difficulty range probed here isn't finding this model's limits. Consider a harder preset (breaking_point or adversarial_belief) or a wider dimension range.

Trials105 trials
Per-trial table (105 trials -- prompt, reasoning, verdict, answer key)
modelverdictkinddifficultycost ($)tokens in/out
gemma-4-31b-it-qat-w4a16-ct✓PASSanswered "]"tool_plan-0.000051393/39full transcript →
gemma-4-31b-it-qat-w4a16-ct✓PASSanswered "]"tool_plan-0.000050387/39full transcript →
gemma-4-31b-it-qat-w4a16-ct✓PASSanswered "]"tool_plan-0.000051389/39full transcript →
gemma-4-31b-it-qat-w4a16-ct✓PASSanswered "]"tool_plan-0.000050387/39full transcript →
gemma-4-31b-it-qat-w4a16-ct✓PASSanswered "[{"tool": "advance_0", "args": {"service": "svc_0"}}]"tool_plan-0.000045387/22full transcript →
gemma-4-31b-it-qat-w4a16-ct✓PASSanswered "]"tool_plan-0.000057432/47full transcript →
gemma-4-31b-it-qat-w4a16-ct✓PASSanswered "]"tool_plan-0.000057434/47full transcript →
gemma-4-31b-it-qat-w4a16-ct✓PASSanswered "]"tool_plan-0.000065432/74full transcript →
gemma-4-31b-it-qat-w4a16-ct✓PASSanswered "]"tool_plan-0.000057433/47full transcript →
gemma-4-31b-it-qat-w4a16-ct✓PASSanswered "]"tool_plan-0.000057432/47full transcript →
gemma-4-31b-it-qat-w4a16-ct✓PASSanswered "]"tool_plan-0.000080524/91full transcript →
gemma-4-31b-it-qat-w4a16-ct✓PASSanswered "]"tool_plan-0.000080524/91full transcript →
gemma-4-31b-it-qat-w4a16-ct✓PASSanswered "]"tool_plan-0.000080524/91full transcript →
gemma-4-31b-it-qat-w4a16-ct✓PASSanswered "]"tool_plan-0.000080524/91full transcript →
gemma-4-31b-it-qat-w4a16-ct✓PASSanswered "]"tool_plan-0.000080524/91full transcript →
gemma-4-31b-it-qat-w4a16-ct✓PASSanswered "]"tool_plan-0.000096606/119full transcript →
gemma-4-31b-it-qat-w4a16-ct✓PASSanswered "]"tool_plan-0.000097613/119full transcript →
gemma-4-31b-it-qat-w4a16-ct✓PASSanswered "]"tool_plan-0.000096607/119full transcript →
gemma-4-31b-it-qat-w4a16-ct✓PASSanswered "]"tool_plan-0.000096606/119full transcript →
gemma-4-31b-it-qat-w4a16-ct✓PASSanswered "]"tool_plan-0.000096606/119full transcript →
gemma-4-31b-it-qat-w4a16-ct✓PASSanswered "]"tool_plan-0.000112683/147full transcript →
gemma-4-31b-it-qat-w4a16-ct✓PASSanswered "]"tool_plan-0.000112681/147full transcript →
gemma-4-31b-it-qat-w4a16-ct✓PASSanswered "]"tool_plan-0.000112684/147full transcript →
gemma-4-31b-it-qat-w4a16-ct✓PASSanswered "]"tool_plan-0.000112684/147full transcript →
gemma-4-31b-it-qat-w4a16-ct✓PASSanswered "]"tool_plan-0.000112681/147full transcript →
gemma-4-31b-it-qat-w4a16-ct✓PASSanswered "[{"tool": "advance_0", "args": {"service": "svc_0"}}]"tool_plan-0.000045387/22full transcript →
gemma-4-31b-it-qat-w4a16-ct✓PASSanswered "]"tool_plan-0.000050387/39full transcript →
gemma-4-31b-it-qat-w4a16-ct✓PASSanswered "]"tool_plan-0.000050387/39full transcript →
gemma-4-31b-it-qat-w4a16-ct✓PASSanswered "]"tool_plan-0.000051390/39full transcript →
gemma-4-31b-it-qat-w4a16-ct✓PASSanswered "[{"tool": "advance_0", "args": {"service": "svc_0"}}]"tool_plan-0.000045387/22full transcript →
gemma-4-31b-it-qat-w4a16-ct✓PASSanswered "[{"tool": "advance_0", "args": {"service": "svc_0"}}]"tool_plan-0.000049428/22full transcript →
gemma-4-31b-it-qat-w4a16-ct✓PASSanswered "[{"tool": "advance_0", "args": {"service": "svc_0"}}]"tool_plan-0.000050432/22full transcript →
gemma-4-31b-it-qat-w4a16-ct✓PASSanswered "[{"tool": "advance_0", "args": {"service": "svc_0"}}]"tool_plan-0.000050430/22full transcript →
gemma-4-31b-it-qat-w4a16-ct✓PASSanswered "[{"tool": "advance_0", "args": {"service": "svc_0"}}]"tool_plan-0.000049428/22full transcript →
gemma-4-31b-it-qat-w4a16-ct✓PASSanswered "[{"tool": "advance_0", "args": {"service": "svc_0"}}]"tool_plan-0.000050432/22full transcript →
gemma-4-31b-it-qat-w4a16-ct✓PASSanswered "[{"tool": "advance_0", "args": {"service": "svc_0"}}]"tool_plan-0.000054472/22full transcript →
gemma-4-31b-it-qat-w4a16-ct✓PASSanswered "[{"tool": "advance_0", "args": {"service": "svc_0"}}]"tool_plan-0.000054476/22full transcript →
gemma-4-31b-it-qat-w4a16-ct✓PASSanswered "[{"tool": "advance_0", "args": {"service": "svc_0"}}]"tool_plan-0.000054472/22full transcript →
gemma-4-31b-it-qat-w4a16-ct✓PASSanswered "[{"tool": "advance_0", "args": {"service": "svc_0"}}]"tool_plan-0.000054472/22full transcript →
gemma-4-31b-it-qat-w4a16-ct✓PASSanswered "[{"tool": "advance_0", "args": {"service": "svc_0"}}]"tool_plan-0.000054476/22full transcript →
gemma-4-31b-it-qat-w4a16-ct✓PASSanswered "[{"tool": "advance_0", "args": {"service": "svc_0"}}]"tool_plan-0.000062554/22full transcript →
gemma-4-31b-it-qat-w4a16-ct✓PASSanswered "[{"tool": "advance_0", "args": {"service": "svc_0"}}]"tool_plan-0.000063560/22full transcript →
gemma-4-31b-it-qat-w4a16-ct✓PASSanswered "[{"tool": "advance_0", "args": {"service": "svc_0"}}]"tool_plan-0.000062554/22full transcript →
gemma-4-31b-it-qat-w4a16-ct✓PASSanswered "[{"tool": "advance_0", "args": {"service": "svc_0"}}]"tool_plan-0.000062558/22full transcript →
gemma-4-31b-it-qat-w4a16-ct✓PASSanswered "[{"tool": "advance_0", "args": {"service": "svc_0"}}]"tool_plan-0.000062554/22full transcript →
gemma-4-31b-it-qat-w4a16-ct✓PASSanswered "[{"tool": "advance_0", "args": {"service": "svc_0"}}]"tool_plan-0.000066597/22full transcript →
gemma-4-31b-it-qat-w4a16-ct✓PASSanswered "[{"tool": "advance_0", "args": {"service": "svc_0"}}]"tool_plan-0.000066597/22full transcript →
gemma-4-31b-it-qat-w4a16-ct✓PASSanswered "[{"tool": "advance_0", "args": {"service": "svc_0"}}]"tool_plan-0.000066597/22full transcript →
gemma-4-31b-it-qat-w4a16-ct✓PASSanswered "[{"tool": "advance_0", "args": {"service": "svc_0"}}]"tool_plan-0.000067601/22full transcript →
gemma-4-31b-it-qat-w4a16-ct✓PASSanswered "[{"tool": "advance_0", "args": {"service": "svc_0"}}]"tool_plan-0.000066597/22full transcript →
gemma-4-31b-it-qat-w4a16-ct✓PASSanswered "]"tool_plan-0.000050387/39full transcript →
gemma-4-31b-it-qat-w4a16-ct✓PASSanswered "[{"tool": "advance_0", "args": {"service": "svc_0"}}]"tool_plan-0.000045387/22full transcript →
gemma-4-31b-it-qat-w4a16-ct✓PASSanswered "]"tool_plan-0.000051390/39full transcript →
gemma-4-31b-it-qat-w4a16-ct✓PASSanswered "]"tool_plan-0.000050387/39full transcript →
gemma-4-31b-it-qat-w4a16-ct✓PASSanswered "]"tool_plan-0.000050387/39full transcript →
gemma-4-31b-it-qat-w4a16-ct✓PASSanswered "]"tool_plan-0.000085554/97full transcript →
gemma-4-31b-it-qat-w4a16-ct✓PASSanswered "]"tool_plan-0.000084550/97full transcript →
gemma-4-31b-it-qat-w4a16-ct✓PASSanswered "]"tool_plan-0.000084550/97full transcript →
gemma-4-31b-it-qat-w4a16-ct✓PASSanswered "]"tool_plan-0.000084550/97full transcript →
gemma-4-31b-it-qat-w4a16-ct✓PASSanswered "]"tool_plan-0.000084550/97full transcript →
gemma-4-31b-it-qat-w4a16-ct✓PASSanswered "]"tool_plan-0.000101646/121full transcript →
gemma-4-31b-it-qat-w4a16-ct✓PASSanswered "]"tool_plan-0.000101642/121full transcript →
gemma-4-31b-it-qat-w4a16-ct✓PASSanswered "]"tool_plan-0.000101642/121full transcript →
gemma-4-31b-it-qat-w4a16-ct✓PASSanswered "]"tool_plan-0.000101642/121full transcript →
gemma-4-31b-it-qat-w4a16-ct✓PASSanswered "]"tool_plan-0.000101642/121full transcript →
gemma-4-31b-it-qat-w4a16-ct✓PASSanswered "[{"tool": "advance_0", "args": {"service": "svc_0"}}]"tool_plan-0.000045387/22full transcript →
gemma-4-31b-it-qat-w4a16-ct✓PASSanswered "]"tool_plan-0.000051392/39full transcript →
gemma-4-31b-it-qat-w4a16-ct✓PASSanswered "]"tool_plan-0.000050387/39full transcript →
gemma-4-31b-it-qat-w4a16-ct✓PASSanswered "]"tool_plan-0.000051389/39full transcript →
gemma-4-31b-it-qat-w4a16-ct✓PASSanswered "[{"tool": "advance_0", "args": {"service": "svc_0"}}]"tool_plan-0.000046398/22full transcript →
gemma-4-31b-it-qat-w4a16-ct✓PASSanswered "]"tool_plan-0.000050387/39full transcript →
gemma-4-31b-it-qat-w4a16-ct✓PASSanswered "[{"tool": "advance_0", "args": {"service": "svc_0"}}]"tool_plan-0.000046396/22full transcript →
gemma-4-31b-it-qat-w4a16-ct✓PASSanswered "]"tool_plan-0.000052407/39full transcript →
gemma-4-31b-it-qat-w4a16-ct✓PASSanswered "[{"tool": "advance_0", "args": {"service": "svc_0"}}]"tool_plan-0.000047407/22full transcript →
gemma-4-31b-it-qat-w4a16-ct✓PASSanswered "]"tool_plan-0.000051393/39full transcript →
gemma-4-31b-it-qat-w4a16-ct✓PASSanswered "]"tool_plan-0.000051397/39full transcript →
gemma-4-31b-it-qat-w4a16-ct✓PASSanswered "[{"tool": "advance_0", "args": {"service": "svc_0"}}]"tool_plan-0.000047403/22full transcript →
gemma-4-31b-it-qat-w4a16-ct✓PASSanswered "]"tool_plan-0.000052403/39full transcript →
gemma-4-31b-it-qat-w4a16-ct✓PASSanswered "]"tool_plan-0.000052407/39full transcript →
gemma-4-31b-it-qat-w4a16-ct✓PASSanswered "]"tool_plan-0.000053415/39full transcript →
gemma-4-31b-it-qat-w4a16-ct✓PASSanswered "]"tool_plan-0.000052403/39full transcript →
gemma-4-31b-it-qat-w4a16-ct✓PASSanswered "[{"tool": "advance_0", "args": {"service": "svc_0"}}]"tool_plan-0.000047407/22full transcript →
gemma-4-31b-it-qat-w4a16-ct✓PASSanswered "]"tool_plan-0.000053412/39full transcript →
gemma-4-31b-it-qat-w4a16-ct✓PASSanswered "]"tool_plan-0.000054418/39full transcript →
gemma-4-31b-it-qat-w4a16-ct✓PASSanswered "]"tool_plan-0.000053414/39full transcript →
gemma-4-31b-it-qat-w4a16-ct✓PASSanswered "]"tool_plan-0.000054419/39full transcript →
gemma-4-31b-it-qat-w4a16-ct✓PASSanswered "]"tool_plan-0.000054419/39full transcript →
gemma-4-31b-it-qat-w4a16-ct✓PASSanswered "[{"tool": "advance_0", "args": {"service": "svc_0"}}]"tool_plan-0.000049421/22full transcript →
gemma-4-31b-it-qat-w4a16-ct✓PASSanswered "[{"tool": "advance_0", "args": {"service": "svc_0"}}]"tool_plan-0.000048419/22full transcript →
gemma-4-31b-it-qat-w4a16-ct✓PASSanswered "]"tool_plan-0.000054419/39full transcript →
gemma-4-31b-it-qat-w4a16-ct✓PASSanswered "]"tool_plan-0.000050387/39full transcript →
gemma-4-31b-it-qat-w4a16-ct✓PASSanswered "]"tool_plan-0.000051393/39full transcript →
gemma-4-31b-it-qat-w4a16-ct✓PASSanswered "]"tool_plan-0.000050387/39full transcript →
gemma-4-31b-it-qat-w4a16-ct✓PASSanswered "]"tool_plan-0.000050387/39full transcript →
gemma-4-31b-it-qat-w4a16-ct✓PASSanswered "]"tool_plan-0.000050387/39full transcript →
gemma-4-31b-it-qat-w4a16-ct✓PASSanswered "]"tool_plan-0.000057427/47full transcript →
gemma-4-31b-it-qat-w4a16-ct✓PASSanswered "]"tool_plan-0.000057427/47full transcript →
gemma-4-31b-it-qat-w4a16-ct✓PASSanswered "]"tool_plan-0.000057427/47full transcript →
gemma-4-31b-it-qat-w4a16-ct✓PASSanswered "]"tool_plan-0.000057431/47full transcript →
gemma-4-31b-it-qat-w4a16-ct✓PASSanswered "]"tool_plan-0.000057427/47full transcript →
gemma-4-31b-it-qat-w4a16-ct✓PASSanswered "]"tool_plan-0.0002111244/287full transcript →
gemma-4-31b-it-qat-w4a16-ct✓PASSanswered "]"tool_plan-0.0002101236/287full transcript →
gemma-4-31b-it-qat-w4a16-ct✓PASSanswered "]"tool_plan-0.0002101236/287full transcript →
gemma-4-31b-it-qat-w4a16-ct✓PASSanswered "]"tool_plan-0.0002101237/287full transcript →
gemma-4-31b-it-qat-w4a16-ct✓PASSanswered "]"tool_plan-0.0002101236/287full transcript →