Data to …… trials

Run camp-irrelevance-gemma4qat-002

PASSED

What this run revealed, then every individual trial as evidence.

14
Trials
100%
14/14 scored
over trials
Pass rate
0
0%
Failures
$0.0015
Run cost

Run camp-irrelevance-gemma4qat-002: passed essentially everything (100%) -- this test did not challenge the model.

Of 14 scored trials (tool query kind), the model passed 100%. That's saturation: the difficulty range probed here isn't finding this model's limits. Consider a harder preset (breaking_point or adversarial_belief) or a wider dimension range.

Trials14 trials
Per-trial table (14 trials -- prompt, reasoning, verdict, answer key)
modelverdictkinddifficultycost ($)tokens in/out
gemma-4-31b-it-qat-w4a16-ct✓PASSanswered "[]"tool_plan-0.000079782/2full transcript →
gemma-4-31b-it-qat-w4a16-ct✓PASSanswered "[]"tool_plan-0.000078772/2full transcript →
gemma-4-31b-it-qat-w4a16-ct✓PASSanswered "]"tool_plan-0.000125826/141full transcript →
gemma-4-31b-it-qat-w4a16-ct✓PASSanswered "]"tool_plan-0.000125822/141full transcript →
gemma-4-31b-it-qat-w4a16-ct✓PASSanswered "]"tool_plan-0.000125826/141full transcript →
gemma-4-31b-it-qat-w4a16-ct✓PASSanswered "]"tool_plan-0.000125822/141full transcript →
gemma-4-31b-it-qat-w4a16-ct✓PASSanswered "[]"tool_plan-0.000079781/2full transcript →
gemma-4-31b-it-qat-w4a16-ct✓PASSanswered "[]"tool_plan-0.000077761/2full transcript →
gemma-4-31b-it-qat-w4a16-ct✓PASSanswered "[]"tool_plan-0.000079781/2full transcript →
gemma-4-31b-it-qat-w4a16-ct✓PASSanswered "]"tool_plan-0.000125824/141full transcript →
gemma-4-31b-it-qat-w4a16-ct✓PASSanswered "]"tool_plan-0.000125822/141full transcript →
gemma-4-31b-it-qat-w4a16-ct✓PASSanswered "[]"tool_plan-0.000077760/2full transcript →
gemma-4-31b-it-qat-w4a16-ct✓PASSanswered "[{"tool": "advance_0", "args": {"service": "svc_0"}}, {"t..."tool_plan-0.000121822/128full transcript →
gemma-4-31b-it-qat-w4a16-ct✓PASSanswered "]"tool_plan-0.000125825/141full transcript →