Run camp-interactive-lookalike-gemma4qat-002
PASSEDWhat this run revealed, then every individual trial as evidence.
15
2 errors
Trials
100%
13/13 scored
over trials
Pass rate
0
Failures
$0.0448
Run cost
Run camp-interactive-lookalike-gemma4qat-002: passed essentially everything (100%) -- this test did not challenge the model.
Of 13 scored trials (interactive query kind), the model passed 100%. That's saturation: the difficulty range probed here isn't finding this model's limits. Consider a harder preset (breaking_point or adversarial_belief) or a wider dimension range.
2 additional trial(s) ended in ERROR (infra failures, cost cap, or cancellation) and are excluded from the pass rate above.
Trials
Per-trial table
| model | verdict | kind | difficulty | cost ($) | tokens in/out | |
|---|---|---|---|---|---|---|
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "[{"step": 1, "tool": "adva_nce_0", "args": {"service": "s..." | interactive | - | 0.000201 | 1497/172 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "[{"step": 1, "tool": "adva-nce_0", "args": {"service": "s..." | interactive | - | 0.000252 | 1500/340 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "[{"step": 1, "tool": "adva-nce_0", "args": {"service": "s..." | interactive | - | 0.000251 | 1494/340 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "[{"step": 1, "tool": "advance_o0", "args": {"service": "s..." | interactive | - | 0.000297 | 2236/246 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "[{"step": 1, "tool": "adva_nce_0", "args": {"service": "s..." | interactive | - | 0.000298 | 2237/246 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✕ERRORtimeout | interactive | - | 0.000230 | 2233/21 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "[{"step": 1, "tool": "advance_o0", "args": {"service": "s..." | interactive | - | 0.004664 | 45621/341 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "[{"step": 1, "tool": "adva_nce_0", "args": {"service": "s..." | interactive | - | 0.004631 | 45307/334 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "[{"step": 1, "tool": "advance_o0", "args": {"service": "s..." | interactive | - | 0.004630 | 45293/334 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "[{"step": 1, "tool": "advance_o0", "args": {"service": "s..." | interactive | - | 0.008154 | 80211/444 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "[{"step": 1, "tool": "set_-flag_0", "args": {"flag": "fla..." | interactive | - | 0.008192 | 80602/441 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "[{"step": 1, "tool": "advance_o0", "args": {"service": "s..." | interactive | - | 0.000539 | 4015/458 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "[{"step": 1, "tool": "advance_o0", "args": {"service": "s..." | interactive | - | 0.000654 | 5005/511 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "[{"step": 1, "tool": "adva-nce_0", "args": {"service": "s..." | interactive | - | 0.011809 | 116480/538 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✕ERRORtimeout | interactive | - | 0.000000 | 0/0 | full transcript → |