Run camp-interactive-fault-gemma4qat-003
PASSEDWhat this run revealed, then every individual trial as evidence.
21
5 errors
Trials
100%
16/16 scored
over trials
Pass rate
0
Failures
$0.0089
Run cost
Run camp-interactive-fault-gemma4qat-003: passed essentially everything (100%) -- this test did not challenge the model.
Of 16 scored trials (interactive query kind), the model passed 100%. That's saturation: the difficulty range probed here isn't finding this model's limits. Consider a harder preset (breaking_point or adversarial_belief) or a wider dimension range.
5 additional trial(s) ended in ERROR (infra failures, cost cap, or cancellation) and are excluded from the pass rate above.
Trials
Per-trial table
| model | verdict | kind | difficulty | cost ($) | tokens in/out | |
|---|---|---|---|---|---|---|
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "[{"step": 1, "tool": "advance_0", "args": {"service": "sv..." | interactive | - | 0.000467 | 3417/418 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "[{"step": 1, "tool": "advance_0", "args": {"service": "sv..." | interactive | - | 0.000467 | 3417/418 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "[{"step": 1, "tool": "advance_0", "args": {"service": "sv..." | interactive | - | 0.000467 | 3417/418 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✕ERRORtimeout | interactive | - | 0.000000 | 0/0 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✕ERRORtimeout | interactive | - | 0.000000 | 0/0 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✕ERRORtimeout | interactive | - | 0.000000 | 0/0 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✕ERRORtimeout | interactive | - | 0.000000 | 0/0 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✕ERRORtimeout | interactive | - | 0.000000 | 0/0 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "[{"step": 1, "tool": "advance_0", "args": {"service": "sv..." | interactive | - | 0.000544 | 3845/532 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "[{"step": 1, "tool": "advance_0", "args": {"service": "sv..." | interactive | - | 0.000467 | 3417/418 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "[{"step": 1, "tool": "advance_0", "args": {"service": "sv..." | interactive | - | 0.000649 | 5406/362 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "[{"step": 1, "tool": "advance_0", "args": {"service": "sv..." | interactive | - | 0.000649 | 5400/362 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "[{"step": 1, "tool": "advance_0", "args": {"service": "sv..." | interactive | - | 0.000730 | 6044/417 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "[{"step": 1, "tool": "advance_0", "args": {"service": "sv..." | interactive | - | 0.000730 | 6044/417 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "[{"step": 1, "tool": "advance_0", "args": {"service": "sv..." | interactive | - | 0.000730 | 6044/417 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "[{"step": 1, "tool": "advance_0", "args": {"service": "sv..." | interactive | - | 0.000544 | 3847/532 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "[{"step": 1, "tool": "advance_0", "args": {"service": "sv..." | interactive | - | 0.000544 | 3841/532 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "[{"step": 1, "tool": "advance_0", "args": {"service": "sv..." | interactive | - | 0.000540 | 3839/522 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "[{"step": 1, "tool": "advance_0", "args": {"service": "sv..." | interactive | - | 0.000467 | 3417/418 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "[{"step": 1, "tool": "advance_0", "args": {"service": "sv..." | interactive | - | 0.000467 | 3417/418 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "[{"step": 1, "tool": "advance_0", "args": {"service": "sv..." | interactive | - | 0.000468 | 3425/418 | full transcript → |