Run camp-full_map-gemma4qat-001/state
PASSEDWhat this run revealed, then every individual trial as evidence.
30
Trials
100%
30/30 scored
over trials
Pass rate
0
Failures
$0.0013
Run cost
Run camp-full_map-gemma4qat-001/state: passed essentially everything (100%) -- this test did not challenge the model.
Of 30 scored trials (state query kind), the model passed 100%. That's saturation: the difficulty range probed here isn't finding this model's limits. Consider a harder preset (breaking_point or adversarial_belief) or a wider dimension range.
Trials
Per-trial table
| model | verdict | kind | difficulty | cost ($) | tokens in/out | |
|---|---|---|---|---|---|---|
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "utility closet" | state | - | 0.000014 | 132/3 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "Courtyard" | state | - | 0.000014 | 129/3 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "storage room" | state | - | 0.000014 | 129/3 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "Boiler room" | state | - | 0.000027 | 260/4 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "Courtyard" | state | - | 0.000014 | 126/3 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "photo studio" | state | - | 0.000014 | 129/3 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "Storage room" | state | - | 0.000026 | 248/3 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "observation deck" | state | - | 0.000026 | 253/3 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "Cafeteria" | state | - | 0.000026 | 251/4 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "Boiler room" | state | - | 0.000027 | 253/4 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "loading dock" | state | - | 0.000038 | 375/3 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "east wing" | state | - | 0.000039 | 380/3 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "mail room" | state | - | 0.000038 | 375/3 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "Cafeteria" | state | - | 0.000040 | 384/4 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "south stairwell" | state | - | 0.000040 | 392/4 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "archive room" | state | - | 0.000051 | 496/3 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "West wing" | state | - | 0.000051 | 497/3 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "atrium" | state | - | 0.000050 | 492/3 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "mail room" | state | - | 0.000052 | 515/3 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "print room" | state | - | 0.000052 | 508/3 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "storage room" | state | - | 0.000064 | 631/3 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "rooftop terrace" | state | - | 0.000064 | 621/5 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "photo studio" | state | - | 0.000063 | 621/3 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "Photo studio" | state | - | 0.000065 | 645/3 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "east wing" | state | - | 0.000064 | 634/3 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "supply closet" | state | - | 0.000064 | 630/3 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "cafeteria" | state | - | 0.000065 | 636/4 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "print room" | state | - | 0.000063 | 623/3 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "photo studio" | state | - | 0.000063 | 626/3 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "south stairwell" | state | - | 0.000063 | 619/4 | full transcript → |