Run camp-noop-gemma4qat-002
PASSEDWhat this run revealed, then every individual trial as evidence.
40
Trials
100%
40/40 scored
over trials
Pass rate
0
Failures
$0.0014
Run cost
Run camp-noop-gemma4qat-002: passed essentially everything (100%) -- this test did not challenge the model.
Of 40 scored trials (state query kind), the model passed 100%. That's saturation: the difficulty range probed here isn't finding this model's limits. Consider a harder preset (breaking_point or adversarial_belief) or a wider dimension range.
Trials
Per-trial table
| model | verdict | kind | difficulty | cost ($) | tokens in/out | |
|---|---|---|---|---|---|---|
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "greenhouse" | state | - | 0.000025 | 236/3 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "Library" | state | - | 0.000024 | 238/2 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "Garage" | state | - | 0.000023 | 225/2 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "print room" | state | - | 0.000025 | 237/3 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "Boiler room" | state | - | 0.000025 | 237/4 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "Break room" | state | - | 0.000026 | 249/3 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "Server room" | state | - | 0.000027 | 260/3 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "Lobby" | state | - | 0.000027 | 261/3 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "Storage room" | state | - | 0.000028 | 266/3 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "utility closet" | state | - | 0.000028 | 267/3 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "Greenhouse" | state | - | 0.000030 | 293/3 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "Conference room" | state | - | 0.000029 | 281/3 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "Cafeteria" | state | - | 0.000029 | 278/4 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "Print room" | state | - | 0.000029 | 280/3 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "meditation room" | state | - | 0.000029 | 282/4 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "Kitchen" | state | - | 0.000035 | 339/2 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "Break room" | state | - | 0.000033 | 322/3 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "Photo studio" | state | - | 0.000034 | 332/3 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "rooftop terrace" | state | - | 0.000036 | 344/5 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "print room" | state | - | 0.000035 | 343/3 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "Security office" | state | - | 0.000037 | 358/3 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "Wine cellar" | state | - | 0.000036 | 356/3 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "North stairwell" | state | - | 0.000038 | 370/4 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "Photo studio" | state | - | 0.000037 | 363/3 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "Atrium" | state | - | 0.000038 | 374/3 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "Break room" | state | - | 0.000041 | 398/3 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "Observation deck" | state | - | 0.000042 | 406/3 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "reception area" | state | - | 0.000039 | 380/4 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "North stairwell" | state | - | 0.000041 | 401/4 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "Cafeteria" | state | - | 0.000041 | 397/4 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "Security office" | state | - | 0.000043 | 421/3 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "Garage" | state | - | 0.000040 | 397/2 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "storage room" | state | - | 0.000042 | 409/3 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "Break room" | state | - | 0.000042 | 413/3 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "cafeteria" | state | - | 0.000042 | 409/4 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "Reception area" | state | - | 0.000044 | 435/3 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "Conference room" | state | - | 0.000046 | 449/3 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "West wing" | state | - | 0.000041 | 398/3 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "Boiler room" | state | - | 0.000045 | 440/4 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "Meditation room" | state | - | 0.000045 | 433/4 | full transcript → |