Run camp-ef-belief-gemma4qat-001/B
37% PASSWhat this run revealed, then every individual trial as evidence.
30
Trials
37%
11/30 scored
over trials
Pass rate
19
Failures
$0.0010
Run cost
Run camp-ef-belief-gemma4qat-001/B: 37% pass rate on belief queries.
Of 30 scored trials (belief query kind), the model passed 37% and failed 63%.
19 failure(s) recorded; failures not yet verified -- use "Verify failures" on this page (or scripts/verify_past_failures.py).
In 16 of 19 classifiable belief failures the model reported where the object ACTUALLY was, not where the queried entity BELIEVED it was -- it collapsed their perspective into reality.
Notable failures
- record 02cf5b79 expected: the supply closetactual: west wing
- record 5cbcc354 expected: the boiler roomactual: utility closet
- record be2c3fa3 expected: the archive roomactual: security office
Trials
Per-trial table
| model | verdict | kind | difficulty | cost ($) | tokens in/out | |
|---|---|---|---|---|---|---|
| gemma-4-31b-it-qat-w4a16-ct | ?FAILanswered "west wing"unverified | belief | - | 0.000032 | 315/3 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "north stairwell" | belief | - | 0.000036 | 343/4 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "kitchen" | belief | - | 0.000034 | 329/2 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "storage room" | belief | - | 0.000036 | 353/3 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ?FAILanswered "utility closet"unverified | belief | - | 0.000034 | 328/3 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ?FAILanswered "security office"unverified | belief | - | 0.000035 | 344/3 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ?FAILanswered "courtyard"unverified | belief | - | 0.000035 | 345/3 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "workshop" | belief | - | 0.000034 | 334/2 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "cafeteria" | belief | - | 0.000033 | 319/4 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "photo studio" | belief | - | 0.000033 | 317/3 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ?FAILanswered "south stairwell"unverified | belief | - | 0.000033 | 313/4 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ?FAILanswered "workshop"unverified | belief | - | 0.000031 | 302/2 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ?FAILanswered "supply closet"unverified | belief | - | 0.000033 | 321/3 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ?FAILanswered "break room"unverified | belief | - | 0.000033 | 319/3 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "archive room" | belief | - | 0.000036 | 356/3 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ?FAILanswered "west wing"unverified | belief | - | 0.000032 | 309/3 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ?FAILanswered "print room"unverified | belief | - | 0.000037 | 358/3 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "front office" | belief | - | 0.000035 | 344/3 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ?FAILanswered "archive room"unverified | belief | - | 0.000034 | 327/3 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "supply closet" | belief | - | 0.000030 | 287/3 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ?FAILanswered "lobby"unverified | belief | - | 0.000035 | 347/2 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ?FAILanswered "meditation room"unverified | belief | - | 0.000033 | 322/4 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "supply closet" | belief | - | 0.000033 | 322/3 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ?FAILanswered "server room"unverified | belief | - | 0.000030 | 295/3 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ?FAILanswered "break room"unverified | belief | - | 0.000033 | 325/3 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ?FAILanswered "garage"unverified | belief | - | 0.000030 | 294/2 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ?FAILanswered "archive room"unverified | belief | - | 0.000033 | 322/3 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ?FAILanswered "wine cellar"unverified | belief | - | 0.000034 | 336/3 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ?FAILanswered "north stairwell"unverified | belief | - | 0.000035 | 334/4 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "security office" | belief | - | 0.000034 | 330/3 | full transcript → |