Run camp-full_map-gemma-001/breaking_point
57% PASSWhat this run revealed, then every individual trial as evidence.
7
Trials
57%
4/7 scored
over trials
Pass rate
3
Failures
$0.0004
Run cost
Run camp-full_map-gemma-001/breaking_point: 57% pass rate on belief queries.
Of 7 scored trials (belief query kind), the model passed 57% and failed 43%.
3 failure(s) recorded; failures not yet verified -- use "Verify failures" on this page (or scripts/verify_past_failures.py).
In 2 of 3 classifiable belief failures the model reported where the object ACTUALLY was, not where the queried entity BELIEVED it was -- it collapsed their perspective into reality.
Notable failures
- record 7a3e678c expected: the lobbyactual: security office
- record ccc213d3 expected: the greenhouseactual: rooftop terrace
- record f8e81c0a expected: the storage roomactual: south stairwell
Trials
Per-trial table
| model | verdict | kind | difficulty | cost ($) | tokens in/out | |
|---|---|---|---|---|---|---|
| google/gemma-3-27b-it | ✓PASSanswered "west wing" | belief | - | 0.000051 | 501/3 | full transcript → |
| google/gemma-3-27b-it | ✓PASSanswered "mail room" | belief | - | 0.000049 | 478/3 | full transcript → |
| google/gemma-3-27b-it | ?FAILanswered "security office"unverified | belief | - | 0.000049 | 483/3 | full transcript → |
| google/gemma-3-27b-it | ✓PASSanswered "conference room" | belief | - | 0.000048 | 472/3 | full transcript → |
| google/gemma-3-27b-it | ?FAILanswered "rooftop terrace"unverified | belief | - | 0.000052 | 501/5 | full transcript → |
| google/gemma-3-27b-it | ✓PASSanswered "break room" | belief | - | 0.000051 | 503/3 | full transcript → |
| google/gemma-3-27b-it | ?FAILanswered "south stairwell"unverified | belief | - | 0.000050 | 492/4 | full transcript → |