Run camp-full_map-gpt-oss-120b-001/adversarial_belief
98% PASSWhat this run revealed, then every individual trial as evidence.
42
Trials
98%
41/42 scored
over trials
Pass rate
1
Failures
$0.0116
Run cost
Run camp-full_map-gpt-oss-120b-001/adversarial_belief: passed essentially everything (98%) -- this test did not challenge the model.
Of 42 scored trials (belief query kind), the model passed 98%. That's saturation: the difficulty range probed here isn't finding this model's limits. Consider a harder preset (breaking_point or adversarial_belief) or a wider dimension range.
1 failure(s) recorded; failures not yet verified -- use "Verify failures" on this page (or scripts/verify_past_failures.py).
In 1 of 1 classifiable belief failures the model reported where the object ACTUALLY was, not where the queried entity BELIEVED it was -- it collapsed their perspective into reality.
Notable failures
- record 6f63a961 expected: the north stairwellactual: workshop
Trials
Per-trial table
| model | verdict | kind | difficulty | cost ($) | tokens in/out | |
|---|---|---|---|---|---|---|
| openai/gpt-oss-120b | ✓PASSanswered "mail room" | belief | - | 0.000147 | 206/194 | full transcript → |
| openai/gpt-oss-120b | ✓PASSanswered "north stairwell" | belief | - | 0.000154 | 210/204 | full transcript → |
| openai/gpt-oss-120b | ✓PASSanswered "supply closet" | belief | - | 0.000162 | 223/215 | full transcript → |
| openai/gpt-oss-120b | ✓PASSanswered "cafeteria" | belief | - | 0.000150 | 219/195 | full transcript → |
| openai/gpt-oss-120b | ✓PASSanswered "utility closet" | belief | - | 0.000179 | 205/247 | full transcript → |
| openai/gpt-oss-120b | ✓PASSanswered "north stairwell" | belief | - | 0.000249 | 269/348 | full transcript → |
| openai/gpt-oss-120b | ✓PASSanswered "observation deck" | belief | - | 0.000172 | 272/219 | full transcript → |
| openai/gpt-oss-120b | ?FAILanswered "workshop" (world seeded for: final_true_state, last_mentioned_location, last_witnessed_by_anyone, most_frequent_location, query_agent_own_last_move)unverified | belief | - | 0.000241 | 264/336 | full transcript → |
| openai/gpt-oss-120b | ✓PASSanswered "break room" | belief | - | 0.000267 | 249/382 | full transcript → |
| openai/gpt-oss-120b | ✓PASSanswered "security office" | belief | - | 0.000338 | 311/486 | full transcript → |
| openai/gpt-oss-120b | ✓PASSanswered "break room" | belief | - | 0.000200 | 260/269 | full transcript → |
| openai/gpt-oss-120b | ✓PASSanswered "archive room" | belief | - | 0.000408 | 319/601 | full transcript → |
| openai/gpt-oss-120b | ✓PASSanswered "break room" | belief | - | 0.000204 | 324/259 | full transcript → |
| openai/gpt-oss-120b | ✓PASSanswered "library" | belief | - | 0.000348 | 339/495 | full transcript → |
| openai/gpt-oss-120b | ✓PASSanswered "server room" | belief | - | 0.000315 | 378/430 | full transcript → |
| openai/gpt-oss-120b | ✓PASSanswered "observation deck" | belief | - | 0.000305 | 318/429 | full transcript → |
| openai/gpt-oss-120b | ✓PASSanswered "storage room" | belief | - | 0.000469 | 371/689 | full transcript → |
| openai/gpt-oss-120b | ✓PASSanswered "east wing" | belief | - | 0.000415 | 397/593 | full transcript → |
| openai/gpt-oss-120b | ✓PASSanswered "library" | belief | - | 0.000576 | 361/870 | full transcript → |
| openai/gpt-oss-120b | ✓PASSanswered "lobby" | belief | - | 0.000425 | 428/602 | full transcript → |
| openai/gpt-oss-120b | ✓PASSanswered "wine cellar" | belief | - | 0.000504 | 414/736 | full transcript → |
| openai/gpt-oss-120b | ✓PASSanswered "lobby" | belief | - | 0.000481 | 456/687 | full transcript → |
| openai/gpt-oss-120b | ✓PASSanswered "library" | belief | - | 0.000378 | 355/542 | full transcript → |
| openai/gpt-oss-120b | ✓PASSanswered "south stairwell" | belief | - | 0.000435 | 409/623 | full transcript → |
| openai/gpt-oss-120b | ✓PASSanswered "supply closet" | belief | - | 0.000405 | 466/559 | full transcript → |
| openai/gpt-oss-120b | ✓PASSanswered "utility closet" | belief | - | 0.000110 | 206/132 | full transcript → |
| openai/gpt-oss-120b | ✓PASSanswered "observation deck" | belief | - | 0.000146 | 203/192 | full transcript → |
| openai/gpt-oss-120b | ✓PASSanswered "photo studio" | belief | - | 0.000163 | 214/219 | full transcript → |
| openai/gpt-oss-120b | ✓PASSanswered "mail room" | belief | - | 0.000142 | 222/181 | full transcript → |
| openai/gpt-oss-120b | ✓PASSanswered "north stairwell" | belief | - | 0.000162 | 221/215 | full transcript → |
| openai/gpt-oss-120b | ✓PASSanswered "front office" | belief | - | 0.000152 | 217/199 | full transcript → |
| openai/gpt-oss-120b | ✓PASSanswered "basement" | belief | - | 0.000208 | 218/292 | full transcript → |
| openai/gpt-oss-120b | ✓PASSanswered "greenhouse" | belief | - | 0.000209 | 219/294 | full transcript → |
| openai/gpt-oss-120b | ✓PASSanswered "conference room" | belief | - | 0.000190 | 222/262 | full transcript → |
| openai/gpt-oss-120b | ✓PASSanswered "break room" | belief | - | 0.000170 | 220/229 | full transcript → |
| openai/gpt-oss-120b | ✓PASSanswered "print room" | belief | - | 0.000207 | 206/294 | full transcript → |
| openai/gpt-oss-120b | ✓PASSanswered "basement" | belief | - | 0.000175 | 198/242 | full transcript → |
| openai/gpt-oss-120b | ✓PASSanswered "supply closet" | belief | - | 0.000241 | 204/350 | full transcript → |
| openai/gpt-oss-120b | ✓PASSanswered "reception area" | belief | - | 0.000135 | 226/169 | full transcript → |
| openai/gpt-oss-120b | ✓PASSanswered "garage" | belief | - | 0.000589 | 210/929 | full transcript → |
| openai/gpt-oss-120b | ✓PASSanswered "mail room" | belief | - | 0.000274 | 219/402 | full transcript → |
| openai/gpt-oss-120b | ✓PASSanswered "south stairwell" | belief | - | 0.000357 | 215/541 | full transcript → |