Data to …… trials

Run camp-full_map-gpt-oss-120b-001/adversarial_belief

98% PASS

What this run revealed, then every individual trial as evidence.

42
Trials
98%
41/42 scored
over trials
Pass rate
1
2%
Failures
$0.0116
Run cost

Run camp-full_map-gpt-oss-120b-001/adversarial_belief: passed essentially everything (98%) -- this test did not challenge the model.

Of 42 scored trials (belief query kind), the model passed 98%. That's saturation: the difficulty range probed here isn't finding this model's limits. Consider a harder preset (breaking_point or adversarial_belief) or a wider dimension range.

1 failure(s) recorded; failures not yet verified -- use "Verify failures" on this page (or scripts/verify_past_failures.py).

In 1 of 1 classifiable belief failures the model reported where the object ACTUALLY was, not where the queried entity BELIEVED it was -- it collapsed their perspective into reality.

Notable failures

  • record 6f63a961 — asked "Where does Silas believe the large folder is? Answer with only the location name (or 'unknown' if they have no belief)."
    expected: the north stairwell
    actual: workshop

    the model reported the object's TRUE final location, not what the queried entity actually believed -- it collapsed belief into reality

Trials42 trials
Per-trial table (42 trials -- prompt, reasoning, verdict, answer key)
modelverdictkinddifficultycost ($)tokens in/out
openai/gpt-oss-120b✓PASSanswered "mail room"belief-0.000147206/194full transcript →
openai/gpt-oss-120b✓PASSanswered "north stairwell"belief-0.000154210/204full transcript →
openai/gpt-oss-120b✓PASSanswered "supply closet"belief-0.000162223/215full transcript →
openai/gpt-oss-120b✓PASSanswered "cafeteria"belief-0.000150219/195full transcript →
openai/gpt-oss-120b✓PASSanswered "utility closet"belief-0.000179205/247full transcript →
openai/gpt-oss-120b✓PASSanswered "north stairwell"belief-0.000249269/348full transcript →
openai/gpt-oss-120b✓PASSanswered "observation deck"belief-0.000172272/219full transcript →
openai/gpt-oss-120b?FAILanswered "workshop" (world seeded for: final_true_state, last_mentioned_location, last_witnessed_by_anyone, most_frequent_location, query_agent_own_last_move)unverifiedbelief-0.000241264/336full transcript →
openai/gpt-oss-120b✓PASSanswered "break room"belief-0.000267249/382full transcript →
openai/gpt-oss-120b✓PASSanswered "security office"belief-0.000338311/486full transcript →
openai/gpt-oss-120b✓PASSanswered "break room"belief-0.000200260/269full transcript →
openai/gpt-oss-120b✓PASSanswered "archive room"belief-0.000408319/601full transcript →
openai/gpt-oss-120b✓PASSanswered "break room"belief-0.000204324/259full transcript →
openai/gpt-oss-120b✓PASSanswered "library"belief-0.000348339/495full transcript →
openai/gpt-oss-120b✓PASSanswered "server room"belief-0.000315378/430full transcript →
openai/gpt-oss-120b✓PASSanswered "observation deck"belief-0.000305318/429full transcript →
openai/gpt-oss-120b✓PASSanswered "storage room"belief-0.000469371/689full transcript →
openai/gpt-oss-120b✓PASSanswered "east wing"belief-0.000415397/593full transcript →
openai/gpt-oss-120b✓PASSanswered "library"belief-0.000576361/870full transcript →
openai/gpt-oss-120b✓PASSanswered "lobby"belief-0.000425428/602full transcript →
openai/gpt-oss-120b✓PASSanswered "wine cellar"belief-0.000504414/736full transcript →
openai/gpt-oss-120b✓PASSanswered "lobby"belief-0.000481456/687full transcript →
openai/gpt-oss-120b✓PASSanswered "library"belief-0.000378355/542full transcript →
openai/gpt-oss-120b✓PASSanswered "south stairwell"belief-0.000435409/623full transcript →
openai/gpt-oss-120b✓PASSanswered "supply closet"belief-0.000405466/559full transcript →
openai/gpt-oss-120b✓PASSanswered "utility closet"belief-0.000110206/132full transcript →
openai/gpt-oss-120b✓PASSanswered "observation deck"belief-0.000146203/192full transcript →
openai/gpt-oss-120b✓PASSanswered "photo studio"belief-0.000163214/219full transcript →
openai/gpt-oss-120b✓PASSanswered "mail room"belief-0.000142222/181full transcript →
openai/gpt-oss-120b✓PASSanswered "north stairwell"belief-0.000162221/215full transcript →
openai/gpt-oss-120b✓PASSanswered "front office"belief-0.000152217/199full transcript →
openai/gpt-oss-120b✓PASSanswered "basement"belief-0.000208218/292full transcript →
openai/gpt-oss-120b✓PASSanswered "greenhouse"belief-0.000209219/294full transcript →
openai/gpt-oss-120b✓PASSanswered "conference room"belief-0.000190222/262full transcript →
openai/gpt-oss-120b✓PASSanswered "break room"belief-0.000170220/229full transcript →
openai/gpt-oss-120b✓PASSanswered "print room"belief-0.000207206/294full transcript →
openai/gpt-oss-120b✓PASSanswered "basement"belief-0.000175198/242full transcript →
openai/gpt-oss-120b✓PASSanswered "supply closet"belief-0.000241204/350full transcript →
openai/gpt-oss-120b✓PASSanswered "reception area"belief-0.000135226/169full transcript →
openai/gpt-oss-120b✓PASSanswered "garage"belief-0.000589210/929full transcript →
openai/gpt-oss-120b✓PASSanswered "mail room"belief-0.000274219/402full transcript →
openai/gpt-oss-120b✓PASSanswered "south stairwell"belief-0.000357215/541full transcript →