Data to …… trials

Run camp-full_map-gpt-oss-120b-001

98% PASS

What this run revealed, then every individual trial as evidence.

312
1 error
Trials
98%
304/310 scored
over trials
Pass rate
7
5 stable / 1 noise
2%
Failures
$0.0742
Run cost

Full-map run camp-full_map-gpt-oss-120b-001: clean on state, order, adversarial_belief, weak province: belief.

Passes state cleanly (100%, 30 trials).

Passes order cleanly (100%, 80 trials).

(order) 1 failures recorded; 0 survived verification (1 were sampling noise and are excluded from findings).

Belief is a weak province: 97% pass rate across 160 trials.

(belief) 5 failures recorded; all 5 survived verification.

(belief) In 3 of 5 classifiable belief failures the model reported where the object ACTUALLY was, not where the queried entity BELIEVED it was -- it collapsed their perspective into reality.

Passes adversarial_belief cleanly (98%, 42 trials).

(adversarial_belief) 1 failure(s) recorded; failures not yet verified -- use "Verify failures" on this page (or scripts/verify_past_failures.py).

(adversarial_belief) In 1 of 1 classifiable belief failures the model reported where the object ACTUALLY was, not where the queried entity BELIEVED it was -- it collapsed their perspective into reality.

breaking_point: not run (no records).

Notable failures

  • record 89641036 — asked "Where does Dexter believe the faded box is? Answer with only the location name (or 'unknown' if they have no belief)."
    expected: the archive room
    actual: print room

    the model reported the object's TRUE final location, not what the queried entity actually believed -- it collapsed belief into reality

  • record 52ea26a5 — asked "Where does Elliot believe the dusty wrench is? Answer with only the location name (or 'unknown' if they have no belief)."
    expected: the east wing
    actual: conference room

    the model reported the object's TRUE final location, not what the queried entity actually believed -- it collapsed belief into reality

  • record 6f63a961 — asked "Where does Silas believe the large folder is? Answer with only the location name (or 'unknown' if they have no belief)."
    expected: the north stairwell
    actual: workshop

    the model reported the object's TRUE final location, not what the queried entity actually believed -- it collapsed belief into reality

Trials312 trials
Per-trial table (312 trials -- prompt, reasoning, verdict, answer key)
modelstageverdictkinddifficultycost ($)tokens in/out
openai/gpt-oss-120bstate✓PASSanswered "courtyard"state-0.000075181/79full transcript →
openai/gpt-oss-120bstate✓PASSanswered "storage room"state-0.000086184/98full transcript →
openai/gpt-oss-120bstate✓PASSanswered "photo studio"state-0.000075181/79full transcript →
openai/gpt-oss-120bstate✓PASSanswered "courtyard"state-0.000075179/81full transcript →
openai/gpt-oss-120bstate✓PASSanswered "utility closet"state-0.000077187/81full transcript →
openai/gpt-oss-120bstate✓PASSanswered "boiler room"state-0.000191308/241full transcript →
openai/gpt-oss-120bstate✓PASSanswered "cafeteria"state-0.000382299/562full transcript →
openai/gpt-oss-120bstate✓PASSanswered "storage room"state-0.000246293/337full transcript →
openai/gpt-oss-120bstate✓PASSanswered "boiler room"state-0.000249298/340full transcript →
openai/gpt-oss-120bstate✓PASSanswered "observation deck"state-0.000303298/431full transcript →
openai/gpt-oss-120bstate✓PASSanswered "loading dock"state-0.000403416/568full transcript →
openai/gpt-oss-120bstate✓PASSanswered "east wing"state-0.000372421/515full transcript →
openai/gpt-oss-120bstate✓PASSanswered "mail room"state-0.000491419/713full transcript →
openai/gpt-oss-120bstate✓PASSanswered "cafeteria"state-0.000598428/890full transcript →
openai/gpt-oss-120bstate✓PASSanswered "south stairwell"state-0.000288439/370full transcript →
openai/gpt-oss-120bstate✓PASSanswered "archive room"state-0.000382527/505full transcript →
openai/gpt-oss-120bstate✓PASSanswered "atrium"state-0.000558525/799full transcript →
openai/gpt-oss-120bstate✓PASSanswered "west wing"state-0.000738528/1098full transcript →
openai/gpt-oss-120bstate✓PASSanswered "print room"state-0.000589545/845full transcript →
openai/gpt-oss-120bstate✓PASSanswered "mail room"state-0.000494547/686full transcript →
openai/gpt-oss-120bstate✓PASSanswered "rooftop terrace"state-0.000676652/964full transcript →
openai/gpt-oss-120bstate✓PASSanswered "photo studio"state-0.000597648/833full transcript →
openai/gpt-oss-120bstate✓PASSanswered "photo studio"state-0.000602680/834full transcript →
openai/gpt-oss-120bstate✓PASSanswered "storage room"state-0.000768666/1113full transcript →
openai/gpt-oss-120bstate✓PASSanswered "east wing"state-0.000602667/837full transcript →
openai/gpt-oss-120bstate✓PASSanswered "cafeteria"state-0.000604660/841full transcript →
openai/gpt-oss-120bstate✓PASSanswered "Print room"state-0.000330648/388full transcript →
openai/gpt-oss-120bstate✓PASSanswered "supply closet"state-0.000637654/899full transcript →
openai/gpt-oss-120bstate✓PASSanswered "photo studio"state-0.000525659/711full transcript →
openai/gpt-oss-120bstate✓PASSanswered "south stairwell"state-0.000535645/730full transcript →
openai/gpt-oss-120border✓PASSanswered "first"order-0.000100204/116full transcript →
openai/gpt-oss-120border✓PASSanswered "first"order-0.000202200/287full transcript →
openai/gpt-oss-120border✓PASSanswered "first"order-0.000186201/259full transcript →
openai/gpt-oss-120border✓PASSanswered "first"order-0.000214200/307full transcript →
openai/gpt-oss-120border✓PASSanswered "first"order-0.000115210/139full transcript →
openai/gpt-oss-120border✓PASSanswered "first"order-0.000155267/192full transcript →
openai/gpt-oss-120border✓PASSanswered "first"order-0.000127268/145full transcript →
openai/gpt-oss-120border✓PASSanswered "first"order-0.000191274/250full transcript →
openai/gpt-oss-120border✓PASSanswered "first"order-0.000224273/305full transcript →
openai/gpt-oss-120border✓PASSanswered "first"order-0.000131367/127full transcript →
openai/gpt-oss-120border✓PASSanswered "first"order-0.000135271/158full transcript →
openai/gpt-oss-120border✓PASSanswered "first"order-0.000146355/155full transcript →
openai/gpt-oss-120border✓PASSanswered "first"order-0.000125350/121full transcript →
openai/gpt-oss-120border✓PASSanswered "first"order-0.000246349/322full transcript →
openai/gpt-oss-120border✓PASSanswered "first"order-0.000168442/170full transcript →
openai/gpt-oss-120border✓PASSanswered "first"order-0.000174362/200full transcript →
openai/gpt-oss-120border✓PASSanswered "first"order-0.000189436/206full transcript →
openai/gpt-oss-120border✓PASSanswered "first"order-0.000152440/143full transcript →
openai/gpt-oss-120border✓PASSanswered "first"order-0.000162443/160full transcript →
openai/gpt-oss-120border✓PASSanswered "first"order-0.000230512/255full transcript →
openai/gpt-oss-120border✓PASSanswered "first"order-0.000186447/198full transcript →
openai/gpt-oss-120border✓PASSanswered "first"order-0.000251508/292full transcript →
openai/gpt-oss-120border✓PASSanswered "first"order-0.000227507/252full transcript →
openai/gpt-oss-120border✓PASSanswered "first"order-0.000221499/244full transcript →
openai/gpt-oss-120border✓PASSanswered "first"order-0.000212509/226full transcript →
openai/gpt-oss-120border✓PASSanswered "first"order-0.000144198/190full transcript →
openai/gpt-oss-120border✓PASSanswered "first"order-0.000235200/341full transcript →
openai/gpt-oss-120border✓PASSanswered "first"order-0.000123201/155full transcript →
openai/gpt-oss-120border✓PASSanswered "first"order-0.000094198/108full transcript →
openai/gpt-oss-120border✓PASSanswered "first"order-0.000188204/263full transcript →
openai/gpt-oss-120border✓PASSanswered "first"order-0.000095201/108full transcript →
openai/gpt-oss-120border✓PASSanswered "first"order-0.000181201/252full transcript →
openai/gpt-oss-120border✓PASSanswered "first"order-0.000250202/367full transcript →
openai/gpt-oss-120border✓PASSanswered "first"order-0.000164204/223full transcript →
openai/gpt-oss-120border✓PASSanswered "first"order-0.000175201/242full transcript →
openai/gpt-oss-120border✓PASSanswered "first"order-0.000486207/759full transcript →
openai/gpt-oss-120border✓PASSanswered "first"order-0.000150207/199full transcript →
openai/gpt-oss-120border✓PASSanswered "first"order-0.000347198/529full transcript →
openai/gpt-oss-120border✓PASSanswered "first"order-0.000247201/362full transcript →
openai/gpt-oss-120border✓PASSanswered "first"order-0.000216198/310full transcript →
openai/gpt-oss-120border✓PASSanswered "first"order-0.000208205/295full transcript →
openai/gpt-oss-120border✓PASSanswered "first"order-0.000206197/294full transcript →
openai/gpt-oss-120border✓PASSanswered "first"order-0.000145198/192full transcript →
openai/gpt-oss-120border✓PASSanswered "first"order-0.000371200/569full transcript →
openai/gpt-oss-120border✕FAILanswered "second"noiseorder-0.000459205/714full transcript →
openai/gpt-oss-120border✓PASSanswered "first"order-0.000179208/247full transcript →
openai/gpt-oss-120border✓PASSanswered "first"order-0.000187205/261full transcript →
openai/gpt-oss-120border✓PASSanswered "first"order-0.000186206/258full transcript →
openai/gpt-oss-120border✓PASSanswered "first"order-0.000161207/217full transcript →
openai/gpt-oss-120border✓PASSanswered "first"order-0.000212207/301full transcript →
openai/gpt-oss-120border✓PASSanswered "first"order-0.000161203/218full transcript →
openai/gpt-oss-120border✓PASSanswered "first"order-0.000105203/124full transcript →
openai/gpt-oss-120border✓PASSanswered "first"order-0.000168205/229full transcript →
openai/gpt-oss-120border✓PASSanswered "first"order-0.000126198/161full transcript →
openai/gpt-oss-120border✓PASSanswered "first"order-0.000197197/279full transcript →
openai/gpt-oss-120border✓PASSanswered "first"order-0.000125315/129full transcript →
openai/gpt-oss-120border✓PASSanswered "first"order-0.000124328/125full transcript →
openai/gpt-oss-120border✓PASSanswered "first"order-0.000231322/305full transcript →
openai/gpt-oss-120border✓PASSanswered "first"order-0.000140328/151full transcript →
openai/gpt-oss-120border✓PASSanswered "first"order-0.000173321/208full transcript →
openai/gpt-oss-120border✓PASSanswered "first"order-0.000164451/161full transcript →
openai/gpt-oss-120border✓PASSanswered "first"order-0.000153427/148full transcript →
openai/gpt-oss-120border✓PASSanswered "first"order-0.000158435/155full transcript →
openai/gpt-oss-120border✓PASSanswered "first"order-0.000170435/174full transcript →
openai/gpt-oss-120border✓PASSanswered "first"order-0.000226548/239full transcript →
openai/gpt-oss-120border✓PASSanswered "first"order-0.000164565/132full transcript →
openai/gpt-oss-120border✓PASSanswered "first"order-0.000198426/224full transcript →
openai/gpt-oss-120border✓PASSanswered "first"order-0.000232560/247full transcript →
openai/gpt-oss-120border✓PASSanswered "first"order-0.000186558/171full transcript →
openai/gpt-oss-120border✓PASSanswered "first"order-0.000187577/167full transcript →
openai/gpt-oss-120border✓PASSanswered "first"order-0.000187654/149full transcript →
openai/gpt-oss-120border✓PASSanswered "first"order-0.000233687/216full transcript →
openai/gpt-oss-120border✓PASSanswered "first"order-0.000212678/184full transcript →
openai/gpt-oss-120border✓PASSanswered "first"order-0.000260687/262full transcript →
openai/gpt-oss-120border✓PASSanswered "first"order-0.000206639/184full transcript →
openai/gpt-oss-120border✓PASSanswered "first"order-0.000103203/121full transcript →
openai/gpt-oss-120border✓PASSanswered "first"order-0.000133208/169full transcript →
openai/gpt-oss-120border✓PASSanswered "first"order-0.000140203/182full transcript →
openai/gpt-oss-120border✓PASSanswered "first"order-0.000165199/225full transcript →
openai/gpt-oss-120border✓PASSanswered "first"order-0.000093201/104full transcript →
openai/gpt-oss-120bbelief✓PASSanswered "east wing"belief-0.000151205/201full transcript →
openai/gpt-oss-120bbelief✓PASSanswered "lobby"belief-0.000130203/166full transcript →
openai/gpt-oss-120bbelief✓PASSanswered "workshop"belief-0.000162218/215full transcript →
openai/gpt-oss-120bbelief✓PASSanswered "boiler room"belief-0.000139219/177full transcript →
openai/gpt-oss-120bbelief✓PASSanswered "garage"belief-0.000208272/279full transcript →
openai/gpt-oss-120bbelief✕FAILanswered "print room"verified-stablebelief-0.000357267/528full transcript →
openai/gpt-oss-120bbelief✓PASSanswered "supply closet"belief-0.000164206/222full transcript →
openai/gpt-oss-120bbelief✓PASSanswered "kitchen"belief-0.000219276/296full transcript →
openai/gpt-oss-120bbelief✓PASSanswered "basement"belief-0.000213268/288full transcript →
openai/gpt-oss-120bbelief✓PASSanswered "observation deck"belief-0.000165284/204full transcript →
openai/gpt-oss-120bbelief✓PASSanswered "reception area"belief-0.000315328/443full transcript →
openai/gpt-oss-120bbelief✓PASSanswered "break room"belief-0.000208300/271full transcript →
openai/gpt-oss-120bbelief✓PASSanswered "garage"belief-0.000331338/468full transcript →
openai/gpt-oss-120bbelief✓PASSanswered "break room"belief-0.000471329/703full transcript →
openai/gpt-oss-120bbelief✓PASSanswered "library"belief-0.000579363/874full transcript →
openai/gpt-oss-120bbelief✓PASSanswered "north stairwell"belief-0.000313406/420full transcript →
openai/gpt-oss-120bbelief✓PASSanswered "security office"belief-0.000439402/631full transcript →
openai/gpt-oss-120bbelief✓PASSanswered "rooftop terrace"belief-0.000411392/587full transcript →
openai/gpt-oss-120bbelief✓PASSanswered "boiler room"belief-0.000318313/451full transcript →
openai/gpt-oss-120bbelief✓PASSanswered "cafeteria"belief-0.000508418/743full transcript →
openai/gpt-oss-120bbelief✓PASSanswered "reception area"belief-0.000430385/620full transcript →
openai/gpt-oss-120bbelief✓PASSanswered "garage"belief-0.000378401/529full transcript →
openai/gpt-oss-120bbelief✓PASSanswered "west wing"belief-0.000626400/943full transcript →
openai/gpt-oss-120bbelief✓PASSanswered "basement"belief-0.000463413/668full transcript →
openai/gpt-oss-120bbelief✓PASSanswered "server room"belief-0.000417406/594full transcript →
openai/gpt-oss-120bbelief✓PASSanswered "break room"belief-0.000122222/148full transcript →
openai/gpt-oss-120bbelief✓PASSanswered "photo studio"belief-0.000117219/141full transcript →
openai/gpt-oss-120bbelief✓PASSanswered "security office"belief-0.000163201/222full transcript →
openai/gpt-oss-120bbelief✓PASSanswered "loading dock"belief-0.000145226/186full transcript →
openai/gpt-oss-120bbelief✓PASSanswered "north stairwell"belief-0.000425203/657full transcript →
openai/gpt-oss-120bbelief✓PASSanswered "rooftop terrace"belief-0.000207218/291full transcript →
openai/gpt-oss-120bbelief✓PASSanswered "loading dock"belief-0.000263205/387full transcript →
openai/gpt-oss-120bbelief✓PASSanswered "library"belief-0.000181206/250full transcript →
openai/gpt-oss-120bbelief✕FAILanswered "conference room"verified-stablebelief-0.000548216/859full transcript →
openai/gpt-oss-120bbelief✓PASSanswered "photo studio"belief-0.000157220/207full transcript →
openai/gpt-oss-120bbelief✓PASSanswered "archive room"belief-0.000181205/251full transcript →
openai/gpt-oss-120bbelief✓PASSanswered "front office"belief-0.000185212/256full transcript →
openai/gpt-oss-120bbelief✓PASSanswered "rooftop terrace"belief-0.000226220/321full transcript →
openai/gpt-oss-120bbelief✓PASSanswered "workshop"belief-0.000318209/478full transcript →
openai/gpt-oss-120bbelief✓PASSanswered "front office"belief-0.000228218/325full transcript →
openai/gpt-oss-120bbelief✓PASSanswered "storage room"belief-0.000175204/240full transcript →
openai/gpt-oss-120bbelief✓PASSanswered "security office"belief-0.000228222/324full transcript →
openai/gpt-oss-120bbelief✓PASSanswered "server room"belief-0.000273207/403full transcript →
openai/gpt-oss-120bbelief✓PASSanswered "observation deck"belief-0.000449214/694full transcript →
openai/gpt-oss-120bbelief✓PASSanswered "loading dock"belief-0.000280224/410full transcript →
openai/gpt-oss-120bbelief✓PASSanswered "west wing"belief-0.000307216/458full transcript →
openai/gpt-oss-120bbelief✓PASSanswered "greenhouse"belief-0.000440217/679full transcript →
openai/gpt-oss-120bbelief✓PASSanswered "archive room"belief-0.000254223/367full transcript →
openai/gpt-oss-120bbelief✓PASSanswered "cafeteria"belief-0.000201219/280full transcript →
openai/gpt-oss-120bbelief✓PASSanswered "utility closet"belief-0.000210227/294full transcript →
openai/gpt-oss-120bbelief✓PASSanswered "loading dock"belief-0.000189223/259full transcript →
openai/gpt-oss-120bbelief✓PASSanswered "cafeteria"belief-0.000141217/181full transcript →
openai/gpt-oss-120bbelief✓PASSanswered "kitchen"belief-0.000144222/184full transcript →
openai/gpt-oss-120bbelief✓PASSanswered "break room"belief-0.000168206/228full transcript →
openai/gpt-oss-120bbelief✓PASSanswered "atrium"belief-0.000152236/194full transcript →
openai/gpt-oss-120bbelief✓PASSanswered "north stairwell"belief-0.000158232/205full transcript →
openai/gpt-oss-120bbelief✓PASSanswered "east wing"belief-0.000175216/238full transcript →
openai/gpt-oss-120bbelief✓PASSanswered "workshop"belief-0.000102214/116full transcript →
openai/gpt-oss-120bbelief✓PASSanswered "server room"belief-0.000208221/291full transcript →
openai/gpt-oss-120bbelief✓PASSanswered "supply closet"belief-0.000178225/240full transcript →
openai/gpt-oss-120bbelief✓PASSanswered "garage"belief-0.000230226/327full transcript →
openai/gpt-oss-120bbelief✓PASSanswered "storage room"belief-0.000140243/173full transcript →
openai/gpt-oss-120bbelief✓PASSanswered "library"belief-0.000142243/176full transcript →
openai/gpt-oss-120bbelief✓PASSanswered "conference room"belief-0.000178241/237full transcript →
openai/gpt-oss-120bbelief✓PASSanswered "supply closet"belief-0.000105251/112full transcript →
openai/gpt-oss-120bbelief✓PASSanswered "south stairwell"belief-0.000130253/153full transcript →
openai/gpt-oss-120bbelief✓PASSanswered "kitchen"belief-0.000192268/253full transcript →
openai/gpt-oss-120bbelief✓PASSanswered "west wing"belief-0.000133267/155full transcript →
openai/gpt-oss-120bbelief✓PASSanswered "observation deck"belief-0.000312275/452full transcript →
openai/gpt-oss-120bbelief✓PASSanswered "north stairwell"belief-0.000212283/282full transcript →
openai/gpt-oss-120bbelief✓PASSanswered "security office"belief-0.000220287/295full transcript →
openai/gpt-oss-120bbelief✓PASSanswered "workshop"belief-0.000186267/243full transcript →
openai/gpt-oss-120bbelief✓PASSanswered "greenhouse"belief-0.000146279/174full transcript →
openai/gpt-oss-120bbelief✓PASSanswered "boiler room"belief-0.000216286/288full transcript →
openai/gpt-oss-120bbelief✓PASSanswered "conference room"belief-0.000265286/370full transcript →
openai/gpt-oss-120bbelief✓PASSanswered "south stairwell"belief-0.000145219/187full transcript →
openai/gpt-oss-120bbelief✓PASSanswered "server room"belief-0.000153213/202full transcript →
openai/gpt-oss-120bbelief✓PASSanswered "lobby"belief-0.000189213/261full transcript →
openai/gpt-oss-120bbelief✓PASSanswered "security office"belief-0.000161223/212full transcript →
openai/gpt-oss-120bbelief✓PASSanswered "break room"belief-0.000173220/234full transcript →
openai/gpt-oss-120bbelief✓PASSanswered "lobby"belief-0.000155270/191full transcript →
openai/gpt-oss-120bbelief✓PASSanswered "courtyard"belief-0.000249287/343full transcript →
openai/gpt-oss-120bbelief✓PASSanswered "photo studio"belief-0.000236280/323full transcript →
openai/gpt-oss-120bbelief✓PASSanswered "archive room"belief-0.000233284/318full transcript →
openai/gpt-oss-120bbelief✓PASSanswered "photo studio"belief-0.000141370/143full transcript →
openai/gpt-oss-120bbelief✓PASSanswered "photo studio"belief-0.000155351/171full transcript →
openai/gpt-oss-120bbelief✓PASSanswered "security office"belief-0.000195275/257full transcript →
openai/gpt-oss-120bbelief✓PASSanswered "north stairwell"belief-0.000171362/195full transcript →
openai/gpt-oss-120bbelief✓PASSanswered "basement"belief-0.000169357/193full transcript →
openai/gpt-oss-120bbelief✓PASSanswered "front office"belief-0.000154369/164full transcript →
openai/gpt-oss-120bbelief✓PASSanswered "reception area"belief-0.000161448/157full transcript →
openai/gpt-oss-120bbelief✓PASSanswered "rooftop terrace"belief-0.000140454/120full transcript →
openai/gpt-oss-120bbelief✓PASSanswered "storage room"belief-0.000144457/126full transcript →
openai/gpt-oss-120bbelief✓PASSanswered "south stairwell"belief-0.000151448/139full transcript →
openai/gpt-oss-120bbelief✓PASSanswered "east wing"belief-0.000238551/259full transcript →
openai/gpt-oss-120bbelief✓PASSanswered "archive room"belief-0.000141462/119full transcript →
openai/gpt-oss-120bbelief✓PASSanswered "meditation room"belief-0.000182537/169full transcript →
openai/gpt-oss-120bbelief✓PASSanswered "wine cellar"belief-0.000190516/188full transcript →
openai/gpt-oss-120bbelief✓PASSanswered "reception area"belief-0.000148512/118full transcript →
openai/gpt-oss-120bbelief✓PASSanswered "courtyard"belief-0.000322520/406full transcript →
openai/gpt-oss-120bbelief✓PASSanswered "basement"belief-0.000119216/144full transcript →
openai/gpt-oss-120bbelief✓PASSanswered "gym"belief-0.000145218/188full transcript →
openai/gpt-oss-120bbelief✓PASSanswered "observation deck"belief-0.000178219/242full transcript →
openai/gpt-oss-120bbelief✓PASSanswered "south stairwell"belief-0.000108203/130full transcript →
openai/gpt-oss-120bbelief✓PASSanswered "kitchen"belief-0.000221216/314full transcript →
openai/gpt-oss-120bbelief✓PASSanswered "server room"belief-0.000184205/256full transcript →
openai/gpt-oss-120bbelief✕FAILanswered "library"verified-stablebelief-0.000238217/343full transcript →
openai/gpt-oss-120bbelief✓PASSanswered "kitchen"belief-0.000161219/214full transcript →
openai/gpt-oss-120bbelief✓PASSanswered "library"belief-0.000168205/229full transcript →
openai/gpt-oss-120bbelief✓PASSanswered "print room"belief-0.000175209/240full transcript →
openai/gpt-oss-120bbelief✓PASSanswered "workshop"belief-0.000116223/138full transcript →
openai/gpt-oss-120bbelief✓PASSanswered "east wing"belief-0.000187206/261full transcript →
openai/gpt-oss-120bbelief✕FAILanswered "reception"verified-stablebelief-0.000138217/176full transcript →
openai/gpt-oss-120bbelief✓PASSanswered "library"belief-0.000185200/259full transcript →
openai/gpt-oss-120bbelief✓PASSanswered "boiler room"belief-0.000133212/169full transcript →
openai/gpt-oss-120bbelief✓PASSanswered "mail room"belief-0.000109205/131full transcript →
openai/gpt-oss-120bbelief✕ERRORhttp 429: b'{"error":{"message":"Rate limit reached for model `openai/gpt-oss-120b` in organization `org_01jpwfsbh0f7atrs0qxaewb6b7` service tier `on_demand` on tokens per minute (TPM): Limit 8000, Used 7368, Req'belief-0.0000000/0full transcript →
openai/gpt-oss-120bbelief✓PASSanswered "observation deck"belief-0.000147202/195full transcript →
openai/gpt-oss-120bbelief✓PASSanswered "wine cellar"belief-0.000267221/390full transcript →
openai/gpt-oss-120bbelief✓PASSanswered "courtyard"belief-0.000117203/144full transcript →
openai/gpt-oss-120bbelief✓PASSanswered "south stairwell"belief-0.000233209/336full transcript →
openai/gpt-oss-120bbelief✓PASSanswered "storage room"belief-0.000103201/122full transcript →
openai/gpt-oss-120bbelief✓PASSanswered "utility closet"belief-0.000147207/194full transcript →
openai/gpt-oss-120bbelief✓PASSanswered "cafeteria"belief-0.000164213/220full transcript →
openai/gpt-oss-120bbelief✓PASSanswered "rooftop terrace"belief-0.000144205/188full transcript →
openai/gpt-oss-120bbelief✓PASSanswered "atrium"belief-0.000193226/266full transcript →
openai/gpt-oss-120bbelief✓PASSanswered "south stairwell"belief-0.000194226/267full transcript →
openai/gpt-oss-120bbelief✓PASSanswered "workshop"belief-0.000143210/186full transcript →
openai/gpt-oss-120bbelief✓PASSanswered "greenhouse"belief-0.000173201/238full transcript →
openai/gpt-oss-120bbelief✓PASSanswered "boiler room"belief-0.000180217/245full transcript →
openai/gpt-oss-120bbelief✓PASSanswered "atrium"belief-0.000181201/251full transcript →
openai/gpt-oss-120bbelief✓PASSanswered "library"belief-0.000261224/379full transcript →
openai/gpt-oss-120bbelief✓PASSanswered "south stairwell"belief-0.000217215/308full transcript →
openai/gpt-oss-120bbelief✓PASSanswered "south stairwell"belief-0.000190210/265full transcript →
openai/gpt-oss-120bbelief✓PASSanswered "server room"belief-0.000143221/183full transcript →
openai/gpt-oss-120bbelief✓PASSanswered "observation deck"belief-0.000152206/202full transcript →
openai/gpt-oss-120bbelief✓PASSanswered "utility closet"belief-0.000126223/155full transcript →
openai/gpt-oss-120bbelief✓PASSanswered "reception area"belief-0.000120223/145full transcript →
openai/gpt-oss-120bbelief✓PASSanswered "library"belief-0.000120202/150full transcript →
openai/gpt-oss-120bbelief✓PASSanswered "south stairwell"belief-0.000274213/404full transcript →
openai/gpt-oss-120bbelief✓PASSanswered "front office"belief-0.000155224/203full transcript →
openai/gpt-oss-120bbelief✓PASSanswered "print room"belief-0.000162218/216full transcript →
openai/gpt-oss-120bbelief✓PASSanswered "mail room"belief-0.000141217/181full transcript →
openai/gpt-oss-120bbelief✓PASSanswered "security office"belief-0.000127221/157full transcript →
openai/gpt-oss-120bbelief✓PASSanswered "supply closet"belief-0.000180222/244full transcript →
openai/gpt-oss-120bbelief✓PASSanswered "front office"belief-0.000159210/213full transcript →
openai/gpt-oss-120bbelief✓PASSanswered "meditation room"belief-0.000128219/158full transcript →
openai/gpt-oss-120bbelief✓PASSanswered "security office"belief-0.000131215/165full transcript →
openai/gpt-oss-120bbelief✓PASSanswered "west wing"belief-0.000196222/272full transcript →
openai/gpt-oss-120bbelief✓PASSanswered "observation deck"belief-0.000119202/148full transcript →
openai/gpt-oss-120bbelief✓PASSanswered "utility closet"belief-0.000137209/176full transcript →
openai/gpt-oss-120bbelief✓PASSanswered "courtyard"belief-0.000120221/145full transcript →
openai/gpt-oss-120bbelief✓PASSanswered "loading dock"belief-0.000151224/195full transcript →
openai/gpt-oss-120bbelief✓PASSanswered "rooftop terrace"belief-0.000094201/107full transcript →
openai/gpt-oss-120bbelief✓PASSanswered "break room"belief-0.000186222/255full transcript →
openai/gpt-oss-120bbelief✓PASSanswered "courtyard"belief-0.000492762/630full transcript →
openai/gpt-oss-120bbelief✓PASSanswered "security office"belief-0.000279779/270full transcript →
openai/gpt-oss-120bbelief✕FAILanswered "unknown"verified-stablebelief-0.000513752/667full transcript →
openai/gpt-oss-120bbelief✓PASSanswered "garage"belief-0.000486763/620full transcript →
openai/gpt-oss-120bbelief✓PASSanswered "greenhouse"belief-0.001263770/1913full transcript →
openai/gpt-oss-120badversarial_belief✓PASSanswered "mail room"belief-0.000147206/194full transcript →
openai/gpt-oss-120badversarial_belief✓PASSanswered "north stairwell"belief-0.000154210/204full transcript →
openai/gpt-oss-120badversarial_belief✓PASSanswered "supply closet"belief-0.000162223/215full transcript →
openai/gpt-oss-120badversarial_belief✓PASSanswered "cafeteria"belief-0.000150219/195full transcript →
openai/gpt-oss-120badversarial_belief✓PASSanswered "utility closet"belief-0.000179205/247full transcript →
openai/gpt-oss-120badversarial_belief✓PASSanswered "north stairwell"belief-0.000249269/348full transcript →
openai/gpt-oss-120badversarial_belief✓PASSanswered "observation deck"belief-0.000172272/219full transcript →
openai/gpt-oss-120badversarial_belief?FAILanswered "workshop" (world seeded for: final_true_state, last_mentioned_location, last_witnessed_by_anyone, most_frequent_location, query_agent_own_last_move)unverifiedbelief-0.000241264/336full transcript →
openai/gpt-oss-120badversarial_belief✓PASSanswered "break room"belief-0.000267249/382full transcript →
openai/gpt-oss-120badversarial_belief✓PASSanswered "security office"belief-0.000338311/486full transcript →
openai/gpt-oss-120badversarial_belief✓PASSanswered "break room"belief-0.000200260/269full transcript →
openai/gpt-oss-120badversarial_belief✓PASSanswered "archive room"belief-0.000408319/601full transcript →
openai/gpt-oss-120badversarial_belief✓PASSanswered "break room"belief-0.000204324/259full transcript →
openai/gpt-oss-120badversarial_belief✓PASSanswered "library"belief-0.000348339/495full transcript →
openai/gpt-oss-120badversarial_belief✓PASSanswered "server room"belief-0.000315378/430full transcript →
openai/gpt-oss-120badversarial_belief✓PASSanswered "observation deck"belief-0.000305318/429full transcript →
openai/gpt-oss-120badversarial_belief✓PASSanswered "storage room"belief-0.000469371/689full transcript →
openai/gpt-oss-120badversarial_belief✓PASSanswered "east wing"belief-0.000415397/593full transcript →
openai/gpt-oss-120badversarial_belief✓PASSanswered "library"belief-0.000576361/870full transcript →
openai/gpt-oss-120badversarial_belief✓PASSanswered "lobby"belief-0.000425428/602full transcript →
openai/gpt-oss-120badversarial_belief✓PASSanswered "wine cellar"belief-0.000504414/736full transcript →
openai/gpt-oss-120badversarial_belief✓PASSanswered "lobby"belief-0.000481456/687full transcript →
openai/gpt-oss-120badversarial_belief✓PASSanswered "library"belief-0.000378355/542full transcript →
openai/gpt-oss-120badversarial_belief✓PASSanswered "south stairwell"belief-0.000435409/623full transcript →
openai/gpt-oss-120badversarial_belief✓PASSanswered "supply closet"belief-0.000405466/559full transcript →
openai/gpt-oss-120badversarial_belief✓PASSanswered "utility closet"belief-0.000110206/132full transcript →
openai/gpt-oss-120badversarial_belief✓PASSanswered "observation deck"belief-0.000146203/192full transcript →
openai/gpt-oss-120badversarial_belief✓PASSanswered "photo studio"belief-0.000163214/219full transcript →
openai/gpt-oss-120badversarial_belief✓PASSanswered "mail room"belief-0.000142222/181full transcript →
openai/gpt-oss-120badversarial_belief✓PASSanswered "north stairwell"belief-0.000162221/215full transcript →
openai/gpt-oss-120badversarial_belief✓PASSanswered "front office"belief-0.000152217/199full transcript →
openai/gpt-oss-120badversarial_belief✓PASSanswered "basement"belief-0.000208218/292full transcript →
openai/gpt-oss-120badversarial_belief✓PASSanswered "greenhouse"belief-0.000209219/294full transcript →
openai/gpt-oss-120badversarial_belief✓PASSanswered "conference room"belief-0.000190222/262full transcript →
openai/gpt-oss-120badversarial_belief✓PASSanswered "break room"belief-0.000170220/229full transcript →
openai/gpt-oss-120badversarial_belief✓PASSanswered "print room"belief-0.000207206/294full transcript →
openai/gpt-oss-120badversarial_belief✓PASSanswered "basement"belief-0.000175198/242full transcript →
openai/gpt-oss-120badversarial_belief✓PASSanswered "supply closet"belief-0.000241204/350full transcript →
openai/gpt-oss-120badversarial_belief✓PASSanswered "reception area"belief-0.000135226/169full transcript →
openai/gpt-oss-120badversarial_belief✓PASSanswered "garage"belief-0.000589210/929full transcript →
openai/gpt-oss-120badversarial_belief✓PASSanswered "mail room"belief-0.000274219/402full transcript →
openai/gpt-oss-120badversarial_belief✓PASSanswered "south stairwell"belief-0.000357215/541full transcript →