Run camp-full_map-gpt-oss-120b-001/belief
97% PASSWhat this run revealed, then every individual trial as evidence.
160
1 error
Trials
97%
154/159 scored
over trials
Pass rate
5
5 stable / 0 noise
Failures
$0.0351
Run cost
Run camp-full_map-gpt-oss-120b-001/belief: 97% pass rate on belief queries.
Of 159 scored trials (belief query kind), the model passed 97% and failed 3%.
1 additional trial(s) ended in ERROR (infra failures, cost cap, or cancellation) and are excluded from the pass rate above.
5 failures recorded; all 5 survived verification.
Diffuse weakness (below 90% but no outright flip) on: witness_gap (pass rate 80% at the high end).
In 3 of 5 classifiable belief failures the model reported where the object ACTUALLY was, not where the queried entity BELIEVED it was -- it collapsed their perspective into reality.
Notable failures
- record 89641036 expected: the archive roomactual: print room
- record 52ea26a5 expected: the east wingactual: conference room
- record 04f097b3 expected: the utility closetactual: library
Trials
Per-trial table
| model | verdict | kind | difficulty | cost ($) | tokens in/out | |
|---|---|---|---|---|---|---|
| openai/gpt-oss-120b | ✓PASSanswered "east wing" | belief | - | 0.000151 | 205/201 | full transcript → |
| openai/gpt-oss-120b | ✓PASSanswered "lobby" | belief | - | 0.000130 | 203/166 | full transcript → |
| openai/gpt-oss-120b | ✓PASSanswered "workshop" | belief | - | 0.000162 | 218/215 | full transcript → |
| openai/gpt-oss-120b | ✓PASSanswered "boiler room" | belief | - | 0.000139 | 219/177 | full transcript → |
| openai/gpt-oss-120b | ✓PASSanswered "garage" | belief | - | 0.000208 | 272/279 | full transcript → |
| openai/gpt-oss-120b | ✕FAILanswered "print room"verified-stable | belief | - | 0.000357 | 267/528 | full transcript → |
| openai/gpt-oss-120b | ✓PASSanswered "supply closet" | belief | - | 0.000164 | 206/222 | full transcript → |
| openai/gpt-oss-120b | ✓PASSanswered "kitchen" | belief | - | 0.000219 | 276/296 | full transcript → |
| openai/gpt-oss-120b | ✓PASSanswered "basement" | belief | - | 0.000213 | 268/288 | full transcript → |
| openai/gpt-oss-120b | ✓PASSanswered "observation deck" | belief | - | 0.000165 | 284/204 | full transcript → |
| openai/gpt-oss-120b | ✓PASSanswered "reception area" | belief | - | 0.000315 | 328/443 | full transcript → |
| openai/gpt-oss-120b | ✓PASSanswered "break room" | belief | - | 0.000208 | 300/271 | full transcript → |
| openai/gpt-oss-120b | ✓PASSanswered "garage" | belief | - | 0.000331 | 338/468 | full transcript → |
| openai/gpt-oss-120b | ✓PASSanswered "break room" | belief | - | 0.000471 | 329/703 | full transcript → |
| openai/gpt-oss-120b | ✓PASSanswered "library" | belief | - | 0.000579 | 363/874 | full transcript → |
| openai/gpt-oss-120b | ✓PASSanswered "north stairwell" | belief | - | 0.000313 | 406/420 | full transcript → |
| openai/gpt-oss-120b | ✓PASSanswered "security office" | belief | - | 0.000439 | 402/631 | full transcript → |
| openai/gpt-oss-120b | ✓PASSanswered "rooftop terrace" | belief | - | 0.000411 | 392/587 | full transcript → |
| openai/gpt-oss-120b | ✓PASSanswered "boiler room" | belief | - | 0.000318 | 313/451 | full transcript → |
| openai/gpt-oss-120b | ✓PASSanswered "cafeteria" | belief | - | 0.000508 | 418/743 | full transcript → |
| openai/gpt-oss-120b | ✓PASSanswered "reception area" | belief | - | 0.000430 | 385/620 | full transcript → |
| openai/gpt-oss-120b | ✓PASSanswered "garage" | belief | - | 0.000378 | 401/529 | full transcript → |
| openai/gpt-oss-120b | ✓PASSanswered "west wing" | belief | - | 0.000626 | 400/943 | full transcript → |
| openai/gpt-oss-120b | ✓PASSanswered "basement" | belief | - | 0.000463 | 413/668 | full transcript → |
| openai/gpt-oss-120b | ✓PASSanswered "server room" | belief | - | 0.000417 | 406/594 | full transcript → |
| openai/gpt-oss-120b | ✓PASSanswered "break room" | belief | - | 0.000122 | 222/148 | full transcript → |
| openai/gpt-oss-120b | ✓PASSanswered "photo studio" | belief | - | 0.000117 | 219/141 | full transcript → |
| openai/gpt-oss-120b | ✓PASSanswered "security office" | belief | - | 0.000163 | 201/222 | full transcript → |
| openai/gpt-oss-120b | ✓PASSanswered "loading dock" | belief | - | 0.000145 | 226/186 | full transcript → |
| openai/gpt-oss-120b | ✓PASSanswered "north stairwell" | belief | - | 0.000425 | 203/657 | full transcript → |
| openai/gpt-oss-120b | ✓PASSanswered "rooftop terrace" | belief | - | 0.000207 | 218/291 | full transcript → |
| openai/gpt-oss-120b | ✓PASSanswered "loading dock" | belief | - | 0.000263 | 205/387 | full transcript → |
| openai/gpt-oss-120b | ✓PASSanswered "library" | belief | - | 0.000181 | 206/250 | full transcript → |
| openai/gpt-oss-120b | ✕FAILanswered "conference room"verified-stable | belief | - | 0.000548 | 216/859 | full transcript → |
| openai/gpt-oss-120b | ✓PASSanswered "photo studio" | belief | - | 0.000157 | 220/207 | full transcript → |
| openai/gpt-oss-120b | ✓PASSanswered "archive room" | belief | - | 0.000181 | 205/251 | full transcript → |
| openai/gpt-oss-120b | ✓PASSanswered "front office" | belief | - | 0.000185 | 212/256 | full transcript → |
| openai/gpt-oss-120b | ✓PASSanswered "rooftop terrace" | belief | - | 0.000226 | 220/321 | full transcript → |
| openai/gpt-oss-120b | ✓PASSanswered "workshop" | belief | - | 0.000318 | 209/478 | full transcript → |
| openai/gpt-oss-120b | ✓PASSanswered "front office" | belief | - | 0.000228 | 218/325 | full transcript → |
| openai/gpt-oss-120b | ✓PASSanswered "storage room" | belief | - | 0.000175 | 204/240 | full transcript → |
| openai/gpt-oss-120b | ✓PASSanswered "security office" | belief | - | 0.000228 | 222/324 | full transcript → |
| openai/gpt-oss-120b | ✓PASSanswered "server room" | belief | - | 0.000273 | 207/403 | full transcript → |
| openai/gpt-oss-120b | ✓PASSanswered "observation deck" | belief | - | 0.000449 | 214/694 | full transcript → |
| openai/gpt-oss-120b | ✓PASSanswered "loading dock" | belief | - | 0.000280 | 224/410 | full transcript → |
| openai/gpt-oss-120b | ✓PASSanswered "west wing" | belief | - | 0.000307 | 216/458 | full transcript → |
| openai/gpt-oss-120b | ✓PASSanswered "greenhouse" | belief | - | 0.000440 | 217/679 | full transcript → |
| openai/gpt-oss-120b | ✓PASSanswered "archive room" | belief | - | 0.000254 | 223/367 | full transcript → |
| openai/gpt-oss-120b | ✓PASSanswered "cafeteria" | belief | - | 0.000201 | 219/280 | full transcript → |
| openai/gpt-oss-120b | ✓PASSanswered "utility closet" | belief | - | 0.000210 | 227/294 | full transcript → |
| openai/gpt-oss-120b | ✓PASSanswered "loading dock" | belief | - | 0.000189 | 223/259 | full transcript → |
| openai/gpt-oss-120b | ✓PASSanswered "cafeteria" | belief | - | 0.000141 | 217/181 | full transcript → |
| openai/gpt-oss-120b | ✓PASSanswered "kitchen" | belief | - | 0.000144 | 222/184 | full transcript → |
| openai/gpt-oss-120b | ✓PASSanswered "break room" | belief | - | 0.000168 | 206/228 | full transcript → |
| openai/gpt-oss-120b | ✓PASSanswered "atrium" | belief | - | 0.000152 | 236/194 | full transcript → |
| openai/gpt-oss-120b | ✓PASSanswered "north stairwell" | belief | - | 0.000158 | 232/205 | full transcript → |
| openai/gpt-oss-120b | ✓PASSanswered "east wing" | belief | - | 0.000175 | 216/238 | full transcript → |
| openai/gpt-oss-120b | ✓PASSanswered "workshop" | belief | - | 0.000102 | 214/116 | full transcript → |
| openai/gpt-oss-120b | ✓PASSanswered "server room" | belief | - | 0.000208 | 221/291 | full transcript → |
| openai/gpt-oss-120b | ✓PASSanswered "supply closet" | belief | - | 0.000178 | 225/240 | full transcript → |
| openai/gpt-oss-120b | ✓PASSanswered "garage" | belief | - | 0.000230 | 226/327 | full transcript → |
| openai/gpt-oss-120b | ✓PASSanswered "storage room" | belief | - | 0.000140 | 243/173 | full transcript → |
| openai/gpt-oss-120b | ✓PASSanswered "library" | belief | - | 0.000142 | 243/176 | full transcript → |
| openai/gpt-oss-120b | ✓PASSanswered "conference room" | belief | - | 0.000178 | 241/237 | full transcript → |
| openai/gpt-oss-120b | ✓PASSanswered "supply closet" | belief | - | 0.000105 | 251/112 | full transcript → |
| openai/gpt-oss-120b | ✓PASSanswered "south stairwell" | belief | - | 0.000130 | 253/153 | full transcript → |
| openai/gpt-oss-120b | ✓PASSanswered "kitchen" | belief | - | 0.000192 | 268/253 | full transcript → |
| openai/gpt-oss-120b | ✓PASSanswered "west wing" | belief | - | 0.000133 | 267/155 | full transcript → |
| openai/gpt-oss-120b | ✓PASSanswered "observation deck" | belief | - | 0.000312 | 275/452 | full transcript → |
| openai/gpt-oss-120b | ✓PASSanswered "north stairwell" | belief | - | 0.000212 | 283/282 | full transcript → |
| openai/gpt-oss-120b | ✓PASSanswered "security office" | belief | - | 0.000220 | 287/295 | full transcript → |
| openai/gpt-oss-120b | ✓PASSanswered "workshop" | belief | - | 0.000186 | 267/243 | full transcript → |
| openai/gpt-oss-120b | ✓PASSanswered "greenhouse" | belief | - | 0.000146 | 279/174 | full transcript → |
| openai/gpt-oss-120b | ✓PASSanswered "boiler room" | belief | - | 0.000216 | 286/288 | full transcript → |
| openai/gpt-oss-120b | ✓PASSanswered "conference room" | belief | - | 0.000265 | 286/370 | full transcript → |
| openai/gpt-oss-120b | ✓PASSanswered "south stairwell" | belief | - | 0.000145 | 219/187 | full transcript → |
| openai/gpt-oss-120b | ✓PASSanswered "server room" | belief | - | 0.000153 | 213/202 | full transcript → |
| openai/gpt-oss-120b | ✓PASSanswered "lobby" | belief | - | 0.000189 | 213/261 | full transcript → |
| openai/gpt-oss-120b | ✓PASSanswered "security office" | belief | - | 0.000161 | 223/212 | full transcript → |
| openai/gpt-oss-120b | ✓PASSanswered "break room" | belief | - | 0.000173 | 220/234 | full transcript → |
| openai/gpt-oss-120b | ✓PASSanswered "lobby" | belief | - | 0.000155 | 270/191 | full transcript → |
| openai/gpt-oss-120b | ✓PASSanswered "courtyard" | belief | - | 0.000249 | 287/343 | full transcript → |
| openai/gpt-oss-120b | ✓PASSanswered "photo studio" | belief | - | 0.000236 | 280/323 | full transcript → |
| openai/gpt-oss-120b | ✓PASSanswered "archive room" | belief | - | 0.000233 | 284/318 | full transcript → |
| openai/gpt-oss-120b | ✓PASSanswered "photo studio" | belief | - | 0.000141 | 370/143 | full transcript → |
| openai/gpt-oss-120b | ✓PASSanswered "photo studio" | belief | - | 0.000155 | 351/171 | full transcript → |
| openai/gpt-oss-120b | ✓PASSanswered "security office" | belief | - | 0.000195 | 275/257 | full transcript → |
| openai/gpt-oss-120b | ✓PASSanswered "north stairwell" | belief | - | 0.000171 | 362/195 | full transcript → |
| openai/gpt-oss-120b | ✓PASSanswered "basement" | belief | - | 0.000169 | 357/193 | full transcript → |
| openai/gpt-oss-120b | ✓PASSanswered "front office" | belief | - | 0.000154 | 369/164 | full transcript → |
| openai/gpt-oss-120b | ✓PASSanswered "reception area" | belief | - | 0.000161 | 448/157 | full transcript → |
| openai/gpt-oss-120b | ✓PASSanswered "rooftop terrace" | belief | - | 0.000140 | 454/120 | full transcript → |
| openai/gpt-oss-120b | ✓PASSanswered "storage room" | belief | - | 0.000144 | 457/126 | full transcript → |
| openai/gpt-oss-120b | ✓PASSanswered "south stairwell" | belief | - | 0.000151 | 448/139 | full transcript → |
| openai/gpt-oss-120b | ✓PASSanswered "east wing" | belief | - | 0.000238 | 551/259 | full transcript → |
| openai/gpt-oss-120b | ✓PASSanswered "archive room" | belief | - | 0.000141 | 462/119 | full transcript → |
| openai/gpt-oss-120b | ✓PASSanswered "meditation room" | belief | - | 0.000182 | 537/169 | full transcript → |
| openai/gpt-oss-120b | ✓PASSanswered "wine cellar" | belief | - | 0.000190 | 516/188 | full transcript → |
| openai/gpt-oss-120b | ✓PASSanswered "reception area" | belief | - | 0.000148 | 512/118 | full transcript → |
| openai/gpt-oss-120b | ✓PASSanswered "courtyard" | belief | - | 0.000322 | 520/406 | full transcript → |
| openai/gpt-oss-120b | ✓PASSanswered "basement" | belief | - | 0.000119 | 216/144 | full transcript → |
| openai/gpt-oss-120b | ✓PASSanswered "gym" | belief | - | 0.000145 | 218/188 | full transcript → |
| openai/gpt-oss-120b | ✓PASSanswered "observation deck" | belief | - | 0.000178 | 219/242 | full transcript → |
| openai/gpt-oss-120b | ✓PASSanswered "south stairwell" | belief | - | 0.000108 | 203/130 | full transcript → |
| openai/gpt-oss-120b | ✓PASSanswered "kitchen" | belief | - | 0.000221 | 216/314 | full transcript → |
| openai/gpt-oss-120b | ✓PASSanswered "server room" | belief | - | 0.000184 | 205/256 | full transcript → |
| openai/gpt-oss-120b | ✕FAILanswered "library"verified-stable | belief | - | 0.000238 | 217/343 | full transcript → |
| openai/gpt-oss-120b | ✓PASSanswered "kitchen" | belief | - | 0.000161 | 219/214 | full transcript → |
| openai/gpt-oss-120b | ✓PASSanswered "library" | belief | - | 0.000168 | 205/229 | full transcript → |
| openai/gpt-oss-120b | ✓PASSanswered "print room" | belief | - | 0.000175 | 209/240 | full transcript → |
| openai/gpt-oss-120b | ✓PASSanswered "workshop" | belief | - | 0.000116 | 223/138 | full transcript → |
| openai/gpt-oss-120b | ✓PASSanswered "east wing" | belief | - | 0.000187 | 206/261 | full transcript → |
| openai/gpt-oss-120b | ✕FAILanswered "reception"verified-stable | belief | - | 0.000138 | 217/176 | full transcript → |
| openai/gpt-oss-120b | ✓PASSanswered "library" | belief | - | 0.000185 | 200/259 | full transcript → |
| openai/gpt-oss-120b | ✓PASSanswered "boiler room" | belief | - | 0.000133 | 212/169 | full transcript → |
| openai/gpt-oss-120b | ✓PASSanswered "mail room" | belief | - | 0.000109 | 205/131 | full transcript → |
| openai/gpt-oss-120b | ✕ERRORhttp 429: b'{"error":{"message":"Rate limit reached for model `openai/gpt-oss-120b` in organization `org_01jpwfsbh0f7atrs0qxaewb6b7` service tier `on_demand` on tokens per minute (TPM): Limit 8000, Used 7368, Req' | belief | - | 0.000000 | 0/0 | full transcript → |
| openai/gpt-oss-120b | ✓PASSanswered "observation deck" | belief | - | 0.000147 | 202/195 | full transcript → |
| openai/gpt-oss-120b | ✓PASSanswered "wine cellar" | belief | - | 0.000267 | 221/390 | full transcript → |
| openai/gpt-oss-120b | ✓PASSanswered "courtyard" | belief | - | 0.000117 | 203/144 | full transcript → |
| openai/gpt-oss-120b | ✓PASSanswered "south stairwell" | belief | - | 0.000233 | 209/336 | full transcript → |
| openai/gpt-oss-120b | ✓PASSanswered "storage room" | belief | - | 0.000103 | 201/122 | full transcript → |
| openai/gpt-oss-120b | ✓PASSanswered "utility closet" | belief | - | 0.000147 | 207/194 | full transcript → |
| openai/gpt-oss-120b | ✓PASSanswered "cafeteria" | belief | - | 0.000164 | 213/220 | full transcript → |
| openai/gpt-oss-120b | ✓PASSanswered "rooftop terrace" | belief | - | 0.000144 | 205/188 | full transcript → |
| openai/gpt-oss-120b | ✓PASSanswered "atrium" | belief | - | 0.000193 | 226/266 | full transcript → |
| openai/gpt-oss-120b | ✓PASSanswered "south stairwell" | belief | - | 0.000194 | 226/267 | full transcript → |
| openai/gpt-oss-120b | ✓PASSanswered "workshop" | belief | - | 0.000143 | 210/186 | full transcript → |
| openai/gpt-oss-120b | ✓PASSanswered "greenhouse" | belief | - | 0.000173 | 201/238 | full transcript → |
| openai/gpt-oss-120b | ✓PASSanswered "boiler room" | belief | - | 0.000180 | 217/245 | full transcript → |
| openai/gpt-oss-120b | ✓PASSanswered "atrium" | belief | - | 0.000181 | 201/251 | full transcript → |
| openai/gpt-oss-120b | ✓PASSanswered "library" | belief | - | 0.000261 | 224/379 | full transcript → |
| openai/gpt-oss-120b | ✓PASSanswered "south stairwell" | belief | - | 0.000217 | 215/308 | full transcript → |
| openai/gpt-oss-120b | ✓PASSanswered "south stairwell" | belief | - | 0.000190 | 210/265 | full transcript → |
| openai/gpt-oss-120b | ✓PASSanswered "server room" | belief | - | 0.000143 | 221/183 | full transcript → |
| openai/gpt-oss-120b | ✓PASSanswered "observation deck" | belief | - | 0.000152 | 206/202 | full transcript → |
| openai/gpt-oss-120b | ✓PASSanswered "utility closet" | belief | - | 0.000126 | 223/155 | full transcript → |
| openai/gpt-oss-120b | ✓PASSanswered "reception area" | belief | - | 0.000120 | 223/145 | full transcript → |
| openai/gpt-oss-120b | ✓PASSanswered "library" | belief | - | 0.000120 | 202/150 | full transcript → |
| openai/gpt-oss-120b | ✓PASSanswered "south stairwell" | belief | - | 0.000274 | 213/404 | full transcript → |
| openai/gpt-oss-120b | ✓PASSanswered "front office" | belief | - | 0.000155 | 224/203 | full transcript → |
| openai/gpt-oss-120b | ✓PASSanswered "print room" | belief | - | 0.000162 | 218/216 | full transcript → |
| openai/gpt-oss-120b | ✓PASSanswered "mail room" | belief | - | 0.000141 | 217/181 | full transcript → |
| openai/gpt-oss-120b | ✓PASSanswered "security office" | belief | - | 0.000127 | 221/157 | full transcript → |
| openai/gpt-oss-120b | ✓PASSanswered "supply closet" | belief | - | 0.000180 | 222/244 | full transcript → |
| openai/gpt-oss-120b | ✓PASSanswered "front office" | belief | - | 0.000159 | 210/213 | full transcript → |
| openai/gpt-oss-120b | ✓PASSanswered "meditation room" | belief | - | 0.000128 | 219/158 | full transcript → |
| openai/gpt-oss-120b | ✓PASSanswered "security office" | belief | - | 0.000131 | 215/165 | full transcript → |
| openai/gpt-oss-120b | ✓PASSanswered "west wing" | belief | - | 0.000196 | 222/272 | full transcript → |
| openai/gpt-oss-120b | ✓PASSanswered "observation deck" | belief | - | 0.000119 | 202/148 | full transcript → |
| openai/gpt-oss-120b | ✓PASSanswered "utility closet" | belief | - | 0.000137 | 209/176 | full transcript → |
| openai/gpt-oss-120b | ✓PASSanswered "courtyard" | belief | - | 0.000120 | 221/145 | full transcript → |
| openai/gpt-oss-120b | ✓PASSanswered "loading dock" | belief | - | 0.000151 | 224/195 | full transcript → |
| openai/gpt-oss-120b | ✓PASSanswered "rooftop terrace" | belief | - | 0.000094 | 201/107 | full transcript → |
| openai/gpt-oss-120b | ✓PASSanswered "break room" | belief | - | 0.000186 | 222/255 | full transcript → |
| openai/gpt-oss-120b | ✓PASSanswered "courtyard" | belief | - | 0.000492 | 762/630 | full transcript → |
| openai/gpt-oss-120b | ✓PASSanswered "security office" | belief | - | 0.000279 | 779/270 | full transcript → |
| openai/gpt-oss-120b | ✕FAILanswered "unknown"verified-stable | belief | - | 0.000513 | 752/667 | full transcript → |
| openai/gpt-oss-120b | ✓PASSanswered "garage" | belief | - | 0.000486 | 763/620 | full transcript → |
| openai/gpt-oss-120b | ✓PASSanswered "greenhouse" | belief | - | 0.001263 | 770/1913 | full transcript → |