Run camp-full_map-nvidia-nemotron-3-nano-30b-a3b-001/belief

Run camp-full_map-nvidia-nemotron-3-nano-30b-a3b-001/belief: 93% pass rate on belief queries.

Of 189 scored trials (belief query kind), the model passed 93% and failed 7%.

4 additional trial(s) ended in ERROR (infra failures, cost cap, or cancellation) and are excluded from the pass rate above.

20 failures recorded; 13 survived verification (7 were sampling noise and are excluded from findings).

Diffuse weakness (below 90% but no outright flip) on: entity_state (pass rate 83% at the high end).

In 10 of 13 classifiable belief failures the model reported where the object ACTUALLY was, not where the queried entity BELIEVED it was -- it collapsed their perspective into reality.

Notable failures

• record 1ca1ef22 — asked "Where does Dexter believe the faded box is? Answer with only the location name (or 'unknown' if they have no belief)."
  expected: the archive room
  actual: print room

  the model reported the object's TRUE final location, not what the queried entity actually believed -- it collapsed belief into reality

• record c17d271f — asked "Where does Freya believe the green tablet is? Answer with only the location name (or 'unknown' if they have no belief)."
  expected: the north stairwell
  actual: rooftop terrace

  the model reported the object's TRUE final location, not what the queried entity actually believed -- it collapsed belief into reality

• record f999f214 — asked "Where does Felix believe the small basket is? Answer with only the location name (or 'unknown' if they have no belief)."
  expected: the boiler room
  actual: utility closet

  the model's answer matches no known shortcut -- an unclassified miss