Data to …… trials

Run smoke-gemma4qat-state

PASSED

What this run revealed, then every individual trial as evidence.

1
Trials
100%
1/1 scored
Pass rate
0
0%
Failures
$0.0000
Run cost

Run smoke-gemma4qat-state: passed essentially everything (100%) -- this test did not challenge the model.

Of 1 scored trials (state query kind), the model passed 100%. That's saturation: the difficulty range probed here isn't finding this model's limits. Consider a harder preset (breaking_point or adversarial_belief) or a wider dimension range.

Trials1 trial
Per-trial table (1 trials -- prompt, reasoning, verdict, answer key)
modelverdictkinddifficultycost ($)tokens in/out
gemma-4-31b-it-qat-w4a16-ct✓PASSanswered "kitchen"state-0.000017164/2full transcript →