Run camp-full_map-gemma4qat-001/order
99% PASSWhat this run revealed, then every individual trial as evidence.
80
Trials
99%
79/80 scored
over trials
Pass rate
1
1 stable / 0 noise
Failures
$0.0023
Run cost
Run camp-full_map-gemma4qat-001/order: passed essentially everything (99%) -- this test did not challenge the model.
Of 80 scored trials (order query kind), the model passed 99%. That's saturation: the difficulty range probed here isn't finding this model's limits. Consider a harder preset (breaking_point or adversarial_belief) or a wider dimension range.
1 failures recorded; all 1 survived verification.
Notable failures
- record 42b3e6bf expected: firstactual: Since neither event described in your question actually occurred as stated, the question cannot b...
Trials
Per-trial table
| model | verdict | kind | difficulty | cost ($) | tokens in/out | |
|---|---|---|---|---|---|---|
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "first" | order | - | 0.000016 | 156/2 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "first" | order | - | 0.000015 | 148/2 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "first" | order | - | 0.000023 | 220/2 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "first" | order | - | 0.000016 | 153/2 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "first" | order | - | 0.000016 | 150/2 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "first" | order | - | 0.000015 | 146/2 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "first" | order | - | 0.000031 | 303/2 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "first" | order | - | 0.000023 | 223/2 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "first" | order | - | 0.000023 | 222/2 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "first" | order | - | 0.000023 | 221/2 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "first" | order | - | 0.000022 | 217/2 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "first" | order | - | 0.000032 | 317/2 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "first" | order | - | 0.000031 | 306/2 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "first" | order | - | 0.000032 | 315/2 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "first" | order | - | 0.000031 | 302/2 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "first" | order | - | 0.000040 | 395/2 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "first" | order | - | 0.000041 | 404/2 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "first" | order | - | 0.000041 | 408/2 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "first" | order | - | 0.000040 | 398/2 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "first" | order | - | 0.000041 | 405/2 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "first" | order | - | 0.000048 | 473/2 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "first" | order | - | 0.000048 | 476/2 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "first" | order | - | 0.000047 | 465/2 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "first" | order | - | 0.000048 | 471/2 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "first" | order | - | 0.000047 | 465/2 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "first" | order | - | 0.000015 | 144/2 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "first" | order | - | 0.000015 | 147/2 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "first" | order | - | 0.000016 | 150/2 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "first" | order | - | 0.000016 | 150/2 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "first" | order | - | 0.000016 | 149/2 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "first" | order | - | 0.000016 | 153/2 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "first" | order | - | 0.000016 | 150/2 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "first" | order | - | 0.000016 | 150/2 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "first" | order | - | 0.000015 | 147/2 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "first" | order | - | 0.000016 | 153/2 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "first" | order | - | 0.000016 | 151/2 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "first" | order | - | 0.000016 | 155/2 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "first" | order | - | 0.000015 | 146/2 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "first" | order | - | 0.000015 | 147/2 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "first" | order | - | 0.000015 | 146/2 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "first" | order | - | 0.000016 | 154/2 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "first" | order | - | 0.000015 | 142/2 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "first" | order | - | 0.000015 | 145/2 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "first" | order | - | 0.000016 | 153/2 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "first" | order | - | 0.000016 | 154/2 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "first" | order | - | 0.000015 | 147/2 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "first" | order | - | 0.000016 | 152/2 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "first" | order | - | 0.000016 | 152/2 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✕FAILanswered "Since neither event described in your question actually o..."verified-stable | order | - | 0.000044 | 149/97 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "first" | order | - | 0.000016 | 156/2 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "first" | order | - | 0.000015 | 147/2 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "first" | order | - | 0.000016 | 152/2 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "first" | order | - | 0.000016 | 151/2 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "first" | order | - | 0.000015 | 146/2 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "first" | order | - | 0.000015 | 146/2 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "first" | order | - | 0.000027 | 267/2 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "first" | order | - | 0.000029 | 284/2 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "first" | order | - | 0.000028 | 276/2 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "first" | order | - | 0.000028 | 278/2 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "first" | order | - | 0.000029 | 284/2 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "first" | order | - | 0.000040 | 390/2 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "first" | order | - | 0.000041 | 405/2 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "first" | order | - | 0.000040 | 398/2 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "first" | order | - | 0.000040 | 398/2 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "first" | order | - | 0.000039 | 385/2 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "first" | order | - | 0.000052 | 510/2 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "first" | order | - | 0.000052 | 517/2 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "first" | order | - | 0.000055 | 547/2 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "first" | order | - | 0.000054 | 530/2 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "first" | order | - | 0.000053 | 528/2 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "first" | order | - | 0.000066 | 657/2 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "first" | order | - | 0.000064 | 631/2 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "first" | order | - | 0.000067 | 664/2 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "first" | order | - | 0.000066 | 655/2 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "first" | order | - | 0.000062 | 616/2 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "first" | order | - | 0.000016 | 151/2 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "first" | order | - | 0.000015 | 148/2 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "first" | order | - | 0.000016 | 152/2 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "first" | order | - | 0.000016 | 150/2 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "first" | order | - | 0.000016 | 156/2 | full transcript → |