Run camp-tool-deep-gemma4qat-001
73% PASSWhat this run revealed, then every individual trial as evidence.
164
2 errors
Trials
73%
119/162 scored
over trials
Pass rate
43
Failures
$0.0541
Run cost
Run camp-tool-deep-gemma4qat-001: 73% pass rate on tool queries.
Of 162 scored trials (tool query kind), the model passed 73% and failed 27%.
2 additional trial(s) ended in ERROR (infra failures, cost cap, or cancellation) and are excluded from the pass rate above.
43 failure(s) recorded; failures not yet verified -- use "Verify failures" on this page (or scripts/verify_past_failures.py).
Notable failures
- record 74ce2834 expected: (unknown)actual: ]
- record 76b4339b expected: (unknown)actual: ```
- record 24466dc1 expected: (unknown)actual: ```
Trials
Per-trial table
| model | verdict | kind | difficulty | cost ($) | tokens in/out | |
|---|---|---|---|---|---|---|
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "]" | tool_plan | - | 0.000132 | 791/177 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "]" | tool_plan | - | 0.000132 | 794/174 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "]" | tool_plan | - | 0.000132 | 790/176 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ?FAILanswered "]" (world seeded for: id_collisions_on=1)unverified | tool_plan | - | 0.000132 | 790/176 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "]" | tool_plan | - | 0.000133 | 795/177 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "]" | tool_plan | - | 0.000131 | 788/174 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "]" | tool_plan | - | 0.000132 | 795/175 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "]" | tool_plan | - | 0.000197 | 1100/291 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "]" | tool_plan | - | 0.000198 | 1103/293 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "]" | tool_plan | - | 0.000200 | 1111/295 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "]" | tool_plan | - | 0.000199 | 1107/295 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "]" | tool_plan | - | 0.000199 | 1106/296 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "]" | tool_plan | - | 0.000200 | 1110/295 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "]" | tool_plan | - | 0.000199 | 1107/293 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "]" | tool_plan | - | 0.000247 | 1337/378 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "]" | tool_plan | - | 0.000249 | 1339/382 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "]" | tool_plan | - | 0.000248 | 1338/382 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "]" | tool_plan | - | 0.000249 | 1341/384 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "]" | tool_plan | - | 0.000249 | 1343/383 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "]" | tool_plan | - | 0.000249 | 1343/383 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "]" | tool_plan | - | 0.000249 | 1340/383 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "```" | tool_plan | - | 0.000319 | 1662/508 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ?FAILanswered "```" (world seeded for: id_collisions_on=1)unverified | tool_plan | - | 0.000319 | 1660/510 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ?FAILanswered "```" (world seeded for: id_collisions_on=1)unverified | tool_plan | - | 0.000320 | 1662/511 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "```" | tool_plan | - | 0.000319 | 1660/509 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ?FAILanswered "```" (world seeded for: id_collisions_on=1)unverified | tool_plan | - | 0.000320 | 1671/510 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "```" | tool_plan | - | 0.000319 | 1661/510 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ?FAILanswered "```" (world seeded for: id_collisions_on=1)unverified | tool_plan | - | 0.000317 | 1656/504 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "```" | tool_plan | - | 0.000372 | 1909/604 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "```" | tool_plan | - | 0.000372 | 1908/605 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "```" | tool_plan | - | 0.000371 | 1906/603 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ?FAILanswered "```" (world seeded for: id_collisions_on=1)unverified | tool_plan | - | 0.000370 | 1900/599 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "```" | tool_plan | - | 0.000372 | 1908/605 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "```" | tool_plan | - | 0.000371 | 1906/603 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "```" | tool_plan | - | 0.000370 | 1904/599 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ?FAILanswered "```" (world seeded for: id_collisions_on=1)unverified | tool_plan | - | 0.000443 | 2237/731 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "```" | tool_plan | - | 0.000442 | 2237/728 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "```" | tool_plan | - | 0.000444 | 2245/733 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ?FAILanswered "```" (world seeded for: id_collisions_on=1)unverified | tool_plan | - | 0.000443 | 2239/732 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ?FAILanswered "```" (world seeded for: id_collisions_on=1)unverified | tool_plan | - | 0.000444 | 2239/734 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ?FAILanswered "```" (world seeded for: id_collisions_on=1)unverified | tool_plan | - | 0.000444 | 2237/733 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ?FAILanswered "```" (world seeded for: id_collisions_on=1)unverified | tool_plan | - | 0.000445 | 2240/735 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "```" | tool_plan | - | 0.000403 | 2062/656 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ?FAILanswered "```" (world seeded for: id_collisions_on=1)unverified | tool_plan | - | 0.000406 | 2071/664 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "```" | tool_plan | - | 0.000407 | 2074/665 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "```" | tool_plan | - | 0.000405 | 2070/661 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "```" | tool_plan | - | 0.000408 | 2079/667 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ?FAILanswered "```" (world seeded for: id_collisions_on=1)unverified | tool_plan | - | 0.000410 | 2082/673 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "```" | tool_plan | - | 0.000408 | 2078/666 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ?FAILanswered "```" (world seeded for: id_collisions_on=1)unverified | tool_plan | - | 0.000423 | 2147/693 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "```" | tool_plan | - | 0.000424 | 2153/695 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "```" | tool_plan | - | 0.000425 | 2156/697 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "```" | tool_plan | - | 0.000424 | 2151/696 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "```" | tool_plan | - | 0.000425 | 2154/700 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "```" | tool_plan | - | 0.000425 | 2154/698 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✕ERRORtimeout | tool_plan | - | 0.000000 | 0/0 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "```" | tool_plan | - | 0.000441 | 2231/727 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "```" | tool_plan | - | 0.000440 | 2229/725 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "```" | tool_plan | - | 0.000441 | 2233/726 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "```" | tool_plan | - | 0.000444 | 2240/732 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "```" | tool_plan | - | 0.000444 | 2242/733 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ?FAILanswered "```" (world seeded for: id_collisions_on=1)unverified | tool_plan | - | 0.000445 | 2240/736 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ?FAILanswered "```" (world seeded for: id_collisions_on=1)unverified | tool_plan | - | 0.000441 | 2234/726 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "```" | tool_plan | - | 0.000441 | 2232/727 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ?FAILanswered "```" (world seeded for: id_collisions_on=1)unverified | tool_plan | - | 0.000446 | 2243/738 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ?FAILanswered "```" (world seeded for: id_collisions_on=1)unverified | tool_plan | - | 0.000443 | 2235/731 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "```" | tool_plan | - | 0.000443 | 2237/731 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "```" | tool_plan | - | 0.000442 | 2233/728 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ?FAILanswered "```" (world seeded for: id_collisions_on=1)unverified | tool_plan | - | 0.000443 | 2239/730 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "```" | tool_plan | - | 0.000443 | 2236/732 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "```" | tool_plan | - | 0.000440 | 2228/724 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ?FAILanswered "```" (world seeded for: id_collisions_on=1)unverified | tool_plan | - | 0.000442 | 2233/729 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "```" | tool_plan | - | 0.000443 | 2236/731 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "```" | tool_plan | - | 0.000443 | 2238/732 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "```" | tool_plan | - | 0.000442 | 2235/729 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "```" | tool_plan | - | 0.000443 | 2236/732 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ?FAILanswered "```" (world seeded for: id_collisions_on=1)unverified | tool_plan | - | 0.000443 | 2236/731 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "]" | tool_plan | - | 0.000133 | 798/178 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "]" | tool_plan | - | 0.000131 | 789/174 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "]" | tool_plan | - | 0.000132 | 791/175 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "]" | tool_plan | - | 0.000131 | 786/174 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "]" | tool_plan | - | 0.000132 | 792/175 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "]" | tool_plan | - | 0.000132 | 789/176 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "]" | tool_plan | - | 0.000131 | 791/174 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "]" | tool_plan | - | 0.000132 | 794/174 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ?FAILanswered "]" (world seeded for: id_collisions_on=1)unverified | tool_plan | - | 0.000132 | 790/176 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "]" | tool_plan | - | 0.000132 | 791/177 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "]" | tool_plan | - | 0.000132 | 790/176 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "]" | tool_plan | - | 0.000133 | 795/177 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "]" | tool_plan | - | 0.000131 | 788/174 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "]" | tool_plan | - | 0.000132 | 795/175 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "]" | tool_plan | - | 0.000197 | 1100/291 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "]" | tool_plan | - | 0.000200 | 1111/295 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "]" | tool_plan | - | 0.000200 | 1110/295 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "]" | tool_plan | - | 0.000199 | 1107/295 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "]" | tool_plan | - | 0.000198 | 1103/293 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "]" | tool_plan | - | 0.000199 | 1106/296 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "]" | tool_plan | - | 0.000249 | 1341/384 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "]" | tool_plan | - | 0.000249 | 1339/382 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "]" | tool_plan | - | 0.000249 | 1343/383 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "]" | tool_plan | - | 0.000247 | 1337/378 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "]" | tool_plan | - | 0.000249 | 1343/383 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "]" | tool_plan | - | 0.000248 | 1338/382 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "```" | tool_plan | - | 0.000319 | 1662/508 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "```" | tool_plan | - | 0.000319 | 1660/509 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ?FAILanswered "```" (world seeded for: id_collisions_on=1)unverified | tool_plan | - | 0.000319 | 1660/510 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "```" | tool_plan | - | 0.000319 | 1661/510 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ?FAILanswered "```" (world seeded for: id_collisions_on=1)unverified | tool_plan | - | 0.000320 | 1662/511 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ?FAILanswered "```" (world seeded for: id_collisions_on=1)unverified | tool_plan | - | 0.000320 | 1671/510 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "```" | tool_plan | - | 0.000370 | 1904/599 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "```" | tool_plan | - | 0.000372 | 1908/605 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "```" | tool_plan | - | 0.000372 | 1908/605 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "```" | tool_plan | - | 0.000372 | 1909/604 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "```" | tool_plan | - | 0.000371 | 1906/603 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ?FAILanswered "```" (world seeded for: id_collisions_on=1)unverified | tool_plan | - | 0.000370 | 1900/599 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ?FAILanswered "```" (world seeded for: id_collisions_on=1)unverified | tool_plan | - | 0.000443 | 2239/732 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "```" | tool_plan | - | 0.000442 | 2237/728 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ?FAILanswered "```" (world seeded for: id_collisions_on=1)unverified | tool_plan | - | 0.000443 | 2237/731 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ?FAILanswered "```" (world seeded for: id_collisions_on=1)unverified | tool_plan | - | 0.000444 | 2239/734 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "```" | tool_plan | - | 0.000444 | 2245/733 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ?FAILanswered "```" (world seeded for: id_collisions_on=1)unverified | tool_plan | - | 0.000444 | 2237/733 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ?FAILanswered "```" (world seeded for: id_collisions_on=1)unverified | tool_plan | - | 0.000445 | 2240/735 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "```" | tool_plan | - | 0.000403 | 2062/656 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "```" | tool_plan | - | 0.000407 | 2074/665 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "```" | tool_plan | - | 0.000405 | 2070/661 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ?FAILanswered "```" (world seeded for: id_collisions_on=1)unverified | tool_plan | - | 0.000406 | 2071/664 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "```" | tool_plan | - | 0.000408 | 2079/667 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ?FAILanswered "```" (world seeded for: id_collisions_on=1)unverified | tool_plan | - | 0.000410 | 2082/673 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "```" | tool_plan | - | 0.000408 | 2078/666 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ?FAILanswered "```" (world seeded for: id_collisions_on=1)unverified | tool_plan | - | 0.000424 | 2153/695 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ?FAILanswered "```" (world seeded for: id_collisions_on=1)unverified | tool_plan | - | 0.000423 | 2147/693 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "```" | tool_plan | - | 0.000425 | 2156/697 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "```" | tool_plan | - | 0.000424 | 2151/696 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "```" | tool_plan | - | 0.000425 | 2154/700 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✕ERRORtimeout | tool_plan | - | 0.000000 | 0/0 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "```" | tool_plan | - | 0.000425 | 2154/698 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "```" | tool_plan | - | 0.000440 | 2229/725 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "```" | tool_plan | - | 0.000444 | 2240/732 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "```" | tool_plan | - | 0.000441 | 2231/727 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ?FAILanswered "```" (world seeded for: id_collisions_on=1)unverified | tool_plan | - | 0.000441 | 2233/726 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "```" | tool_plan | - | 0.000444 | 2242/733 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ?FAILanswered "```" (world seeded for: id_collisions_on=1)unverified | tool_plan | - | 0.000445 | 2240/736 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ?FAILanswered "```" (world seeded for: id_collisions_on=1)unverified | tool_plan | - | 0.000441 | 2234/726 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "```" | tool_plan | - | 0.000441 | 2232/727 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ?FAILanswered "```" (world seeded for: id_collisions_on=1)unverified | tool_plan | - | 0.000446 | 2243/738 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ?FAILanswered "```" (world seeded for: id_collisions_on=1)unverified | tool_plan | - | 0.000443 | 2235/731 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "```" | tool_plan | - | 0.000443 | 2237/731 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "```" | tool_plan | - | 0.000442 | 2233/728 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ?FAILanswered "```" (world seeded for: id_collisions_on=1)unverified | tool_plan | - | 0.000443 | 2239/730 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "```" | tool_plan | - | 0.000443 | 2236/732 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "```" | tool_plan | - | 0.000440 | 2228/724 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ?FAILanswered "```" (world seeded for: id_collisions_on=1)unverified | tool_plan | - | 0.000442 | 2233/729 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "```" | tool_plan | - | 0.000443 | 2236/731 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "```" | tool_plan | - | 0.000443 | 2238/732 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "```" | tool_plan | - | 0.000442 | 2235/729 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "```" | tool_plan | - | 0.000443 | 2236/732 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ?FAILanswered "```" (world seeded for: id_collisions_on=1)unverified | tool_plan | - | 0.000443 | 2236/731 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "]" | tool_plan | - | 0.000133 | 798/178 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "]" | tool_plan | - | 0.000131 | 789/174 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "]" | tool_plan | - | 0.000132 | 791/175 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "]" | tool_plan | - | 0.000131 | 786/174 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "]" | tool_plan | - | 0.000132 | 792/175 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "]" | tool_plan | - | 0.000132 | 789/176 | full transcript → |
| gemma-4-31b-it-qat-w4a16-ct | ✓PASSanswered "]" | tool_plan | - | 0.000131 | 791/174 | full transcript → |