Trials · tool_plan
Every trial behind one square of the capability map: Gemma 3 27B on tool_plan.
398
0 errors
Trials in this cell
55%
219/398 scored
Pass rate
179
0 noise excluded
Real failures
$0.0698
Cell cost
Trials
| kind | verdict | realized dims | seeded traps | run | |
|---|---|---|---|---|---|
| tool_plan | ?FAILanswered "```"unverified | smoke-gemma-tool | transcript → | ||
| tool_plan | ✓PASSanswered "```" | poison_traps=0 | camp-tool_bp-gemma-001 | transcript → | |
| tool_plan | ✓PASSanswered "```" | poison_traps=0 | camp-tool_bp-gemma-001 | transcript → | |
| tool_plan | ✓PASSanswered "```" | poison_traps=0 | camp-tool_bp-gemma-001 | transcript → | |
| tool_plan | ✓PASSanswered "```" | poison_traps=0 | camp-tool_bp-gemma-001 | transcript → | |
| tool_plan | ✓PASSanswered "```" | poison_traps=0 | camp-tool_bp-gemma-001 | transcript → | |
| tool_plan | ✓PASSanswered "```" | poison_traps=0 | camp-tool_bp-gemma-001 | transcript → | |
| tool_plan | ?FAILanswered "```"unverified | camp-irrelevance-gemma-001 | transcript → | ||
| tool_plan | ?FAILanswered "```"unverified | camp-irrelevance-gemma-001 | transcript → | ||
| tool_plan | ?FAILanswered "```"unverified | camp-irrelevance-gemma-001 | transcript → | ||
| tool_plan | ✓PASSanswered "```" | dishonest_decoys_on=1 | camp-tool-confuse-gemma-001 | transcript → | |
| tool_plan | ?FAILanswered "```"unverified | id_collisions_on=0 | camp-tool-depth-gemma-003 | transcript → | |
| tool_plan | ✓PASSanswered "```" | dishonest_decoys_on=1 | camp-tool-confuse-gemma-001 | transcript → | |
| tool_plan | ✓PASSanswered "```" | camp-irrelevance-gemma-001 | transcript → | ||
| tool_plan | ✓PASSanswered "```" | dishonest_decoys_on=1 | camp-tool-confuse-gemma-001 | transcript → | |
| tool_plan | ✓PASSanswered "```" | dishonest_decoys_on=1 | camp-tool-confuse-gemma-001 | transcript → | |
| tool_plan | ✓PASSanswered "```" | camp-irrelevance-gemma-001 | transcript → | ||
| tool_plan | ✓PASSanswered "```" | dishonest_decoys_on=1 | camp-tool-confuse-gemma-001 | transcript → | |
| tool_plan | ✓PASSanswered "]" | id_collisions_on=0 | camp-tool-depth-gemma-003 | transcript → | |
| tool_plan | ✓PASSanswered "```" | dishonest_decoys_on=1 | camp-tool-confuse-gemma-001 | transcript → | |
| tool_plan | ✓PASSanswered "```" | camp-irrelevance-gemma-001 | transcript → | ||
| tool_plan | ✓PASSanswered "```" | id_collisions_on=0 | camp-tool-depth-gemma-003 | transcript → | |
| tool_plan | ✓PASSanswered "```" | poison_traps=0 | camp-tool_bp-gemma-001 | transcript → | |
| tool_plan | ✓PASSanswered "```" | id_collisions_on=1 | camp-tool-deep-gemma-001 | transcript → | |
| tool_plan | ✓PASSanswered "```" | id_collisions_on=1 | camp-tool-deep-gemma-001 | transcript → | |
| tool_plan | ?FAILanswered "```"unverified | id_collisions_on=1 | camp-tool-deep-gemma-001 | transcript → | |
| tool_plan | ✓PASSanswered "```" | id_collisions_on=0 | camp-tool-depth-gemma-003 | transcript → | |
| tool_plan | ✓PASSanswered "```" | id_collisions_on=0 | camp-tool-depth-gemma-003 | transcript → | |
| tool_plan | ✓PASSanswered "```" | id_collisions_on=0 | camp-tool-depth-gemma-003 | transcript → | |
| tool_plan | ✓PASSanswered "```" | id_collisions_on=1 | camp-tool-deep-gemma-001 | transcript → | |
| tool_plan | ✓PASSanswered "```" | id_collisions_on=1 | camp-tool-deep-gemma-001 | transcript → | |
| tool_plan | ✓PASSanswered "```" | id_collisions_on=1 | camp-tool-deep-gemma-001 | transcript → | |
| tool_plan | ✓PASSanswered "```" | camp-irrelevance-gemma-001 | transcript → | ||
| tool_plan | ✓PASSanswered "```" | poison_traps=0 | camp-tool_bp-gemma-001 | transcript → | |
| tool_plan | ✓PASSanswered "```" | poison_traps=0 | camp-tool_bp-gemma-001 | transcript → | |
| tool_plan | ✓PASSanswered "```" | poison_traps=0 | camp-tool_bp-gemma-001 | transcript → | |
| tool_plan | ✓PASSanswered "```" | poison_traps=0 | camp-tool_bp-gemma-001 | transcript → | |
| tool_plan | ?FAILanswered "```"unverified | camp-irrelevance-gemma-001 | transcript → | ||
| tool_plan | ?FAILanswered "```"unverified | camp-irrelevance-gemma-001 | transcript → | ||
| tool_plan | ✓PASSanswered "```" | poison_traps=0 | camp-tool_bp-gemma-001 | transcript → | |
| tool_plan | ✓PASSanswered "```" | poison_traps=0 | camp-tool_bp-gemma-001 | transcript → | |
| tool_plan | ?FAILanswered "```"unverified | camp-irrelevance-gemma-001 | transcript → | ||
| tool_plan | ?FAILanswered "```"unverified | camp-irrelevance-gemma-001 | transcript → | ||
| tool_plan | ✓PASSanswered "```" | dishonest_decoys_on=1 | camp-tool-confuse-gemma-001 | transcript → | |
| tool_plan | ✓PASSanswered "```" | id_collisions_on=0 | camp-tool-depth-gemma-003 | transcript → | |
| tool_plan | ✓PASSanswered "```" | camp-irrelevance-gemma-001 | transcript → | ||
| tool_plan | ?FAILanswered "```"unverified | id_collisions_on=1 | camp-tool-deep-gemma-001 | transcript → | |
| tool_plan | ✓PASSanswered "```" | poison_traps=0 | camp-tool_bp-gemma-001 | transcript → | |
| tool_plan | ✓PASSanswered "```" | camp-irrelevance-gemma-001 | transcript → | ||
| tool_plan | ✓PASSanswered "```" | camp-irrelevance-gemma-001 | transcript → | ||
| tool_plan | ✓PASSanswered "```" | camp-irrelevance-gemma-001 | transcript → | ||
| tool_plan | ?FAILanswered "```"unverified | dishonest_decoys_on=1 | camp-tool-confuse-gemma-001 | transcript → | |
| tool_plan | ?FAILanswered "```"unverified | dishonest_decoys_on=1 | camp-tool-confuse-gemma-001 | transcript → | |
| tool_plan | ✓PASSanswered "```" | dishonest_decoys_on=1 | camp-tool-confuse-gemma-001 | transcript → | |
| tool_plan | ✓PASSanswered "```" | dishonest_decoys_on=1 | camp-tool-confuse-gemma-001 | transcript → | |
| tool_plan | ✓PASSanswered "```" | camp-irrelevance-gemma-001 | transcript → | ||
| tool_plan | ✓PASSanswered "```" | camp-irrelevance-gemma-001 | transcript → | ||
| tool_plan | ✓PASSanswered "```" | dishonest_decoys_on=1 | camp-tool-confuse-gemma-001 | transcript → | |
| tool_plan | ✓PASSanswered "```" | dishonest_decoys_on=1 | camp-tool-confuse-gemma-001 | transcript → | |
| tool_plan | ?FAILanswered "```"unverified | camp-irrelevance-gemma-001 | transcript → | ||
| tool_plan | ?FAILanswered "```"unverified | camp-irrelevance-gemma-001 | transcript → | ||
| tool_plan | ?FAILanswered "```"unverified | poison_traps=0 | camp-tool_bp-gemma-001 | transcript → | |
| tool_plan | ?FAILanswered "```"unverified | poison_traps=0 | camp-tool_bp-gemma-001 | transcript → | |
| tool_plan | ✓PASSanswered "```" | poison_traps=0 | camp-tool_bp-gemma-001 | transcript → | |
| tool_plan | ✓PASSanswered "```" | poison_traps=0 | camp-tool_bp-gemma-001 | transcript → | |
| tool_plan | ?FAILanswered "```"unverified | id_collisions_on=0 | camp-tool-depth-gemma-003 | transcript → | |
| tool_plan | ?FAILanswered "```"unverified | id_collisions_on=0 | camp-tool-depth-gemma-003 | transcript → | |
| tool_plan | ✓PASSanswered "```" | camp-irrelevance-gemma-001 | transcript → | ||
| tool_plan | ✓PASSanswered "```" | id_collisions_on=0 | camp-tool-depth-gemma-003 | transcript → | |
| tool_plan | ✓PASSanswered "```" | id_collisions_on=0 | camp-tool-depth-gemma-003 | transcript → | |
| tool_plan | ✓PASSanswered "```" | id_collisions_on=0 | camp-tool-depth-gemma-003 | transcript → | |
| tool_plan | ✓PASSanswered "```" | poison_traps=0 | camp-tool_bp-gemma-001 | transcript → | |
| tool_plan | ✓PASSanswered "```" | poison_traps=0 | camp-tool_bp-gemma-001 | transcript → | |
| tool_plan | ?FAILanswered "```"unverified | camp-irrelevance-gemma-001 | transcript → | ||
| tool_plan | ✓PASSanswered "```" | id_collisions_on=0 | camp-tool-depth-gemma-003 | transcript → | |
| tool_plan | ?FAILanswered "```"unverified | camp-irrelevance-gemma-001 | transcript → | ||
| tool_plan | ✓PASSanswered "```" | dishonest_decoys_on=1 | camp-tool-confuse-gemma-001 | transcript → | |
| tool_plan | ✓PASSanswered "]" | camp-irrelevance-gemma-001 | transcript → | ||
| tool_plan | ✓PASSanswered "```" | camp-irrelevance-gemma-001 | transcript → | ||
| tool_plan | ✓PASSanswered "```" | camp-irrelevance-gemma-001 | transcript → | ||
| tool_plan | ?FAILanswered "```"unverified | id_collisions_on=1 | camp-tool-deep-gemma-001 | transcript → | |
| tool_plan | ✓PASSanswered "```" | id_collisions_on=1 | camp-tool-deep-gemma-001 | transcript → | |
| tool_plan | ✓PASSanswered "```" | id_collisions_on=1 | camp-tool-deep-gemma-001 | transcript → | |
| tool_plan | ?FAILanswered "```"unverified | poison_traps=0 | camp-tool_bp-gemma-001 | transcript → | |
| tool_plan | ✓PASSanswered "]" | camp-irrelevance-gemma-001 | transcript → | ||
| tool_plan | ✓PASSanswered "```" | id_collisions_on=1 | camp-tool-deep-gemma-001 | transcript → | |
| tool_plan | ✓PASSanswered "```" | id_collisions_on=1 | camp-tool-deep-gemma-001 | transcript → | |
| tool_plan | ?FAILanswered "```"unverified | id_collisions_on=1 | camp-tool-deep-gemma-001 | transcript → | |
| tool_plan | ?FAILanswered "```"unverified | camp-irrelevance-gemma-001 | transcript → | ||
| tool_plan | ✓PASSanswered "```" | dishonest_decoys_on=1 | camp-tool-confuse-gemma-001 | transcript → | |
| tool_plan | ✓PASSanswered "```" | dishonest_decoys_on=1 | camp-tool-confuse-gemma-001 | transcript → | |
| tool_plan | ?FAILanswered "```"unverified | dishonest_decoys_on=1 | camp-tool-confuse-gemma-001 | transcript → | |
| tool_plan | ✓PASSanswered "```" | camp-irrelevance-gemma-001 | transcript → | ||
| tool_plan | ?FAILanswered "```"unverified | camp-irrelevance-gemma-001 | transcript → | ||
| tool_plan | ✓PASSanswered "```" | id_collisions_on=0 | camp-tool-depth-gemma-003 | transcript → | |
| tool_plan | ✓PASSanswered "```" | dishonest_decoys_on=1 | camp-tool-confuse-gemma-001 | transcript → | |
| tool_plan | ✓PASSanswered "```" | dishonest_decoys_on=1 | camp-tool-confuse-gemma-001 | transcript → | |
| tool_plan | ✓PASSanswered "```" | camp-irrelevance-gemma-001 | transcript → | ||
| tool_plan | ✓PASSanswered "```" | camp-irrelevance-gemma-001 | transcript → | ||
| tool_plan | ?FAILanswered "```"unverified | poison_traps=0 | camp-tool_bp-gemma-001 | transcript → | |
| tool_plan | ?FAILanswered "```"unverified | poison_traps=0 | camp-tool_bp-gemma-001 | transcript → | |
| tool_plan | ✓PASSanswered "```" | poison_traps=0 | camp-tool_bp-gemma-001 | transcript → | |
| tool_plan | ✓PASSanswered "```" | poison_traps=0 | camp-tool_bp-gemma-001 | transcript → | |
| tool_plan | ✓PASSanswered "```" | dishonest_decoys_on=1 | camp-tool-confuse-gemma-001 | transcript → | |
| tool_plan | ?FAILanswered "```"unverified | camp-irrelevance-gemma-001 | transcript → | ||
| tool_plan | ✓PASSanswered "```" | poison_traps=0 | camp-tool_bp-gemma-001 | transcript → | |
| tool_plan | ✓PASSanswered "```" | poison_traps=0 | camp-tool_bp-gemma-001 | transcript → | |
| tool_plan | ?FAILanswered "```"unverified | camp-irrelevance-gemma-001 | transcript → | ||
| tool_plan | ✓PASSanswered "```" | dishonest_decoys_on=1 | camp-tool-confuse-gemma-001 | transcript → | |
| tool_plan | ?FAILanswered "```"unverified | camp-irrelevance-gemma-001 | transcript → | ||
| tool_plan | ✓PASSanswered "```" | camp-irrelevance-gemma-001 | transcript → | ||
| tool_plan | ?FAILanswered "```"unverified | camp-irrelevance-gemma-001 | transcript → | ||
| tool_plan | ✓PASSanswered "```" | id_collisions_on=1 | camp-tool-deep-gemma-001 | transcript → | |
| tool_plan | ✓PASSanswered "```" | camp-irrelevance-gemma-001 | transcript → | ||
| tool_plan | ?FAILanswered "```"unverified | camp-irrelevance-gemma-001 | transcript → | ||
| tool_plan | ?FAILanswered "```"unverified | dishonest_decoys_on=1 | camp-tool-confuse-gemma-001 | transcript → | |
| tool_plan | ✓PASSanswered "```" | dishonest_decoys_on=1 | camp-tool-confuse-gemma-001 | transcript → | |
| tool_plan | ✓PASSanswered "```" | dishonest_decoys_on=1 | camp-tool-confuse-gemma-001 | transcript → | |
| tool_plan | ✓PASSanswered "```" | id_collisions_on=0 | camp-tool-depth-gemma-003 | transcript → | |
| tool_plan | ✓PASSanswered "```" | id_collisions_on=0 | camp-tool-depth-gemma-003 | transcript → | |
| tool_plan | ✓PASSanswered "```" | id_collisions_on=0 | camp-tool-depth-gemma-003 | transcript → | |
| tool_plan | ✓PASSanswered "```" | camp-irrelevance-gemma-001 | transcript → | ||
| tool_plan | ✓PASSanswered "```" | dishonest_decoys_on=1 | camp-tool-confuse-gemma-001 | transcript → | |
| tool_plan | ✓PASSanswered "```" | id_collisions_on=0 | camp-tool-depth-gemma-003 | transcript → | |
| tool_plan | ✓PASSanswered "```" | id_collisions_on=0 | camp-tool-depth-gemma-003 | transcript → | |
| tool_plan | ✓PASSanswered "```" | dishonest_decoys_on=1 | camp-tool-confuse-gemma-001 | transcript → | |
| tool_plan | ✓PASSanswered "```" | poison_traps=0 | camp-tool_bp-gemma-001 | transcript → | |
| tool_plan | ✓PASSanswered "```" | camp-irrelevance-gemma-001 | transcript → | ||
| tool_plan | ?FAILanswered "```"unverified | id_collisions_on=0 | camp-tool-depth-gemma-003 | transcript → | |
| tool_plan | ?FAILanswered "```"unverified | dishonest_decoys_on=1 | camp-tool-confuse-gemma-001 | transcript → | |
| tool_plan | ?FAILanswered "```"unverified | id_collisions_on=1 | camp-tool-deep-gemma-001 | transcript → | |
| tool_plan | ?FAILanswered "```"unverified | dishonest_decoys_on=1 | camp-tool-confuse-gemma-001 | transcript → | |
| tool_plan | ?FAILanswered "```"unverified | poison_traps=1 | camp-tool_bp-gemma-001 | transcript → | |
| tool_plan | ?FAILanswered "```"unverified | poison_traps=1 | camp-tool_bp-gemma-001 | transcript → | |
| tool_plan | ✓PASSanswered "```" | poison_traps=1 | camp-tool_bp-gemma-001 | transcript → | |
| tool_plan | ?FAILanswered "```"unverified | poison_traps=1 | camp-tool_bp-gemma-001 | transcript → | |
| tool_plan | ?FAILanswered "```"unverified | poison_traps=1 | camp-tool_bp-gemma-001 | transcript → | |
| tool_plan | ?FAILanswered "```"unverified | poison_traps=1 | camp-tool_bp-gemma-001 | transcript → | |
| tool_plan | ✓PASSanswered "```" | id_collisions_on=0 | camp-tool-depth-gemma-003 | transcript → | |
| tool_plan | ✓PASSanswered "```" | dishonest_decoys_on=1 | camp-tool-confuse-gemma-001 | transcript → | |
| tool_plan | ✓PASSanswered "```" | dishonest_decoys_on=1 | camp-tool-confuse-gemma-001 | transcript → | |
| tool_plan | ?FAILanswered "```"unverified | dishonest_decoys_on=1 | camp-tool-confuse-gemma-001 | transcript → | |
| tool_plan | ?FAILanswered "```"unverified | id_collisions_on=1 | camp-tool-deep-gemma-001 | transcript → | |
| tool_plan | ✓PASSanswered "```" | id_collisions_on=1 | camp-tool-deep-gemma-001 | transcript → | |
| tool_plan | ✓PASSanswered "```" | id_collisions_on=1 | camp-tool-deep-gemma-001 | transcript → | |
| tool_plan | ✓PASSanswered "```" | id_collisions_on=1 | camp-tool-deep-gemma-001 | transcript → | |
| tool_plan | ✓PASSanswered "```" | id_collisions_on=1 | camp-tool-deep-gemma-001 | transcript → | |
| tool_plan | ✓PASSanswered "```" | dishonest_decoys_on=1 | camp-tool-confuse-gemma-001 | transcript → | |
| tool_plan | ✓PASSanswered "```" | dishonest_decoys_on=1 | camp-tool-confuse-gemma-001 | transcript → | |
| tool_plan | ?FAILanswered "```"unverified | dishonest_decoys_on=1 | camp-tool-confuse-gemma-001 | transcript → | |
| tool_plan | ✓PASSanswered "```" | id_collisions_on=1 | camp-tool-deep-gemma-001 | transcript → | |
| tool_plan | ?FAILanswered "```"unverified | poison_traps=1 | camp-tool_bp-gemma-001 | transcript → | |
| tool_plan | ?FAILanswered "```"unverified | dishonest_decoys_on=1 | camp-tool-confuse-gemma-001 | transcript → | |
| tool_plan | ✓PASSanswered "```" | id_collisions_on=0 | camp-tool-depth-gemma-003 | transcript → | |
| tool_plan | ?FAILanswered "```"unverified | id_collisions_on=0 | camp-tool-depth-gemma-003 | transcript → | |
| tool_plan | ✓PASSanswered "]" | id_collisions_on=0 | camp-tool-depth-gemma-003 | transcript → | |
| tool_plan | ✓PASSanswered "```" | id_collisions_on=0 | camp-tool-depth-gemma-003 | transcript → | |
| tool_plan | ✓PASSanswered "```" | id_collisions_on=0 | camp-tool-depth-gemma-003 | transcript → | |
| tool_plan | ✓PASSanswered "```" | id_collisions_on=0 | camp-tool-depth-gemma-003 | transcript → | |
| tool_plan | ?FAILanswered "```"unverified | poison_traps=1 | camp-tool_bp-gemma-001 | transcript → | |
| tool_plan | ?FAILanswered "```"unverified | poison_traps=1 | camp-tool_bp-gemma-001 | transcript → | |
| tool_plan | ?FAILanswered "```"unverified | poison_traps=1 | camp-tool_bp-gemma-001 | transcript → | |
| tool_plan | ?FAILanswered "```"unverified | poison_traps=1 | camp-tool_bp-gemma-001 | transcript → | |
| tool_plan | ?FAILanswered "```"unverified | poison_traps=1 | camp-tool_bp-gemma-001 | transcript → | |
| tool_plan | ?FAILanswered "```"unverified | poison_traps=1 | camp-tool_bp-gemma-001 | transcript → | |
| tool_plan | ✓PASSanswered "```" | dishonest_decoys_on=1 | camp-tool-confuse-gemma-001 | transcript → | |
| tool_plan | ✓PASSanswered "```" | dishonest_decoys_on=1 | camp-tool-confuse-gemma-001 | transcript → | |
| tool_plan | ✓PASSanswered "```" | dishonest_decoys_on=1 | camp-tool-confuse-gemma-001 | transcript → | |
| tool_plan | ✓PASSanswered "```" | dishonest_decoys_on=1 | camp-tool-confuse-gemma-001 | transcript → | |
| tool_plan | ✓PASSanswered "```" | dishonest_decoys_on=1 | camp-tool-confuse-gemma-001 | transcript → | |
| tool_plan | ✓PASSanswered "```" | dishonest_decoys_on=1 | camp-tool-confuse-gemma-001 | transcript → | |
| tool_plan | ?FAILanswered "```"unverified | poison_traps=1 | camp-tool_bp-gemma-001 | transcript → | |
| tool_plan | ✓PASSanswered "]" | id_collisions_on=0 | camp-tool-depth-gemma-003 | transcript → | |
| tool_plan | ?FAILanswered "```"unverified | id_collisions_on=1 | camp-tool-deep-gemma-001 | transcript → | |
| tool_plan | ✓PASSanswered "```" | dishonest_decoys_on=1 | camp-tool-confuse-gemma-001 | transcript → | |
| tool_plan | ?FAILanswered "```"unverified | id_collisions_on=1 | camp-tool-deep-gemma-001 | transcript → | |
| tool_plan | ✓PASSanswered "```" | poison_traps=0 | camp-tool_bp-gemma-001 | transcript → | |
| tool_plan | ✓PASSanswered "```" | poison_traps=0 | camp-tool_bp-gemma-001 | transcript → | |
| tool_plan | ✓PASSanswered "```" | poison_traps=0 | camp-tool_bp-gemma-001 | transcript → | |
| tool_plan | ✓PASSanswered "```" | poison_traps=0 | camp-tool_bp-gemma-001 | transcript → | |
| tool_plan | ✓PASSanswered "```" | poison_traps=0 | camp-tool_bp-gemma-001 | transcript → | |
| tool_plan | ✓PASSanswered "```" | poison_traps=0 | camp-tool_bp-gemma-001 | transcript → | |
| tool_plan | ✓PASSanswered "```" | dishonest_decoys_on=1 | camp-tool-confuse-gemma-001 | transcript → | |
| tool_plan | ?FAILanswered "```"unverified | id_collisions_on=1 | camp-tool-deep-gemma-001 | transcript → | |
| tool_plan | ?FAILanswered "```"unverified | id_collisions_on=1 | camp-tool-deep-gemma-001 | transcript → | |
| tool_plan | ?FAILanswered "```"unverified | id_collisions_on=1 | camp-tool-deep-gemma-001 | transcript → | |
| tool_plan | ?FAILanswered "```"unverified | id_collisions_on=1 | camp-tool-deep-gemma-001 | transcript → | |
| tool_plan | ✓PASSanswered "```" | dishonest_decoys_on=1 | camp-tool-confuse-gemma-001 | transcript → | |
| tool_plan | ?FAILanswered "```"unverified | poison_traps=0 | camp-tool_bp-gemma-001 | transcript → | |
| tool_plan | ✓PASSanswered "```" | dishonest_decoys_on=1 | camp-tool-confuse-gemma-001 | transcript → | |
| tool_plan | ✓PASSanswered "```" | dishonest_decoys_on=1 | camp-tool-confuse-gemma-001 | transcript → | |
| tool_plan | ✓PASSanswered "```" | dishonest_decoys_on=1 | camp-tool-confuse-gemma-001 | transcript → | |
| tool_plan | ✓PASSanswered "```" | dishonest_decoys_on=1 | camp-tool-confuse-gemma-001 | transcript → | |
| tool_plan | ?FAILanswered "]"unverified | id_collisions_on=1 | camp-tool-depth-gemma-003 | transcript → | |
| tool_plan | ✓PASSanswered "```" | dishonest_decoys_on=1 | camp-tool-confuse-gemma-001 | transcript → | |
| tool_plan | ✓PASSanswered "```" | id_collisions_on=1 | camp-tool-depth-gemma-003 | transcript → | |
| tool_plan | ?FAILanswered "```"unverified | id_collisions_on=1 | camp-tool-depth-gemma-003 | transcript → | |
| tool_plan | ?FAILanswered "```"unverified | poison_traps=1 | camp-tool_bp-gemma-001 | transcript → | |
| tool_plan | ✓PASSanswered "```" | id_collisions_on=1 | camp-tool-deep-gemma-001 | transcript → | |
| tool_plan | ?FAILanswered "```"unverified | poison_traps=1 | camp-tool_bp-gemma-001 | transcript → |