Trials · interactive
Every trial behind one square of the capability map: Gemma 4 31B QAT on interactive.
682
58 errors
Trials in this cell
57%
354/624 scored
Pass rate
270
0 noise excluded
Real failures
$1.0827
Cell cost
Trials
| kind | verdict | realized dims | seeded traps | run | |
|---|---|---|---|---|---|
| interactive | ✕ERRORhttp 400: b'{"error":{"message":"\\"auto\\" tool choice requires --enable-auto-tool-choice and --tool-call-parser to be set","type":"BadRequestError","param":null,"code":400}}' | smoke-gemma4qat-interactive | transcript → | ||
| interactive | ✕ERRORhttp 400: b'{"error":{"message":"\\"auto\\" tool choice requires --enable-auto-tool-choice and --tool-call-parser to be set","type":"BadRequestError","param":null,"code":400}}' | camp-interactive-fault-gemma4qat-001 | transcript → | ||
| interactive | ✕ERRORhttp 400: b'{"error":{"message":"\\"auto\\" tool choice requires --enable-auto-tool-choice and --tool-call-parser to be set","type":"BadRequestError","param":null,"code":400}}' | camp-interactive-gemma4qat-001 | transcript → | ||
| interactive | ✕ERRORhttp 400: b'{"error":{"message":"\\"auto\\" tool choice requires --enable-auto-tool-choice and --tool-call-parser to be set","type":"BadRequestError","param":null,"code":400}}' | camp-interactive-fault-gemma4qat-001 | transcript → | ||
| interactive | ✕ERRORhttp 400: b'{"error":{"message":"\\"auto\\" tool choice requires --enable-auto-tool-choice and --tool-call-parser to be set","type":"BadRequestError","param":null,"code":400}}' | camp-interactive-gemma4qat-001 | transcript → | ||
| interactive | ✕ERRORhttp 400: b'{"error":{"message":"\\"auto\\" tool choice requires --enable-auto-tool-choice and --tool-call-parser to be set","type":"BadRequestError","param":null,"code":400}}' | camp-interactive-fault-gemma4qat-001 | transcript → | ||
| interactive | ✕ERRORhttp 400: b'{"error":{"message":"\\"auto\\" tool choice requires --enable-auto-tool-choice and --tool-call-parser to be set","type":"BadRequestError","param":null,"code":400}}' | camp-interactive-gemma4qat-001 | transcript → | ||
| interactive | ✕ERRORhttp 400: b'{"error":{"message":"\\"auto\\" tool choice requires --enable-auto-tool-choice and --tool-call-parser to be set","type":"BadRequestError","param":null,"code":400}}' | camp-interactive-lookalike-gemma4qat-001 | transcript → | ||
| interactive | ✕ERRORhttp 400: b'{"error":{"message":"\\"auto\\" tool choice requires --enable-auto-tool-choice and --tool-call-parser to be set","type":"BadRequestError","param":null,"code":400}}' | camp-interactive-gemma4qat-001 | transcript → | ||
| interactive | ✕ERRORhttp 400: b'{"error":{"message":"\\"auto\\" tool choice requires --enable-auto-tool-choice and --tool-call-parser to be set","type":"BadRequestError","param":null,"code":400}}' | camp-interactive-lookalike-gemma4qat-001 | transcript → | ||
| interactive | ✕ERRORhttp 400: b'{"error":{"message":"\\"auto\\" tool choice requires --enable-auto-tool-choice and --tool-call-parser to be set","type":"BadRequestError","param":null,"code":400}}' | camp-interactive-fault-gemma4qat-001 | transcript → | ||
| interactive | ✕ERRORhttp 400: b'{"error":{"message":"\\"auto\\" tool choice requires --enable-auto-tool-choice and --tool-call-parser to be set","type":"BadRequestError","param":null,"code":400}}' | camp-interactive-lookalike-gemma4qat-001 | transcript → | ||
| interactive | ✕ERRORhttp 400: b'{"error":{"message":"\\"auto\\" tool choice requires --enable-auto-tool-choice and --tool-call-parser to be set","type":"BadRequestError","param":null,"code":400}}' | camp-interactive-lookalike-gemma4qat-001 | transcript → | ||
| interactive | ✕ERRORhttp 400: b'{"error":{"message":"\\"auto\\" tool choice requires --enable-auto-tool-choice and --tool-call-parser to be set","type":"BadRequestError","param":null,"code":400}}' | camp-interactive-fault-gemma4qat-001 | transcript → | ||
| interactive | ✕ERRORhttp 400: b'{"error":{"message":"\\"auto\\" tool choice requires --enable-auto-tool-choice and --tool-call-parser to be set","type":"BadRequestError","param":null,"code":400}}' | camp-interactive-gemma4qat-001 | transcript → | ||
| interactive | ✕ERRORhttp 400: b'{"error":{"message":"\\"auto\\" tool choice requires --enable-auto-tool-choice and --tool-call-parser to be set","type":"BadRequestError","param":null,"code":400}}' | camp-interactive-lookalike-gemma4qat-001 | transcript → | ||
| interactive | ✕ERRORtimeout | camp-interactive-fault-gemma4qat-001 | transcript → | ||
| interactive | ✕ERRORtimeout | camp-interactive-gemma4qat-001 | transcript → | ||
| interactive | ✕ERRORtimeout | camp-interactive-lookalike-gemma4qat-001 | transcript → | ||
| interactive | ✕ERRORtimeout | camp-interactive-fault-gemma4qat-001 | transcript → | ||
| interactive | ✕ERRORtimeout | camp-interactive-gemma4qat-001 | transcript → | ||
| interactive | ✕ERRORtimeout | camp-interactive-lookalike-gemma4qat-001 | transcript → | ||
| interactive | ✕ERRORtimeout | camp-interactive-fault-gemma4qat-001 | transcript → | ||
| interactive | ✕ERRORtimeout | camp-interactive-fault-gemma4qat-001 | transcript → | ||
| interactive | ✕ERRORtimeout | camp-interactive-gemma4qat-001 | transcript → | ||
| interactive | ✕ERRORtimeout | camp-interactive-lookalike-gemma4qat-001 | transcript → | ||
| interactive | ✕ERRORtimeout | camp-interactive-lookalike-gemma4qat-001 | transcript → | ||
| interactive | ✕ERRORtimeout | camp-interactive-gemma4qat-001 | transcript → | ||
| interactive | ✓PASSanswered "[{"step": 1, "tool": "advance_o0", "args": {"service"..." | camp-interactive-lookalike-gemma4qat-001 | transcript → | ||
| interactive | ✓PASSanswered "[{"step": 1, "tool": "advance_0", "args": {"service":..." | camp-interactive-gemma4qat-001 | transcript → | ||
| interactive | ✓PASSanswered "[{"step": 1, "tool": "advance_0", "args": {"service":..." | camp-interactive-fault-gemma4qat-001 | transcript → | ||
| interactive | ✓PASSanswered "[{"step": 1, "tool": "adva_nce_0", "args": {"service"..." | camp-interactive-lookalike-gemma4qat-001 | transcript → | ||
| interactive | ✓PASSanswered "[{"step": 1, "tool": "advance_0", "args": {"service":..." | camp-interactive-fault-gemma4qat-001 | transcript → | ||
| interactive | ✓PASSanswered "[{"step": 1, "tool": "advance_0", "args": {"service":..." | camp-interactive-gemma4qat-001 | transcript → | ||
| interactive | ✓PASSanswered "[{"step": 1, "tool": "advance_0", "args": {"service":..." | camp-interactive-gemma4qat-001 | transcript → | ||
| interactive | ✓PASSanswered "[{"step": 1, "tool": "advance_0", "args": {"service":..." | camp-interactive-gemma4qat-001 | transcript → | ||
| interactive | ✓PASSanswered "[{"step": 1, "tool": "advance_0", "args": {"service":..." | camp-interactive-gemma4qat-001 | transcript → | ||
| interactive | ✓PASSanswered "[{"step": 1, "tool": "adva-nce_0", "args": {"service"..." | camp-interactive-lookalike-gemma4qat-001 | transcript → | ||
| interactive | ✓PASSanswered "[{"step": 1, "tool": "adva-nce_0", "args": {"service"..." | camp-interactive-lookalike-gemma4qat-001 | transcript → | ||
| interactive | ✓PASSanswered "[{"step": 1, "tool": "adva_nce_0", "args": {"service"..." | camp-interactive-lookalike-gemma4qat-001 | transcript → | ||
| interactive | ✓PASSanswered "[{"step": 1, "tool": "advance_0", "args": {"service":..." | camp-interactive-fault-gemma4qat-001 | transcript → | ||
| interactive | ✓PASSanswered "[{"step": 1, "tool": "advance_0", "args": {"service":..." | camp-interactive-fault-gemma4qat-001 | transcript → | ||
| interactive | ✓PASSanswered "[{"step": 1, "tool": "advance_0", "args": {"service":..." | camp-interactive-fault-gemma4qat-001 | transcript → | ||
| interactive | ✓PASSanswered "[{"step": 1, "tool": "advance_0", "args": {"service":..." | camp-interactive-gemma4qat-001 | transcript → | ||
| interactive | ✓PASSanswered "[{"step": 1, "tool": "advance_0", "args": {"service":..." | camp-interactive-fault-gemma4qat-001 | transcript → | ||
| interactive | ✓PASSanswered "[{"step": 1, "tool": "advance_o1", "args": {"service"..." | camp-interactive-lookalike-gemma4qat-001 | transcript → | ||
| interactive | ✓PASSanswered "[{"step": 1, "tool": "adva_nce_0", "args": {"service"..." | camp-interactive-lookalike-gemma4qat-001 | transcript → | ||
| interactive | ✓PASSanswered "[{"step": 1, "tool": "advance_0", "args": {"service":..." | camp-interactive-fault-gemma4qat-001 | transcript → | ||
| interactive | ?FAILanswered "[{"step": 1, "tool": "advance_0", "args": {"service":..."unverified | camp-interactive-gemma4qat-001 | transcript → | ||
| interactive | ?FAILanswered "[{"step": 1, "tool": "advance_0", "args": {"service":..."unverified | camp-interactive-gemma4qat-001 | transcript → | ||
| interactive | ?FAILanswered "[{"step": 1, "tool": "advance_0", "args": {"service":..."unverified | camp-interactive-fault-gemma4qat-001 | transcript → | ||
| interactive | ✓PASSanswered "[{"step": 1, "tool": "advance_0", "args": {"service":..." | camp-interactive-gemma4qat-001 | transcript → | ||
| interactive | ✓PASSanswered "[{"step": 1, "tool": "advance_0", "args": {"service":..." | camp-interactive-gemma4qat-001 | transcript → | ||
| interactive | ✓PASSanswered "[{"step": 1, "tool": "adva_nce_0", "args": {"service"..." | camp-interactive-lookalike-gemma4qat-001 | transcript → | ||
| interactive | ?FAILanswered "[{"step": 1, "tool": "advance_0", "args": {"service":..."unverified | camp-interactive-fault-gemma4qat-001 | transcript → | ||
| interactive | ✓PASSanswered "[{"step": 1, "tool": "advance_o0", "args": {"service"..." | camp-interactive-lookalike-gemma4qat-001 | transcript → | ||
| interactive | ✓PASSanswered "[{"step": 1, "tool": "adva_nce_0", "args": {"service"..." | camp-interactive-lookalike-gemma4qat-001 | transcript → | ||
| interactive | ✓PASSanswered "[{"step": 1, "tool": "adva_nce_0", "args": {"service"..." | camp-interactive-lookalike-gemma4qat-001 | transcript → | ||
| interactive | ✓PASSanswered "[{"step": 1, "tool": "advance_0", "args": {"service":..." | camp-interactive-fault-gemma4qat-001 | transcript → | ||
| interactive | ✓PASSanswered "[{"step": 1, "tool": "advance_0", "args": {"service":..." | camp-interactive-gemma4qat-001 | transcript → | ||
| interactive | ✓PASSanswered "[{"step": 1, "tool": "advance_0", "args": {"service":..." | camp-interactive-fault-gemma4qat-001 | transcript → | ||
| interactive | ✓PASSanswered "[{"step": 1, "tool": "adva_nce_0", "args": {"service"..." | camp-interactive-lookalike-gemma4qat-001 | transcript → | ||
| interactive | ✓PASSanswered "[{"step": 1, "tool": "adva-nce_0", "args": {"service"..." | camp-interactive-lookalike-gemma4qat-001 | transcript → | ||
| interactive | ✓PASSanswered "[{"step": 1, "tool": "adva-nce_0", "args": {"service"..." | camp-interactive-lookalike-gemma4qat-001 | transcript → | ||
| interactive | ✓PASSanswered "[{"step": 1, "tool": "adva_nce_0", "args": {"service"..." | camp-interactive-lookalike-gemma4qat-001 | transcript → | ||
| interactive | ✓PASSanswered "[{"step": 1, "tool": "advance_0", "args": {"service":..." | camp-interactive-gemma4qat-001 | transcript → | ||
| interactive | ✓PASSanswered "[{"step": 1, "tool": "advance_0", "args": {"service":..." | camp-interactive-fault-gemma4qat-001 | transcript → | ||
| interactive | ?FAILanswered "[{"step": 1, "tool": "advance_0", "args": {"service":..."unverified | camp-interactive-gemma4qat-001 | transcript → | ||
| interactive | ?FAILanswered "[{"step": 1, "tool": "advance_0", "args": {"service":..."unverified | camp-interactive-gemma4qat-001 | transcript → | ||
| interactive | ✓PASSanswered "[{"step": 1, "tool": "advance_0", "args": {"service":..." | camp-interactive-fault-gemma4qat-001 | transcript → | ||
| interactive | ✓PASSanswered "[{"step": 1, "tool": "advance_0", "args": {"service":..." | camp-interactive-gemma4qat-001 | transcript → | ||
| interactive | ✓PASSanswered "[{"step": 1, "tool": "advance_0", "args": {"service":..." | camp-interactive-gemma4qat-001 | transcript → | ||
| interactive | ✓PASSanswered "[{"step": 1, "tool": "advance_0", "args": {"service":..." | camp-interactive-fault-gemma4qat-001 | transcript → | ||
| interactive | ✓PASSanswered "[{"step": 1, "tool": "adva-nce_0", "args": {"service"..." | camp-interactive-lookalike-gemma4qat-001 | transcript → | ||
| interactive | ✓PASSanswered "[{"step": 1, "tool": "advance_0", "args": {"service":..." | camp-interactive-fault-gemma4qat-001 | transcript → | ||
| interactive | ✓PASSanswered "[{"step": 1, "tool": "advance_0", "args": {"service":..." | camp-interactive-fault-gemma4qat-001 | transcript → | ||
| interactive | ?FAILanswered "[{"step": 1, "tool": "advance_0", "args": {"service":..."unverified | camp-interactive-gemma4qat-001 | transcript → | ||
| interactive | ?FAILanswered "[{"step": 1, "tool": "advance_0", "args": {"service":..."unverified | camp-interactive-gemma4qat-001 | transcript → | ||
| interactive | ?FAILanswered "[{"step": 1, "tool": "advance_0", "args": {"service":..."unverified | camp-interactive-fault-gemma4qat-001 | transcript → | ||
| interactive | ?FAILanswered "[{"step": 1, "tool": "advance_0", "args": {"service":..."unverified | camp-interactive-gemma4qat-001 | transcript → | ||
| interactive | ?FAILanswered "[{"step": 1, "tool": "advance_0", "args": {"service":..."unverified | camp-interactive-fault-gemma4qat-001 | transcript → | ||
| interactive | ?FAILanswered "[{"step": 1, "tool": "advance_0", "args": {"service":..."unverified | camp-interactive-fault-gemma4qat-001 | transcript → | ||
| interactive | ?FAILanswered "[{"step": 1, "tool": "advance_0", "args": {"service":..."unverified | camp-interactive-fault-gemma4qat-001 | transcript → | ||
| interactive | ✓PASSanswered "[{"step": 1, "tool": "adva-nce_0", "args": {"service"..." | camp-interactive-lookalike-gemma4qat-001 | transcript → | ||
| interactive | ?FAILanswered "[{"step": 1, "tool": "advance_0", "args": {"service":..."unverified | camp-interactive-fault-gemma4qat-001 | transcript → | ||
| interactive | ✓PASSanswered "[{"step": 1, "tool": "advance_0", "args": {"service":..." | camp-interactive-gemma4qat-001 | transcript → | ||
| interactive | ?FAILanswered "[{"step": 1, "tool": "set_flag_0", "args": {"flag": "..."unverified | camp-interactive-gemma4qat-001 | transcript → | ||
| interactive | ✓PASSanswered "[{"step": 1, "tool": "adva_nce_0", "args": {"service"..." | camp-interactive-lookalike-gemma4qat-001 | transcript → | ||
| interactive | ?FAILanswered "[{"step": 1, "tool": "advance_0", "args": {"service":..."unverified | camp-interactive-fault-gemma4qat-001 | transcript → | ||
| interactive | ?FAILanswered "[{"step": 1, "tool": "advance_0", "args": {"service":..."unverified | camp-interactive-fault-gemma4qat-001 | transcript → | ||
| interactive | ?FAILanswered "[{"step": 1, "tool": "advance_0", "args": {"service":..."unverified | camp-interactive-fault-gemma4qat-001 | transcript → | ||
| interactive | ?FAILanswered "[{"step": 1, "tool": "advance_0", "args": {"service":..."unverified | camp-interactive-gemma4qat-001 | transcript → | ||
| interactive | ?FAILanswered "[{"step": 1, "tool": "advance_0", "args": {"service":..."unverified | camp-interactive-gemma4qat-001 | transcript → | ||
| interactive | ?FAILanswered "[{"step": 1, "tool": "advance_0", "args": {"service":..."unverified | camp-interactive-gemma4qat-001 | transcript → | ||
| interactive | ?FAILanswered "[{"step": 1, "tool": "advance_0", "args": {"service":..."unverified | camp-interactive-fault-gemma4qat-001 | transcript → | ||
| interactive | ✓PASSanswered "[{"step": 1, "tool": "advance_o0", "args": {"service"..." | camp-interactive-lookalike-gemma4qat-001 | transcript → | ||
| interactive | ✓PASSanswered "[{"step": 1, "tool": "adva_nce_0", "args": {"service"..." | camp-interactive-lookalike-gemma4qat-001 | transcript → | ||
| interactive | ✓PASSanswered "[{"step": 1, "tool": "set_flag_0", "args": {"flag": "..." | camp-interactive-gemma4qat-001 | transcript → | ||
| interactive | ?FAILanswered "[{"step": 1, "tool": "advance_0", "args": {"service":..."unverified | camp-interactive-gemma4qat-001 | transcript → | ||
| interactive | ✓PASSanswered "[{"step": 1, "tool": "advance_0", "args": {"service":..." | camp-interactive-fault-gemma4qat-001 | transcript → | ||
| interactive | ?FAILanswered "[{"step": 1, "tool": "advance_0", "args": {"service":..."unverified | camp-interactive-gemma4qat-001 | transcript → | ||
| interactive | ?FAILanswered "[{"step": 1, "tool": "advance_0", "args": {"service":..."unverified | camp-interactive-gemma4qat-001 | transcript → | ||
| interactive | ?FAILanswered "[{"step": 1, "tool": "advance_0", "args": {"service":..."unverified | camp-interactive-fault-gemma4qat-001 | transcript → | ||
| interactive | ?FAILanswered "[{"step": 1, "tool": "advance_0", "args": {"service":..."unverified | camp-interactive-fault-gemma4qat-001 | transcript → | ||
| interactive | ?FAILanswered "[{"step": 1, "tool": "advance_0", "args": {"service":..."unverified | camp-interactive-gemma4qat-001 | transcript → | ||
| interactive | ?FAILanswered "[{"step": 1, "tool": "advance_0", "args": {"service":..."unverified | camp-interactive-fault-gemma4qat-001 | transcript → | ||
| interactive | ?FAILanswered "[{"step": 1, "tool": "advance_0", "args": {"service":..."unverified | camp-interactive-gemma4qat-001 | transcript → | ||
| interactive | ?FAILanswered "[{"step": 1, "tool": "advance_0", "args": {"service":..."unverified | camp-interactive-fault-gemma4qat-001 | transcript → | ||
| interactive | ?FAILanswered "[{"step": 1, "tool": "advance_0", "args": {"service":..."unverified | camp-interactive-gemma4qat-001 | transcript → | ||
| interactive | ✓PASSanswered "[{"step": 1, "tool": "adva-nce_0", "args": {"service"..." | camp-interactive-lookalike-gemma4qat-001 | transcript → | ||
| interactive | ?FAILanswered "[]"unverified | camp-interactive-lookalike-gemma4qat-001 | transcript → | ||
| interactive | ?FAILanswered "[{"step": 1, "tool": "advance_0", "args": {"service":..."unverified | camp-interactive-gemma4qat-001 | transcript → | ||
| interactive | ?FAILanswered "[{"step": 1, "tool": "advance_0", "args": {"service":..."unverified | camp-interactive-gemma4qat-001 | transcript → | ||
| interactive | ?FAILanswered "[{"step": 1, "tool": "advance_0", "args": {"service":..."unverified | camp-interactive-gemma4qat-001 | transcript → | ||
| interactive | ?FAILanswered "[{"step": 1, "tool": "advance_0", "args": {"service":..."unverified | camp-interactive-gemma4qat-001 | transcript → | ||
| interactive | ✓PASSanswered "[{"step": 1, "tool": "advance_0", "args": {"service":..." | camp-interactive-fault-gemma4qat-001 | transcript → | ||
| interactive | ✓PASSanswered "[{"step": 1, "tool": "adva_nce_0", "args": {"service"..." | camp-interactive-lookalike-gemma4qat-001 | transcript → | ||
| interactive | ✓PASSanswered "[{"step": 1, "tool": "adva-nce_0", "args": {"service"..." | camp-interactive-lookalike-gemma4qat-001 | transcript → | ||
| interactive | ✓PASSanswered "[{"step": 1, "tool": "adva-nce_0", "args": {"service"..." | camp-interactive-lookalike-gemma4qat-001 | transcript → | ||
| interactive | ?FAILanswered "[{"step": 1, "tool": "advance_0", "args": {"service":..."unverified | camp-interactive-gemma4qat-001 | transcript → | ||
| interactive | ✓PASSanswered "[{"step": 1, "tool": "adva_nce_0", "args": {"service"..." | camp-interactive-lookalike-gemma4qat-001 | transcript → | ||
| interactive | ?FAILanswered "[{"step": 1, "tool": "advance_0", "args": {"service":..."unverified | camp-interactive-fault-gemma4qat-001 | transcript → | ||
| interactive | ?FAILanswered "[{"step": 1, "tool": "advance_0", "args": {"service":..."unverified | camp-interactive-fault-gemma4qat-001 | transcript → | ||
| interactive | ?FAILanswered "[{"step": 1, "tool": "advance_0", "args": {"service":..."unverified | camp-interactive-gemma4qat-001 | transcript → | ||
| interactive | ?FAILanswered "[{"step": 1, "tool": "advance_0", "args": {"service":..."unverified | camp-interactive-fault-gemma4qat-001 | transcript → | ||
| interactive | ?FAILanswered "[{"step": 1, "tool": "advance_0", "args": {"service":..."unverified | camp-interactive-gemma4qat-001 | transcript → | ||
| interactive | ?FAILanswered "[{"step": 1, "tool": "advance_0", "args": {"service":..."unverified | camp-interactive-fault-gemma4qat-001 | transcript → | ||
| interactive | ✓PASSanswered "[{"step": 1, "tool": "advance_0", "args": {"service":..." | camp-interactive-fault-gemma4qat-001 | transcript → | ||
| interactive | ?FAILanswered "[{"step": 1, "tool": "advance_0", "args": {"service":..."unverified | camp-interactive-fault-gemma4qat-001 | transcript → | ||
| interactive | ?FAILanswered "[{"step": 1, "tool": "advance_0", "args": {"service":..."unverified | camp-interactive-gemma4qat-001 | transcript → | ||
| interactive | ✓PASSanswered "[{"step": 1, "tool": "adva_nce_0", "args": {"service"..." | camp-interactive-lookalike-gemma4qat-001 | transcript → | ||
| interactive | ✓PASSanswered "[{"step": 1, "tool": "advance_0", "args": {"service":..." | camp-interactive-fault-gemma4qat-001 | transcript → | ||
| interactive | ?FAILanswered "[{"step": 1, "tool": "advance_0", "args": {"service":..."unverified | camp-interactive-gemma4qat-001 | transcript → | ||
| interactive | ✓PASSanswered "[{"step": 1, "tool": "advance_0", "args": {"service":..." | camp-interactive-fault-gemma4qat-001 | transcript → | ||
| interactive | ✓PASSanswered "[{"step": 1, "tool": "adva-nce_0", "args": {"service"..." | camp-interactive-lookalike-gemma4qat-001 | transcript → | ||
| interactive | ?FAILanswered "[{"step": 1, "tool": "advance_0", "args": {"service":..."unverified | camp-interactive-gemma4qat-001 | transcript → | ||
| interactive | ?FAILanswered "[{"step": 1, "tool": "advance_0", "args": {"service":..."unverified | camp-interactive-fault-gemma4qat-001 | transcript → | ||
| interactive | ✓PASSanswered "[{"step": 1, "tool": "advance_0", "args": {"service":..." | camp-interactive-gemma4qat-001 | transcript → | ||
| interactive | ✓PASSanswered "[{"step": 1, "tool": "advance_0", "args": {"service":..." | camp-interactive-gemma4qat-001 | transcript → | ||
| interactive | ?FAILanswered "[{"step": 1, "tool": "advance_0", "args": {"service":..."unverified | camp-interactive-fault-gemma4qat-001 | transcript → | ||
| interactive | ✓PASSanswered "[{"step": 1, "tool": "advance_0", "args": {"service":..." | camp-interactive-gemma4qat-001 | transcript → | ||
| interactive | ✓PASSanswered "[{"step": 1, "tool": "advance_0", "args": {"service":..." | camp-interactive-gemma4qat-001 | transcript → | ||
| interactive | ?FAILanswered "[{"step": 1, "tool": "advance_0", "args": {"service":..."unverified | camp-interactive-fault-gemma4qat-001 | transcript → | ||
| interactive | ✓PASSanswered "[{"step": 1, "tool": "advance_0", "args": {"service":..." | camp-interactive-gemma4qat-001 | transcript → | ||
| interactive | ?FAILanswered "[{"step": 1, "tool": "advance_0", "args": {"service":..."unverified | camp-interactive-fault-gemma4qat-001 | transcript → | ||
| interactive | ?FAILanswered "[{"step": 1, "tool": "advance_0", "args": {"service":..."unverified | camp-interactive-gemma4qat-001 | transcript → | ||
| interactive | ?FAILanswered "[{"step": 1, "tool": "advance_0", "args": {"service":..."unverified | camp-interactive-gemma4qat-001 | transcript → | ||
| interactive | ✓PASSanswered "[{"step": 1, "tool": "advance_o0", "args": {"service"..." | camp-interactive-lookalike-gemma4qat-001 | transcript → | ||
| interactive | ?FAILanswered "[{"step": 1, "tool": "advance_0", "args": {"service":..."unverified | camp-interactive-fault-gemma4qat-001 | transcript → | ||
| interactive | ✓PASSanswered "[{"step": 1, "tool": "advance_0", "args": {"service":..." | camp-interactive-gemma4qat-001 | transcript → | ||
| interactive | ?FAILanswered "[{"step": 1, "tool": "advance_0", "args": {"service":..."unverified | camp-interactive-gemma4qat-001 | transcript → | ||
| interactive | ?FAILanswered "[{"step": 1, "tool": "advance_0", "args": {"service":..."unverified | camp-interactive-fault-gemma4qat-001 | transcript → | ||
| interactive | ✓PASSanswered "[{"step": 1, "tool": "advance_o0", "args": {"service"..." | camp-interactive-lookalike-gemma4qat-001 | transcript → | ||
| interactive | ?FAILanswered "[{"step": 1, "tool": "advance_0", "args": {"service":..."unverified | camp-interactive-gemma4qat-001 | transcript → | ||
| interactive | ✓PASSanswered "[{"step": 1, "tool": "advance_o0", "args": {"service"..." | camp-interactive-lookalike-gemma4qat-001 | transcript → | ||
| interactive | ✓PASSanswered "[{"step": 1, "tool": "advance_0", "args": {"service":..." | camp-interactive-gemma4qat-001 | transcript → | ||
| interactive | ✓PASSanswered "[{"step": 1, "tool": "advance_0", "args": {"service":..." | camp-interactive-gemma4qat-001 | transcript → | ||
| interactive | ✓PASSanswered "[{"step": 1, "tool": "advance_0", "args": {"service":..." | camp-interactive-fault-gemma4qat-001 | transcript → | ||
| interactive | ✓PASSanswered "[{"step": 1, "tool": "advance_0", "args": {"service":..." | camp-interactive-gemma4qat-001 | transcript → | ||
| interactive | ✓PASSanswered "[{"step": 1, "tool": "advance_0", "args": {"service":..." | camp-interactive-fault-gemma4qat-001 | transcript → | ||
| interactive | ✓PASSanswered "[{"step": 1, "tool": "advance_0", "args": {"service":..." | camp-interactive-gemma4qat-001 | transcript → | ||
| interactive | ✓PASSanswered "[{"step": 1, "tool": "advance_0", "args": {"service":..." | camp-interactive-fault-gemma4qat-001 | transcript → | ||
| interactive | ✓PASSanswered "[{"step": 1, "tool": "adva_nce_0", "args": {"service"..." | camp-interactive-lookalike-gemma4qat-001 | transcript → | ||
| interactive | ✓PASSanswered "[{"step": 1, "tool": "advance_0", "args": {"service":..." | camp-interactive-gemma4qat-001 | transcript → | ||
| interactive | ✓PASSanswered "[{"step": 1, "tool": "advance_0", "args": {"service":..." | camp-interactive-fault-gemma4qat-001 | transcript → | ||
| interactive | ✓PASSanswered "[{"step": 1, "tool": "advance_0", "args": {"service":..." | camp-interactive-fault-gemma4qat-001 | transcript → | ||
| interactive | ✓PASSanswered "[{"step": 1, "tool": "advance_0", "args": {"service":..." | camp-interactive-fault-gemma4qat-001 | transcript → | ||
| interactive | ?FAILanswered "[{"step": 1, "tool": "advance_0", "args": {"service":..."unverified | camp-interactive-fault-gemma4qat-001 | transcript → | ||
| interactive | ?FAILanswered "[{"step": 1, "tool": "advance_0", "args": {"service":..."unverified | camp-interactive-fault-gemma4qat-001 | transcript → | ||
| interactive | ?FAILanswered "[{"step": 1, "tool": "advance_0", "args": {"service":..."unverified | camp-interactive-fault-gemma4qat-001 | transcript → | ||
| interactive | ✓PASSanswered "[{"step": 1, "tool": "advance_0", "args": {"service":..." | camp-interactive-fault-gemma4qat-001 | transcript → | ||
| interactive | ?FAILanswered "[{"step": 1, "tool": "advance_0", "args": {"service":..."unverified | camp-interactive-fault-gemma4qat-001 | transcript → | ||
| interactive | ✕ERRORtimeout | camp-interactive-lookalike-gemma4qat-001 | transcript → | ||
| interactive | ✕ERRORtimeout | camp-interactive-lookalike-gemma4qat-001 | transcript → | ||
| interactive | ✕ERRORtimeout | camp-interactive-lookalike-gemma4qat-001 | transcript → | ||
| interactive | ✓PASSanswered "[{"step": 1, "tool": "adva_nce_0", "args": {"service"..." | camp-interactive-lookalike-gemma4qat-001 | transcript → | ||
| interactive | ✕ERRORtimeout | camp-interactive-lookalike-gemma4qat-001 | transcript → | ||
| interactive | ✕ERRORtimeout | camp-interactive-lookalike-gemma4qat-001 | transcript → | ||
| interactive | ✕ERRORtimeout | camp-interactive-lookalike-gemma4qat-001 | transcript → | ||
| interactive | ✕ERRORtimeout | camp-interactive-lookalike-gemma4qat-001 | transcript → | ||
| interactive | ✓PASSanswered "[{"step": 1, "tool": "adva_nce_0", "args": {"service"..." | camp-interactive-lookalike-gemma4qat-001 | transcript → | ||
| interactive | ✓PASSanswered "[{"step": 1, "tool": "adva-nce_0", "args": {"service"..." | camp-interactive-lookalike-gemma4qat-001 | transcript → | ||
| interactive | ✕ERRORtimeout | camp-interactive-lookalike-gemma4qat-001 | transcript → | ||
| interactive | ✕ERRORtimeout | camp-interactive-lookalike-gemma4qat-001 | transcript → | ||
| interactive | ✕ERRORtimeout | camp-interactive-lookalike-gemma4qat-001 | transcript → | ||
| interactive | ✓PASSanswered "[{"step": 1, "tool": "adva_nce_0", "args": {"service"..." | camp-interactive-lookalike-gemma4qat-001 | transcript → | ||
| interactive | ✓PASSanswered "[{"step": 1, "tool": "advance_0", "args": {"service":..." | smoke-ticket-length-gemma4qat | transcript → | ||
| interactive | ?FAILanswered "[{"step": 1, "tool": "advance_0", "args": {"service":..."unverified | smoke-ticket-length-gemma4qat | transcript → | ||
| interactive | ?FAILanswered "[{"step": 1, "tool": "advance_0", "args": {"service":..."unverified | smoke-ticket-mechanism-gemma4qat | transcript → | ||
| interactive | ?FAILanswered "[{"step": 1, "tool": "advance_0", "args": {"service":..."unverified | smoke-ticket-mechanism-gemma4qat | transcript → | ||
| interactive | ?FAILanswered "[{"step": 1, "tool": "advance_0", "args": {"service":..."unverified | smoke-ticket-trap-gemma4qat | transcript → | ||
| interactive | ✓PASSanswered "[{"step": 1, "tool": "advance_0", "args": {"service":..." | smoke-ticket-trap-gemma4qat | transcript → | ||
| interactive | ✓PASSanswered "[{"step": 1, "tool": "advance_0", "args": {"service":..." | camp-ticket-length-gemma4qat-001 | transcript → | ||
| interactive | ?FAILanswered "[{"step": 1, "tool": "set_flag_0", "args": {"flag": "..."unverified | camp-ticket-length-gemma4qat-001 | transcript → | ||
| interactive | ?FAILanswered "[{"step": 1, "tool": "advance_0", "args": {"service":..."unverified | camp-ticket-length-gemma4qat-001 | transcript → | ||
| interactive | ✓PASSanswered "[{"step": 1, "tool": "advance_0", "args": {"service":..." | camp-ticket-length-gemma4qat-001 | transcript → | ||
| interactive | ?FAILanswered "[{"step": 1, "tool": "advance_0", "args": {"service":..."unverified | camp-ticket-length-gemma4qat-001 | transcript → | ||
| interactive | ?FAILanswered "[{"step": 1, "tool": "set_flag_0", "args": {"flag": "..."unverified | camp-ticket-length-gemma4qat-001/ablate | transcript → | ||
| interactive | ?FAILanswered "[{"step": 1, "tool": "set_flag_0", "args": {"flag": "..."unverified | camp-ticket-length-gemma4qat-001/ablate | transcript → | ||
| interactive | ?FAILanswered "[{"step": 1, "tool": "set_flag_0", "args": {"flag": "..."unverified | camp-ticket-length-gemma4qat-001/ablate | transcript → |