Trials · code_trace
Every trial behind one square of the capability map: Gemma 4 31B QAT on code_trace.
829
4 errors
Trials in this cell
97%
797/825 scored
Pass rate
28
0 noise excluded
Real failures
$0.2036
Cell cost
Trials
| kind | verdict | realized dims | seeded traps | run | |
|---|---|---|---|---|---|
| code_trace | ✓PASSanswered "ANSWER: 6" | aliasing_on=0 | smoke-gemma4qat-code | transcript → | |
| code_trace | ✓PASSanswered "ANSWER: 23" | aliasing_on=0 | camp-code-lookalike-gemma4qat-001 | transcript → | |
| code_trace | ✓PASSanswered "ANSWER: 9" | aliasing_on=0 | camp-code-traps-gemma4qat-001 | transcript → | |
| code_trace | ✓PASSanswered "ANSWER: 11" | aliasing_on=0 | camp-code-length-gemma4qat-001 | transcript → | |
| code_trace | ✓PASSanswered "ANSWER: 15" | aliasing_on=0 | camp-code-length-gemma4qat-001 | transcript → | |
| code_trace | ✓PASSanswered "ANSWER: 9" | aliasing_on=0 | camp-code-traps-gemma4qat-001 | transcript → | |
| code_trace | ✓PASSanswered "ANSWER: 13" | aliasing_on=0 | camp-code-length-gemma4qat-001 | transcript → | |
| code_trace | ✓PASSanswered "ANSWER: 12" | aliasing_on=0 | camp-code-length-gemma4qat-001 | transcript → | |
| code_trace | ✓PASSanswered "ANSWER: [7, 9, 2, 4]" | aliasing_on=0 | camp-code-length-gemma4qat-001 | transcript → | |
| code_trace | ✓PASSanswered "ANSWER: 16" | aliasing_on=0 | camp-code-traps-gemma4qat-001 | transcript → | |
| code_trace | ✓PASSanswered "ANSWER: [5, 9, 0, 2]" | aliasing_on=0 | camp-code-traps-gemma4qat-001 | transcript → | |
| code_trace | ✓PASSanswered "ANSWER: 21" | aliasing_on=0 | camp-code-lookalike-gemma4qat-001 | transcript → | |
| code_trace | ✓PASSanswered "ANSWER: 27" | aliasing_on=0 | camp-code-lookalike-gemma4qat-001 | transcript → | |
| code_trace | ✓PASSanswered "ANSWER: [0, 3, 2, 8, 4, 3]" | aliasing_on=0 | camp-code-traps-gemma4qat-001 | transcript → | |
| code_trace | ✓PASSanswered "ANSWER: [5, 5, 8, 8, 5]" | aliasing_on=0 | camp-code-lookalike-gemma4qat-001 | transcript → | |
| code_trace | ✓PASSanswered "ANSWER: [0, 4, 0, 9, 4, 4]" | aliasing_on=0 | camp-code-traps-gemma4qat-001 | transcript → | |
| code_trace | ✓PASSanswered "ANSWER: [1, 0, 4, 6]" | aliasing_on=0 | camp-code-length-gemma4qat-001 | transcript → | |
| code_trace | ✓PASSanswered "ANSWER: 24" | aliasing_on=0 | camp-code-lookalike-gemma4qat-001 | transcript → | |
| code_trace | ✓PASSanswered "ANSWER: [2, 9, 4, 3]" | aliasing_on=0 | camp-code-lookalike-gemma4qat-001 | transcript → | |
| code_trace | ✓PASSanswered "ANSWER: 7" | aliasing_on=0 | camp-code-length-gemma4qat-001 | transcript → | |
| code_trace | ✓PASSanswered "ANSWER: 15" | aliasing_on=0 | camp-code-lookalike-gemma4qat-001 | transcript → | |
| code_trace | ✓PASSanswered "ANSWER: [8, 0, 5, 0]" | aliasing_on=0 | camp-code-traps-gemma4qat-001 | transcript → | |
| code_trace | ✓PASSanswered "ANSWER: 17" | aliasing_on=0 | camp-code-traps-gemma4qat-001 | transcript → | |
| code_trace | ✓PASSanswered "ANSWER: 17" | aliasing_on=0 | camp-code-lookalike-gemma4qat-001 | transcript → | |
| code_trace | ✓PASSanswered "ANSWER: 8" | aliasing_on=0 | camp-code-traps-gemma4qat-001 | transcript → | |
| code_trace | ✓PASSanswered "ANSWER: 47" | aliasing_on=0 | camp-code-traps-gemma4qat-001 | transcript → | |
| code_trace | ✓PASSanswered "ANSWER: 17" | aliasing_on=0 | camp-code-lookalike-gemma4qat-001 | transcript → | |
| code_trace | ✓PASSanswered "ANSWER: 17" | aliasing_on=0 | camp-code-length-gemma4qat-001 | transcript → | |
| code_trace | ✓PASSanswered "ANSWER: 49" | aliasing_on=0 | camp-code-traps-gemma4qat-001 | transcript → | |
| code_trace | ✓PASSanswered "ANSWER: 15" | aliasing_on=0 | camp-code-lookalike-gemma4qat-001 | transcript → | |
| code_trace | ✓PASSanswered "ANSWER: 16" | aliasing_on=0 | camp-code-lookalike-gemma4qat-001 | transcript → | |
| code_trace | ✓PASSanswered "ANSWER: 12" | aliasing_on=0 | camp-code-length-gemma4qat-001 | transcript → | |
| code_trace | ✓PASSanswered "ANSWER: [5, 8, 2, 18]" | aliasing_on=0 | camp-code-length-gemma4qat-001 | transcript → | |
| code_trace | ✓PASSanswered "ANSWER: [0, 2, 1, 0, 3]" | aliasing_on=0 | camp-code-lookalike-gemma4qat-001 | transcript → | |
| code_trace | ✓PASSanswered "ANSWER: [3, 6, 15, 8]" | aliasing_on=0 | camp-code-traps-gemma4qat-001 | transcript → | |
| code_trace | ✓PASSanswered "ANSWER: 17" | aliasing_on=0 | camp-code-length-gemma4qat-001 | transcript → | |
| code_trace | ✓PASSanswered "ANSWER: 29" | aliasing_on=0 | camp-code-traps-gemma4qat-001 | transcript → | |
| code_trace | ✓PASSanswered "ANSWER: 16" | aliasing_on=0 | camp-code-lookalike-gemma4qat-001 | transcript → | |
| code_trace | ✓PASSanswered "ANSWER: 28" | aliasing_on=0 | camp-code-traps-gemma4qat-001 | transcript → | |
| code_trace | ✓PASSanswered "ANSWER: 15" | aliasing_on=0 | camp-code-lookalike-gemma4qat-001 | transcript → | |
| code_trace | ✓PASSanswered "ANSWER: 33" | aliasing_on=0 | camp-code-length-gemma4qat-001 | transcript → | |
| code_trace | ✓PASSanswered "ANSWER: 12" | aliasing_on=0 | camp-code-traps-gemma4qat-001 | transcript → | |
| code_trace | ✓PASSanswered "ANSWER: 8" | aliasing_on=0 | camp-code-traps-gemma4qat-001 | transcript → | |
| code_trace | ✓PASSanswered "ANSWER: 10" | aliasing_on=0 | camp-code-length-gemma4qat-001 | transcript → | |
| code_trace | ✓PASSanswered "ANSWER: 5" | aliasing_on=0 | camp-code-traps-gemma4qat-001 | transcript → | |
| code_trace | ✓PASSanswered "ANSWER: 39" | aliasing_on=0 | camp-code-traps-gemma4qat-001 | transcript → | |
| code_trace | ✓PASSanswered "ANSWER: [3, 4, 2, 2]" | aliasing_on=0 | camp-code-traps-gemma4qat-001 | transcript → | |
| code_trace | ✓PASSanswered "ANSWER: 14" | aliasing_on=0 | camp-code-lookalike-gemma4qat-001 | transcript → | |
| code_trace | ✓PASSanswered "ANSWER: [5, 5, 1, 2]" | aliasing_on=0 | camp-code-length-gemma4qat-001 | transcript → | |
| code_trace | ✓PASSanswered "ANSWER: [8, 2, 8, 12, 9]" | aliasing_on=0 | camp-code-traps-gemma4qat-001 | transcript → | |
| code_trace | ✓PASSanswered "ANSWER: 21" | aliasing_on=0 | camp-code-lookalike-gemma4qat-001 | transcript → | |
| code_trace | ✓PASSanswered "ANSWER: 8" | aliasing_on=0 | camp-code-traps-gemma4qat-001 | transcript → | |
| code_trace | ✓PASSanswered "ANSWER: 17" | aliasing_on=0 | camp-code-lookalike-gemma4qat-001 | transcript → | |
| code_trace | ✓PASSanswered "ANSWER: -9" | aliasing_on=0 | camp-code-length-gemma4qat-001 | transcript → | |
| code_trace | ✓PASSanswered "ANSWER: 8" | aliasing_on=0 | camp-code-length-gemma4qat-001 | transcript → | |
| code_trace | ✓PASSanswered "ANSWER: 20" | aliasing_on=0 | camp-code-length-gemma4qat-001 | transcript → | |
| code_trace | ✓PASSanswered "ANSWER: 15" | aliasing_on=0 | camp-code-lookalike-gemma4qat-001 | transcript → | |
| code_trace | ✓PASSanswered "ANSWER: 12" | aliasing_on=0 | camp-code-length-gemma4qat-001 | transcript → | |
| code_trace | ✓PASSanswered "ANSWER: 4" | aliasing_on=0 | camp-code-traps-gemma4qat-001 | transcript → | |
| code_trace | ✓PASSanswered "ANSWER: 10" | aliasing_on=0 | camp-code-traps-gemma4qat-001 | transcript → | |
| code_trace | ✓PASSanswered "ANSWER: 45" | aliasing_on=0 | camp-code-lookalike-gemma4qat-001 | transcript → | |
| code_trace | ✓PASSanswered "ANSWER: 15" | aliasing_on=0 | camp-code-traps-gemma4qat-001 | transcript → | |
| code_trace | ✓PASSanswered "ANSWER: [7, 3, 9, 3]" | aliasing_on=0 | camp-code-traps-gemma4qat-001 | transcript → | |
| code_trace | ✓PASSanswered "ANSWER: 12" | aliasing_on=0 | camp-code-length-gemma4qat-001 | transcript → | |
| code_trace | ✓PASSanswered "ANSWER: 17" | aliasing_on=0 | camp-code-length-gemma4qat-001 | transcript → | |
| code_trace | ✓PASSanswered "ANSWER: 9" | aliasing_on=0 | camp-code-traps-gemma4qat-001 | transcript → | |
| code_trace | ✓PASSanswered "ANSWER: 25" | aliasing_on=0 | camp-code-traps-gemma4qat-001 | transcript → | |
| code_trace | ✓PASSanswered "ANSWER: 8" | aliasing_on=0 | camp-code-length-gemma4qat-001 | transcript → | |
| code_trace | ✓PASSanswered "ANSWER: 17" | aliasing_on=0 | camp-code-traps-gemma4qat-001 | transcript → | |
| code_trace | ✓PASSanswered "ANSWER: [3, 3, 1, 4, 2, 18]" | aliasing_on=0 | camp-code-lookalike-gemma4qat-001 | transcript → | |
| code_trace | ✓PASSanswered "ANSWER: [1, 7, 8, 8, 3]" | aliasing_on=0 | camp-code-lookalike-gemma4qat-001 | transcript → | |
| code_trace | ✓PASSanswered "ANSWER: 9" | aliasing_on=0 | camp-code-length-gemma4qat-001 | transcript → | |
| code_trace | ✓PASSanswered "ANSWER: [5, 4, 7, 54, 10]" | aliasing_on=0 | camp-code-length-gemma4qat-001 | transcript → | |
| code_trace | ✓PASSanswered "ANSWER: 100" | aliasing_on=1 | camp-code-traps-gemma4qat-001 | transcript → | |
| code_trace | ✓PASSanswered "ANSWER: 9" | aliasing_on=0 | camp-code-lookalike-gemma4qat-001 | transcript → | |
| code_trace | ✓PASSanswered "ANSWER: 16" | aliasing_on=0 | camp-code-lookalike-gemma4qat-001 | transcript → | |
| code_trace | ✓PASSanswered "ANSWER: 12" | aliasing_on=0 | camp-code-length-gemma4qat-001 | transcript → | |
| code_trace | ✓PASSanswered "ANSWER: 48" | aliasing_on=0 | camp-code-lookalike-gemma4qat-001 | transcript → | |
| code_trace | ✓PASSanswered "ANSWER: [5, 4, 0, 4, 2, 4, 9, 4, 0]" | aliasing_on=0 | camp-code-lookalike-gemma4qat-001 | transcript → | |
| code_trace | ✓PASSanswered "ANSWER: 72" | aliasing_on=1 | camp-code-traps-gemma4qat-001 | transcript → | |
| code_trace | ✓PASSanswered "ANSWER: 8" | aliasing_on=0 | camp-code-length-gemma4qat-001 | transcript → | |
| code_trace | ✓PASSanswered "ANSWER: 113" | aliasing_on=1 | camp-code-traps-gemma4qat-001 | transcript → | |
| code_trace | ✓PASSanswered "ANSWER: 99" | aliasing_on=1 | camp-code-traps-gemma4qat-001 | transcript → | |
| code_trace | ✓PASSanswered "ANSWER: 5" | aliasing_on=0 | camp-code-lookalike-gemma4qat-001 | transcript → | |
| code_trace | ✓PASSanswered "ANSWER: [5, 8, 8, 2, 5, 5, 7, 7, 6, 6, 0, 0, 3, 3, 6,..." | aliasing_on=0 | camp-code-lookalike-gemma4qat-001 | transcript → | |
| code_trace | ✓PASSanswered "ANSWER: 6" | aliasing_on=0 | camp-code-lookalike-gemma4qat-001 | transcript → | |
| code_trace | ✓PASSanswered "ANSWER: 0" | aliasing_on=0 | camp-code-length-gemma4qat-001 | transcript → | |
| code_trace | ✓PASSanswered "ANSWER: 4353" | aliasing_on=0 | camp-code-length-gemma4qat-001 | transcript → | |
| code_trace | ✓PASSanswered "ANSWER: [6, 8, 1, 1, 18, 16, 23, 0, 1, 2, 3, 4, 2, 3,..." | aliasing_on=1 | camp-code-traps-gemma4qat-001 | transcript → | |
| code_trace | ✓PASSanswered "ANSWER: [2, 7, 0, 2, 4, 32, 10, 0, 1, 2, 3, 4, 5, -1,..." | aliasing_on=1 | camp-code-traps-gemma4qat-001 | transcript → | |
| code_trace | ✓PASSanswered "ANSWER: 15" | aliasing_on=0 | camp-code-lookalike-gemma4qat-001 | transcript → | |
| code_trace | ✓PASSanswered "ANSWER: 14" | aliasing_on=0 | camp-code-lookalike-gemma4qat-001 | transcript → | |
| code_trace | ✓PASSanswered "ANSWER: 17" | aliasing_on=0 | camp-code-lookalike-gemma4qat-001 | transcript → | |
| code_trace | ✓PASSanswered "ANSWER: [8, 4, 3, 3]" | aliasing_on=0 | camp-code-lookalike-gemma4qat-001 | transcript → | |
| code_trace | ✓PASSanswered "ANSWER: 21" | aliasing_on=0 | camp-code-lookalike-gemma4qat-001 | transcript → | |
| code_trace | ✓PASSanswered "ANSWER: [0, 7, 4, 1, 3]" | aliasing_on=0 | camp-code-lookalike-gemma4qat-001 | transcript → | |
| code_trace | ✓PASSanswered "ANSWER: [8, 1, 3, 3, 2, 2, 4, 4, 5, 5, 13, 8, 27, 0, ..." | aliasing_on=1 | camp-code-traps-gemma4qat-001 | transcript → | |
| code_trace | ✓PASSanswered "ANSWER: [5, 2, 3, 9, 9, 4, 4, 1, 1, 0, 0, 3, 3, 5, 9,..." | aliasing_on=0 | camp-code-lookalike-gemma4qat-001 | transcript → | |
| code_trace | ✓PASSanswered "ANSWER: 90" | aliasing_on=1 | camp-code-traps-gemma4qat-001 | transcript → | |
| code_trace | ✓PASSanswered "ANSWER: 112" | aliasing_on=1 | camp-code-traps-gemma4qat-001 | transcript → | |
| code_trace | ✓PASSanswered "ANSWER: 59" | aliasing_on=1 | camp-code-traps-gemma4qat-001 | transcript → | |
| code_trace | ✓PASSanswered "ANSWER: 109" | aliasing_on=1 | camp-code-traps-gemma4qat-001 | transcript → | |
| code_trace | ✓PASSanswered "ANSWER: 82" | aliasing_on=0 | camp-code-lookalike-gemma4qat-001 | transcript → | |
| code_trace | ✓PASSanswered "ANSWER: 8" | aliasing_on=0 | camp-code-lookalike-gemma4qat-001 | transcript → | |
| code_trace | ✓PASSanswered "ANSWER: 14" | aliasing_on=0 | camp-code-lookalike-gemma4qat-001 | transcript → | |
| code_trace | ✓PASSanswered "ANSWER: 20" | aliasing_on=0 | camp-code-lookalike-gemma4qat-001 | transcript → | |
| code_trace | ✓PASSanswered "ANSWER: 30" | aliasing_on=0 | camp-code-lookalike-gemma4qat-001 | transcript → | |
| code_trace | ✓PASSanswered "ANSWER: 64" | aliasing_on=1 | camp-code-traps-gemma4qat-001 | transcript → | |
| code_trace | ✓PASSanswered "ANSWER: [2, 0, 1, 3]" | aliasing_on=0 | camp-code-lookalike-gemma4qat-001 | transcript → | |
| code_trace | ✓PASSanswered "ANSWER: [5, 9, 17, 3, 16, 14, 3, 4, 5, -2, 2, 0]" | aliasing_on=1 | camp-code-traps-gemma4qat-001 | transcript → | |
| code_trace | ✓PASSanswered "ANSWER: [4, 2, 3, 19, 30, 20, 0, 1, 2, 3, -2, 2, 4]" | aliasing_on=1 | camp-code-traps-gemma4qat-001 | transcript → | |
| code_trace | ✓PASSanswered "ANSWER: 18" | aliasing_on=0 | camp-code-lookalike-gemma4qat-001 | transcript → | |
| code_trace | ✓PASSanswered "ANSWER: [0, 7, 7, 2, 4, 8, 6, 8, 8, 8, 6, 6, 8, 8, 8,..." | aliasing_on=0 | camp-code-length-gemma4qat-001 | transcript → | |
| code_trace | ✓PASSanswered "ANSWER: 76" | aliasing_on=1 | camp-code-traps-gemma4qat-001 | transcript → | |
| code_trace | ✓PASSanswered "ANSWER: 132" | aliasing_on=1 | camp-code-traps-gemma4qat-001 | transcript → | |
| code_trace | ✓PASSanswered "ANSWER: 112" | aliasing_on=1 | camp-code-traps-gemma4qat-001 | transcript → | |
| code_trace | ✓PASSanswered "ANSWER: 86" | aliasing_on=1 | camp-code-traps-gemma4qat-001 | transcript → | |
| code_trace | ✓PASSanswered "ANSWER: [9, 4, 12, 7, 3, 11, 26, 0, 1, 2, 3, 4, 5, 2, 3]" | aliasing_on=1 | camp-code-traps-gemma4qat-001 | transcript → | |
| code_trace | ✓PASSanswered "ANSWER: 18" | aliasing_on=0 | camp-code-lookalike-gemma4qat-001 | transcript → | |
| code_trace | ✓PASSanswered "ANSWER: 13" | aliasing_on=0 | camp-code-length-gemma4qat-001 | transcript → | |
| code_trace | ✓PASSanswered "ANSWER: 35" | aliasing_on=0 | camp-code-lookalike-gemma4qat-001 | transcript → | |
| code_trace | ✓PASSanswered "ANSWER: 22" | aliasing_on=0 | camp-code-lookalike-gemma4qat-001 | transcript → | |
| code_trace | ✓PASSanswered "ANSWER: [9, 1, 2, 4, 82]" | aliasing_on=0 | camp-code-lookalike-gemma4qat-001 | transcript → | |
| code_trace | ✓PASSanswered "ANSWER: 3" | aliasing_on=0 | camp-code-length-gemma4qat-001 | transcript → | |
| code_trace | ✓PASSanswered "ANSWER: [6, 1, 4, 24, 3, 8]" | aliasing_on=0 | camp-code-lookalike-gemma4qat-001 | transcript → | |
| code_trace | ✓PASSanswered "ANSWER: 13" | aliasing_on=0 | camp-code-length-gemma4qat-001 | transcript → | |
| code_trace | ✓PASSanswered "ANSWER: 6" | aliasing_on=0 | camp-code-length-gemma4qat-001 | transcript → | |
| code_trace | ✓PASSanswered "ANSWER: 124" | aliasing_on=1 | camp-code-traps-gemma4qat-001 | transcript → | |
| code_trace | ✓PASSanswered "ANSWER: 9" | aliasing_on=0 | camp-code-lookalike-gemma4qat-001 | transcript → | |
| code_trace | ✓PASSanswered "ANSWER: [1, 5, 14, 10, 12, 0, 1, 2, 3, 4, 2, 3, 4, 0]" | aliasing_on=1 | camp-code-traps-gemma4qat-001 | transcript → | |
| code_trace | ✓PASSanswered "ANSWER: [7, 1, 5, 6, 4]" | aliasing_on=0 | camp-code-length-gemma4qat-001 | transcript → | |
| code_trace | ✓PASSanswered "ANSWER: 68" | aliasing_on=1 | camp-code-traps-gemma4qat-001 | transcript → | |
| code_trace | ✓PASSanswered "ANSWER: 57" | aliasing_on=1 | camp-code-traps-gemma4qat-001 | transcript → | |
| code_trace | ✓PASSanswered "ANSWER: 121" | aliasing_on=1 | camp-code-traps-gemma4qat-001 | transcript → | |
| code_trace | ✓PASSanswered "ANSWER: 263" | aliasing_on=1 | camp-code-traps-gemma4qat-001 | transcript → | |
| code_trace | ✓PASSanswered "ANSWER: [2, 3, 5, 1, 5, 19, 22, 14, 2, 3, 4, -2, 9, 4]" | aliasing_on=1 | camp-code-traps-gemma4qat-001 | transcript → | |
| code_trace | ✓PASSanswered "ANSWER: 59" | aliasing_on=1 | camp-code-traps-gemma4qat-001 | transcript → | |
| code_trace | ✓PASSanswered "ANSWER: 26" | aliasing_on=0 | camp-code-length-gemma4qat-001 | transcript → | |
| code_trace | ✓PASSanswered "ANSWER: [5, 4, 17, 5, 5, 2, 2, 2, 2, 25, 29, 0, 1, 2,..." | aliasing_on=1 | camp-code-traps-gemma4qat-001 | transcript → | |
| code_trace | ✓PASSanswered "ANSWER: 39" | aliasing_on=0 | camp-code-lookalike-gemma4qat-001 | transcript → | |
| code_trace | ✓PASSanswered "ANSWER: 16" | aliasing_on=0 | camp-code-lookalike-gemma4qat-001 | transcript → | |
| code_trace | ✓PASSanswered "ANSWER: 25" | aliasing_on=0 | camp-code-lookalike-gemma4qat-001 | transcript → | |
| code_trace | ✓PASSanswered "ANSWER: 18" | aliasing_on=0 | camp-code-lookalike-gemma4qat-001 | transcript → | |
| code_trace | ✓PASSanswered "ANSWER: 23" | aliasing_on=0 | camp-code-lookalike-gemma4qat-001 | transcript → | |
| code_trace | ✓PASSanswered "ANSWER: 30" | aliasing_on=0 | camp-code-lookalike-gemma4qat-001 | transcript → | |
| code_trace | ✓PASSanswered "ANSWER: 44" | aliasing_on=0 | camp-code-lookalike-gemma4qat-001 | transcript → | |
| code_trace | ✓PASSanswered "ANSWER: [1, 3, 5, -12, 2]" | aliasing_on=0 | camp-code-lookalike-gemma4qat-001 | transcript → | |
| code_trace | ✓PASSanswered "ANSWER: 22" | aliasing_on=0 | camp-code-length-gemma4qat-001 | transcript → | |
| code_trace | ✓PASSanswered "ANSWER: 2" | aliasing_on=0 | camp-code-length-gemma4qat-001 | transcript → | |
| code_trace | ✓PASSanswered "ANSWER: [3, 7, 2, 2, 2, 4, 9, 3]" | aliasing_on=0 | camp-code-length-gemma4qat-001 | transcript → | |
| code_trace | ✓PASSanswered "ANSWER: 20" | aliasing_on=0 | camp-code-length-gemma4qat-001 | transcript → | |
| code_trace | ✓PASSanswered "ANSWER: [0, 5, 1, 7, 4]" | aliasing_on=0 | camp-code-length-gemma4qat-001 | transcript → | |
| code_trace | ✓PASSanswered "ANSWER: [3, 7, 7, 4]" | aliasing_on=0 | camp-code-length-gemma4qat-001 | transcript → | |
| code_trace | ✓PASSanswered "ANSWER: [3, 7, 7, 4, 5, 4, 4, 0, 4, 4, 5, 4, 4, 6, 2]" | aliasing_on=0 | camp-code-length-gemma4qat-001 | transcript → | |
| code_trace | ✓PASSanswered "ANSWER: [9, 9, 8, 64, 6]" | aliasing_on=0 | camp-code-length-gemma4qat-001 | transcript → | |
| code_trace | ✓PASSanswered "ANSWER: 4" | aliasing_on=0 | camp-code-length-gemma4qat-001 | transcript → | |
| code_trace | ✓PASSanswered "ANSWER: [3, 4, 1, 4, 1]" | aliasing_on=0 | camp-code-length-gemma4qat-001 | transcript → | |
| code_trace | ✓PASSanswered "ANSWER: 11" | aliasing_on=0 | camp-code-length-gemma4qat-001 | transcript → | |
| code_trace | ✓PASSanswered "ANSWER: 11" | aliasing_on=0 | camp-code-length-gemma4qat-001 | transcript → | |
| code_trace | ✓PASSanswered "ANSWER: [4, 1, 0, 9, 3, 3]" | aliasing_on=0 | camp-code-length-gemma4qat-001 | transcript → | |
| code_trace | ✓PASSanswered "ANSWER: [7, 4, 4, 7, 4, 7, 7, 9, 9, 9, 9]" | aliasing_on=0 | camp-code-length-gemma4qat-001 | transcript → | |
| code_trace | ✓PASSanswered "ANSWER: [4, 9, 5, 8, 5, 3, 3, 0, 0, 7, 7, 2, 2, 9, 9,..." | aliasing_on=0 | camp-code-length-gemma4qat-001 | transcript → | |
| code_trace | ✓PASSanswered "ANSWER: [3, 8, 0, 16]" | aliasing_on=0 | camp-code-length-gemma4qat-001 | transcript → | |
| code_trace | ✓PASSanswered "ANSWER: [5, 0, 2, 5, 3, 22]" | aliasing_on=0 | camp-code-length-gemma4qat-001 | transcript → | |
| code_trace | ✓PASSanswered "ANSWER: 9" | aliasing_on=0 | camp-code-length-gemma4qat-001 | transcript → | |
| code_trace | ✓PASSanswered "ANSWER: 5" | aliasing_on=0 | camp-code-length-gemma4qat-001 | transcript → | |
| code_trace | ✓PASSanswered "ANSWER: 9" | aliasing_on=0 | camp-code-length-gemma4qat-001 | transcript → | |
| code_trace | ✓PASSanswered "ANSWER: 17" | aliasing_on=0 | camp-code-length-gemma4qat-001 | transcript → | |
| code_trace | ✓PASSanswered "ANSWER: [9, 5, 1, -2]" | aliasing_on=0 | camp-code-length-gemma4qat-001 | transcript → | |
| code_trace | ✓PASSanswered "ANSWER: 9" | aliasing_on=0 | camp-code-traps-gemma4qat-002 | transcript → | |
| code_trace | ✓PASSanswered "ANSWER: 25" | aliasing_on=0 | camp-code-copy-gemma4qat-001 | transcript → | |
| code_trace | ✓PASSanswered "ANSWER: 16" | aliasing_on=0 | camp-code-traps-gemma4qat-002 | transcript → | |
| code_trace | ✓PASSanswered "ANSWER: 14" | aliasing_on=0 | camp-code-copy-gemma4qat-001 | transcript → | |
| code_trace | ✓PASSanswered "ANSWER: 30" | aliasing_on=0 | camp-code-copy-gemma4qat-001 | transcript → | |
| code_trace | ✓PASSanswered "ANSWER: 3" | aliasing_on=0 | camp-code-dialect-gemma4qat-001 | transcript → | |
| code_trace | ✓PASSanswered "ANSWER: [0, 4, 0, 9, 4, 4]" | aliasing_on=0 | camp-code-traps-gemma4qat-002 | transcript → | |
| code_trace | ✓PASSanswered "ANSWER: 21" | aliasing_on=0 | camp-code-lookalike-gemma4qat-002 | transcript → | |
| code_trace | ✓PASSanswered "ANSWER: 27" | aliasing_on=0 | camp-code-lookalike-gemma4qat-002 | transcript → | |
| code_trace | ✓PASSanswered "ANSWER: [9, 7, 6, 6, 10, 2]" | aliasing_on=0 | camp-code-dialect-gemma4qat-001 | transcript → | |
| code_trace | ✓PASSanswered "ANSWER: 13" | aliasing_on=0 | camp-code-length-gemma4qat-002 | transcript → | |
| code_trace | ✓PASSanswered "ANSWER: [1, 0, 4, 6]" | aliasing_on=0 | camp-code-length-gemma4qat-002 | transcript → | |
| code_trace | ✓PASSanswered "ANSWER: [7, 9, 2, 4]" | aliasing_on=0 | camp-code-length-gemma4qat-002 | transcript → | |
| code_trace | ✓PASSanswered "ANSWER: [5, 5, 8, 8, 5]" | aliasing_on=0 | camp-code-lookalike-gemma4qat-002 | transcript → | |
| code_trace | ✓PASSanswered "ANSWER: 12" | aliasing_on=0 | camp-code-copy-gemma4qat-001 | transcript → | |
| code_trace | ✓PASSanswered "ANSWER: 10" | aliasing_on=0 | camp-code-copy-gemma4qat-001 | transcript → | |
| code_trace | ✓PASSanswered "ANSWER: 17" | aliasing_on=0 | camp-code-traps-gemma4qat-002 | transcript → | |
| code_trace | ✓PASSanswered "ANSWER: [4, 5, 3, 3]" | aliasing_on=0 | camp-code-traps-gemma4qat-002 | transcript → | |
| code_trace | ✓PASSanswered "ANSWER: 33" | aliasing_on=0 | camp-code-traps-gemma4qat-002 | transcript → | |
| code_trace | ✓PASSanswered "ANSWER: 15" | aliasing_on=0 | camp-code-lookalike-gemma4qat-002 | transcript → | |
| code_trace | ✓PASSanswered "ANSWER: 10" | aliasing_on=0 | camp-code-dialect-gemma4qat-001 | transcript → | |
| code_trace | ✓PASSanswered "ANSWER: 19" | aliasing_on=0 | camp-code-length-gemma4qat-002 | transcript → | |
| code_trace | ✓PASSanswered "ANSWER: 12" | aliasing_on=0 | camp-code-length-gemma4qat-002 | transcript → | |
| code_trace | ✓PASSanswered "ANSWER: 21" | aliasing_on=0 | camp-code-lookalike-gemma4qat-002 | transcript → | |
| code_trace | ✓PASSanswered "ANSWER: 29" | aliasing_on=0 | camp-code-traps-gemma4qat-002 | transcript → | |
| code_trace | ✓PASSanswered "ANSWER: 16" | aliasing_on=0 | camp-code-traps-gemma4qat-002 | transcript → | |
| code_trace | ✓PASSanswered "ANSWER: 20" | aliasing_on=0 | camp-code-traps-gemma4qat-002 | transcript → | |
| code_trace | ✓PASSanswered "ANSWER: 44" | aliasing_on=0 | camp-code-dialect-gemma4qat-001 | transcript → | |
| code_trace | ✕ERRORtimeout | aliasing_on=0 | camp-code-copy-gemma4qat-001 | transcript → | |
| code_trace | ✕ERRORtimeout | aliasing_on=0 | camp-code-length-gemma4qat-002 | transcript → | |
| code_trace | ✕ERRORtimeout | aliasing_on=0 | camp-code-lookalike-gemma4qat-002 | transcript → |