lm-studio
qwen/qwen3.6-35b-a3b
Run score 100.0% across 70 completed iterations.
- Score
- 100.0%
- Passed
- 70
- Failed
- 0
- Errors
- 0
- Started
- 5/11/2026, 1:25:28 PM
- Ended
- 5/11/2026, 1:41:40 PM
- Duration
- 971s
Category Breakdown
| Category | Total | Passed | Failed | Errors | Score |
|---|---|---|---|---|---|
| Basic File Reading | 40 | 40 | 0 | 0 | 100.0% |
| Basic Skills | 30 | 30 | 0 | 0 | 100.0% |
Cases
| Case | iterations | Passed | Failed | Errors | Score |
|---|---|---|---|---|---|
| find-file | 10 total | 10 | 0 | 0 | 100.0% |
| read-exact-file | 10 total | 10 | 0 | 0 | 100.0% |
| read-exact-file-with-at-reference | 10 total | 10 | 0 | 0 | 100.0% |
| read-file | 10 total | 10 | 0 | 0 | 100.0% |
| use-skill | 10 total | 10 | 0 | 0 | 100.0% |
| use-skill-with-refs | 10 total | 10 | 0 | 0 | 100.0% |
| use-skill-with-scripts | 10 total | 10 | 0 | 0 | 100.0% |
Iterations
70 matching iterations
| Iteration | Model | Category | Variant | Status | Duration | Tools | Tokens | Context |
|---|---|---|---|---|---|---|---|---|
| find-file / 001 | lm-studio / qwen/qwen3.6-35b-a3b | Basic File Reading | Baseline (/skills) | passed | 18,885ms | 4 | 7,631 | 5.2% |
| find-file / 002 | lm-studio / qwen/qwen3.6-35b-a3b | Basic File Reading | Baseline (/skills) | passed | 13,681ms | 3 | 5,953 | 4.9% |
| find-file / 003 | lm-studio / qwen/qwen3.6-35b-a3b | Basic File Reading | Baseline (/skills) | passed | 13,257ms | 4 | 6,170 | 5.1% |
| find-file / 004 | lm-studio / qwen/qwen3.6-35b-a3b | Basic File Reading | Baseline (/skills) | passed | 14,456ms | 5 | 7,785 | 5.3% |
| find-file / 005 | lm-studio / qwen/qwen3.6-35b-a3b | Basic File Reading | Baseline (/skills) | passed | 12,194ms | 4 | 6,029 | 5.0% |
| find-file / 006 | lm-studio / qwen/qwen3.6-35b-a3b | Basic File Reading | Baseline (/skills) | passed | 14,390ms | 6 | 7,953 | 5.5% |
| find-file / 007 | lm-studio / qwen/qwen3.6-35b-a3b | Basic File Reading | Baseline (/skills) | passed | 11,838ms | 4 | 6,064 | 5.0% |
| find-file / 008 | lm-studio / qwen/qwen3.6-35b-a3b | Basic File Reading | Baseline (/skills) | passed | 12,688ms | 4 | 6,220 | 5.2% |
| find-file / 009 | lm-studio / qwen/qwen3.6-35b-a3b | Basic File Reading | Baseline (/skills) | passed | 11,479ms | 4 | 6,063 | 5.1% |
| find-file / 010 | lm-studio / qwen/qwen3.6-35b-a3b | Basic File Reading | Baseline (/skills) | passed | 15,038ms | 5 | 7,844 | 5.4% |
| read-exact-file / 001 | lm-studio / qwen/qwen3.6-35b-a3b | Basic File Reading | Baseline (/skills) | passed | 7,348ms | 2 | 4,598 | 4.9% |
| read-exact-file / 002 | lm-studio / qwen/qwen3.6-35b-a3b | Basic File Reading | Baseline (/skills) | passed | 11,878ms | 2 | 4,603 | 4.9% |
| read-exact-file / 003 | lm-studio / qwen/qwen3.6-35b-a3b | Basic File Reading | Baseline (/skills) | passed | 13,866ms | 2 | 4,650 | 5.0% |
| read-exact-file / 004 | lm-studio / qwen/qwen3.6-35b-a3b | Basic File Reading | Baseline (/skills) | passed | 13,656ms | 2 | 4,625 | 4.9% |
| read-exact-file / 005 | lm-studio / qwen/qwen3.6-35b-a3b | Basic File Reading | Baseline (/skills) | passed | 14,786ms | 2 | 4,613 | 4.9% |
| read-exact-file / 006 | lm-studio / qwen/qwen3.6-35b-a3b | Basic File Reading | Baseline (/skills) | passed | 13,743ms | 2 | 4,613 | 4.9% |
| read-exact-file / 007 | lm-studio / qwen/qwen3.6-35b-a3b | Basic File Reading | Baseline (/skills) | passed | 14,205ms | 2 | 4,654 | 5.0% |
| read-exact-file / 008 | lm-studio / qwen/qwen3.6-35b-a3b | Basic File Reading | Baseline (/skills) | passed | 13,797ms | 2 | 4,669 | 5.0% |
| read-exact-file / 009 | lm-studio / qwen/qwen3.6-35b-a3b | Basic File Reading | Baseline (/skills) | passed | 13,748ms | 2 | 4,656 | 5.0% |
| read-exact-file / 010 | lm-studio / qwen/qwen3.6-35b-a3b | Basic File Reading | Baseline (/skills) | passed | 12,567ms | 2 | 4,690 | 5.1% |
| read-exact-file-with-at-reference / 001 | lm-studio / qwen/qwen3.6-35b-a3b | Basic File Reading | Baseline (/skills) | passed | 12,859ms | 2 | 4,359 | 4.7% |
| read-exact-file-with-at-reference / 002 | lm-studio / qwen/qwen3.6-35b-a3b | Basic File Reading | Baseline (/skills) | passed | 11,772ms | 2 | 4,356 | 4.7% |
| read-exact-file-with-at-reference / 003 | lm-studio / qwen/qwen3.6-35b-a3b | Basic File Reading | Baseline (/skills) | passed | 11,733ms | 2 | 4,343 | 4.7% |
| read-exact-file-with-at-reference / 004 | lm-studio / qwen/qwen3.6-35b-a3b | Basic File Reading | Baseline (/skills) | passed | 12,463ms | 2 | 4,438 | 4.8% |
| read-exact-file-with-at-reference / 005 | lm-studio / qwen/qwen3.6-35b-a3b | Basic File Reading | Baseline (/skills) | passed | 11,876ms | 2 | 4,379 | 4.7% |
| read-exact-file-with-at-reference / 006 | lm-studio / qwen/qwen3.6-35b-a3b | Basic File Reading | Baseline (/skills) | passed | 12,225ms | 2 | 4,373 | 4.7% |
| read-exact-file-with-at-reference / 007 | lm-studio / qwen/qwen3.6-35b-a3b | Basic File Reading | Baseline (/skills) | passed | 11,379ms | 2 | 4,444 | 4.8% |
| read-exact-file-with-at-reference / 008 | lm-studio / qwen/qwen3.6-35b-a3b | Basic File Reading | Baseline (/skills) | passed | 11,178ms | 2 | 4,346 | 4.7% |
| read-exact-file-with-at-reference / 009 | lm-studio / qwen/qwen3.6-35b-a3b | Basic File Reading | Baseline (/skills) | passed | 12,529ms | 2 | 4,350 | 4.7% |
| read-exact-file-with-at-reference / 010 | lm-studio / qwen/qwen3.6-35b-a3b | Basic File Reading | Baseline (/skills) | passed | 11,505ms | 2 | 4,363 | 4.7% |
| read-file / 001 | lm-studio / qwen/qwen3.6-35b-a3b | Basic File Reading | Baseline (/skills) | passed | 22,082ms | 5 | 9,314 | 5.3% |
| read-file / 002 | lm-studio / qwen/qwen3.6-35b-a3b | Basic File Reading | Baseline (/skills) | passed | 18,410ms | 4 | 7,568 | 5.1% |
| read-file / 003 | lm-studio / qwen/qwen3.6-35b-a3b | Basic File Reading | Baseline (/skills) | passed | 25,388ms | 5 | 9,263 | 5.3% |
| read-file / 004 | lm-studio / qwen/qwen3.6-35b-a3b | Basic File Reading | Baseline (/skills) | passed | 23,095ms | 4 | 7,615 | 5.2% |
| read-file / 005 | lm-studio / qwen/qwen3.6-35b-a3b | Basic File Reading | Baseline (/skills) | passed | 21,509ms | 5 | 9,335 | 5.4% |
| read-file / 006 | lm-studio / qwen/qwen3.6-35b-a3b | Basic File Reading | Baseline (/skills) | passed | 14,692ms | 3 | 5,902 | 4.9% |
| read-file / 007 | lm-studio / qwen/qwen3.6-35b-a3b | Basic File Reading | Baseline (/skills) | passed | 21,652ms | 5 | 9,258 | 5.3% |
| read-file / 008 | lm-studio / qwen/qwen3.6-35b-a3b | Basic File Reading | Baseline (/skills) | passed | 18,095ms | 4 | 7,614 | 5.2% |
| read-file / 009 | lm-studio / qwen/qwen3.6-35b-a3b | Basic File Reading | Baseline (/skills) | passed | 17,077ms | 4 | 7,617 | 5.2% |
| read-file / 010 | lm-studio / qwen/qwen3.6-35b-a3b | Basic File Reading | Baseline (/skills) | passed | 20,970ms | 5 | 9,251 | 5.3% |
| use-skill / 001 | lm-studio / qwen/qwen3.6-35b-a3b | Basic Skills | Baseline (/skills) | passed | 8,971ms | 2 | 4,658 | 5.0% |
| use-skill / 002 | lm-studio / qwen/qwen3.6-35b-a3b | Basic Skills | Baseline (/skills) | passed | 9,159ms | 2 | 4,671 | 5.0% |
| use-skill / 003 | lm-studio / qwen/qwen3.6-35b-a3b | Basic Skills | Baseline (/skills) | passed | 9,685ms | 2 | 4,662 | 5.0% |
| use-skill / 004 | lm-studio / qwen/qwen3.6-35b-a3b | Basic Skills | Baseline (/skills) | passed | 8,684ms | 2 | 4,682 | 5.0% |
| use-skill / 005 | lm-studio / qwen/qwen3.6-35b-a3b | Basic Skills | Baseline (/skills) | passed | 8,604ms | 2 | 4,646 | 4.9% |
| use-skill / 006 | lm-studio / qwen/qwen3.6-35b-a3b | Basic Skills | Baseline (/skills) | passed | 9,676ms | 2 | 4,637 | 4.9% |
| use-skill / 007 | lm-studio / qwen/qwen3.6-35b-a3b | Basic Skills | Baseline (/skills) | passed | 8,800ms | 2 | 4,628 | 4.9% |
| use-skill / 008 | lm-studio / qwen/qwen3.6-35b-a3b | Basic Skills | Baseline (/skills) | passed | 9,609ms | 2 | 4,648 | 4.9% |
| use-skill / 009 | lm-studio / qwen/qwen3.6-35b-a3b | Basic Skills | Baseline (/skills) | passed | 10,513ms | 2 | 4,627 | 4.9% |
| use-skill / 010 | lm-studio / qwen/qwen3.6-35b-a3b | Basic Skills | Baseline (/skills) | passed | 9,366ms | 2 | 4,670 | 5.0% |
| use-skill-with-refs / 001 | lm-studio / qwen/qwen3.6-35b-a3b | Basic Skills | Baseline (/skills) | passed | 10,912ms | 3 | 6,543 | 5.4% |
| use-skill-with-refs / 002 | lm-studio / qwen/qwen3.6-35b-a3b | Basic Skills | Baseline (/skills) | passed | 11,674ms | 3 | 6,716 | 5.5% |
| use-skill-with-refs / 003 | lm-studio / qwen/qwen3.6-35b-a3b | Basic Skills | Baseline (/skills) | passed | 11,752ms | 3 | 6,643 | 5.5% |
| use-skill-with-refs / 004 | lm-studio / qwen/qwen3.6-35b-a3b | Basic Skills | Baseline (/skills) | passed | 12,361ms | 3 | 6,577 | 5.4% |
| use-skill-with-refs / 005 | lm-studio / qwen/qwen3.6-35b-a3b | Basic Skills | Baseline (/skills) | passed | 11,400ms | 3 | 6,533 | 5.3% |
| use-skill-with-refs / 006 | lm-studio / qwen/qwen3.6-35b-a3b | Basic Skills | Baseline (/skills) | passed | 11,617ms | 3 | 6,547 | 5.3% |
| use-skill-with-refs / 007 | lm-studio / qwen/qwen3.6-35b-a3b | Basic Skills | Baseline (/skills) | passed | 12,661ms | 3 | 6,578 | 5.4% |
| use-skill-with-refs / 008 | lm-studio / qwen/qwen3.6-35b-a3b | Basic Skills | Baseline (/skills) | passed | 12,105ms | 3 | 6,673 | 5.5% |
| use-skill-with-refs / 009 | lm-studio / qwen/qwen3.6-35b-a3b | Basic Skills | Baseline (/skills) | passed | 12,323ms | 3 | 6,607 | 5.4% |
| use-skill-with-refs / 010 | lm-studio / qwen/qwen3.6-35b-a3b | Basic Skills | Baseline (/skills) | passed | 11,765ms | 3 | 6,637 | 5.5% |
| use-skill-with-scripts / 001 | lm-studio / qwen/qwen3.6-35b-a3b | Basic Skills | Baseline (/skills) | passed | 12,112ms | 3 | 6,979 | 5.7% |
| use-skill-with-scripts / 002 | lm-studio / qwen/qwen3.6-35b-a3b | Basic Skills | Baseline (/skills) | passed | 13,989ms | 4 | 9,034 | 6.0% |
| use-skill-with-scripts / 003 | lm-studio / qwen/qwen3.6-35b-a3b | Basic Skills | Baseline (/skills) | passed | 11,542ms | 3 | 7,039 | 5.7% |
| use-skill-with-scripts / 004 | lm-studio / qwen/qwen3.6-35b-a3b | Basic Skills | Baseline (/skills) | passed | 12,473ms | 3 | 7,057 | 5.8% |
| use-skill-with-scripts / 005 | lm-studio / qwen/qwen3.6-35b-a3b | Basic Skills | Baseline (/skills) | passed | 11,634ms | 3 | 7,057 | 5.8% |
| use-skill-with-scripts / 006 | lm-studio / qwen/qwen3.6-35b-a3b | Basic Skills | Baseline (/skills) | passed | 12,524ms | 3 | 7,065 | 5.8% |
| use-skill-with-scripts / 007 | lm-studio / qwen/qwen3.6-35b-a3b | Basic Skills | Baseline (/skills) | passed | 11,748ms | 3 | 7,012 | 5.7% |
| use-skill-with-scripts / 008 | lm-studio / qwen/qwen3.6-35b-a3b | Basic Skills | Baseline (/skills) | passed | 11,056ms | 3 | 7,022 | 5.7% |
| use-skill-with-scripts / 009 | lm-studio / qwen/qwen3.6-35b-a3b | Basic Skills | Baseline (/skills) | passed | 10,844ms | 3 | 7,024 | 5.7% |
| use-skill-with-scripts / 010 | lm-studio / qwen/qwen3.6-35b-a3b | Basic Skills | Baseline (/skills) | passed | 11,057ms | 3 | 7,062 | 5.7% |