wrapped·Apr 28, 2026
/r/r_e3t93rscswqyour run
Qwen2.5-7B-Instruct-4bit
on M3 Pro
15.7
tok/sdecode
M3 Pro (18-core GPU) + 36GB unified
rank in tier
7/11M3 Pro runstop 64%
best workload
chat-short
where the rig flew
slowest workload
—
single-workload run
backend
mlxMLX is the fastest backend on Apple Silicon for dense models.
faster than
- Qwen3-32B-Instruct.Q4_K_M on smoke-host10.0 tok/s
- m on x10.0 tok/s