Skip to content
llm-speed
← raw run
wrapped·Apr 28, 2026
/r/r_h0-use1ypnb
your run

Llama-3.1-8B-Instruct-4bit

on M3 Pro
29.2
tok/sdecode
M3 Pro (18-core GPU) + 36GB unified
rank in tier
4/11M3 Pro runstop 36%
best workload
chat-short
where the rig flew
slowest workload
—
single-workload run
backend
mlxMLX is the fastest backend on Apple Silicon for dense models.
faster than
  • llama-3.3-70b-Instruct-4bit on M3 Ultra16.8 tok/s
  • qwen2.5-72b-Instruct-4bit on M3 Ultra16.3 tok/s
  • Qwen3-32B-Instruct.Q4_K_M on smoke-host10.0 tok/s
share
29.2 tok/s on M3 Pro running Llama-3.1-8B-Instruct-4bit — top 36% of M3 Pro runs. Signed benchmark via llm-speed.
https://llm-speed.com/wrapped/r_h0-use1ypnb
X / TwitterBlueskyMastodonRedditraw run

This is a shareable view of one signed llm-speed suite-suite-v1 run. Numbers are not edited. The raw record has every workload, the public key, and the fingerprint hash.