Skip to content
llm-speed

stable-code-instruct-3b-4bit on M3 Ultra (60-core GPU) + 96GB unified

M3 Ultra (60-core GPU) + 96GB unifiedM3 Ultra (60-core GPU) + 96GB unified
suite suite-v1
cli 0.0.1-dev
signedG8xb3zMu3+…
Embed badgesubmitted Apr 28, 2026

Workload results

WorkloadBackendModeldecode tok/sprefill tok/sTTFTp50p95
chat-shortmlx@0.31.3mlx-community/stable-code-instruct-3b-4bit192.5tok/s560.7tok/s226ms5.1ms6.1ms

Reproduce on your machine

Same workload, same model, signed at your rig. The exact command that produced this run:

$ pipx install llm-speed && llm-speed bench --model 'mlx-community/stable-code-instruct-3b-4bit' --workload 'chat-short'

Runs in about a minute. Your number lands on the leaderboard signed and linkable. How it's measured.

Embed this run

Drop the badge into a README, blog post, or signature. Each render is a backlink to the signed result.

llm-speed: 192 tok/s on M3 Ultra (60-core GPU) (stable-code-instruct-3b-4bit)
[![llm-speed: 192 tok/s on M3 Ultra (60-core GPU) (stable-code-instruct-3b-4bit)](https://llm-speed.com/badge/r_y2_5y8oo97d.svg)](https://llm-speed.com/r/r_y2_5y8oo97d)

Related benchmarks

Provenance

Run ID
r_y2_5y8oo97d
Fingerprint hash
bbf15132ccbbe7d7
Public key
G8xb3zMu3+pznEici/TiW0gPk5qSNIYIikGCwm1rMdQ=
Received
2026-04-28 14:38:39