community pool / model answer

Qwen3-4B

chat · Qwen/Qwen3-4B

55.3 tok/s · model median · 15 runs in the model record.

Reference rigQuantizationMedian resultBasisTTFT (ms)Peak VRAMMax contextEngines
Arc Pro B60 24GB4-bit76 tok/sreported265- GB2,048llama.cpp
Arc Pro B70 32GB4-bit100.5 tok/sreported184- GB2,048llama.cpp
AMD Ryzen 7 7840HS4-bit22.3 tok/sreported-- GB512llama.cpp
RX 570 4GB ×24-bit54.9 tok/smeasured78- GB2,048llama.cpp

Context tested

The table above is the tested context for each exact rig and quantization cell. Empty fields remain empty rather than being filled with an estimate.