community pool / model answer

Qwopus-MoE-35B-A3B

chat · samuelcardillo/Qwopus-MoE-35B-A3B

72.4 tok/s · model median · 10 runs in the model record.

Reference rigQuantizationMedian resultBasisTTFT (ms)Peak VRAMMax contextEngines
Ryzen AI Max 395 128GB4-bit72.5 tok/smeasured-23.2 GB128,000llama.cpp
Ryzen AI Max 395 128GB8-bit53.1 tok/smeasured-37.1 GB80,000llama.cpp

Context tested

The table above is the tested context for each exact rig and quantization cell. Empty fields remain empty rather than being filled with an estimate.