community pool / model answer

Qwen3.8-Flash-Next-GGUF

chat · unsloth/Qwen3.8-Flash-Next-GGUF

44.3 tok/s · model median · 12 runs in the model record.

Reference rigQuantizationMedian resultBasisTTFT (ms)Peak VRAMMax contextEngines
CMP 170HX 64GB1-bit44.6 tok/smeasured32142.1 GB65,536llama.cpp
Radeon AI Pro R9700 32GB4-bit25.6 tok/sreported4,74732.9 GB32,768llama.cpp
RTX 3090 24GB ×23-bit41.6 tok/sreported6,50543.6 GB217,088llama.cpp
Ryzen AI Max 395 128GB4-bit74 tok/smeasured2,31267.4 GB32,768llama.cpp

Context tested

The table above is the tested context for each exact rig and quantization cell. Empty fields remain empty rather than being filled with an estimate.