community pool / model answer

Huihui-DeepSeek-V4-Flash-abliterated-ds4-GGUF

chat · huihui-ai/Huihui-DeepSeek-V4-Flash-abliterated-ds4-GGUF

12.1 tok/s · model median · 1 runs in the model record.

Reference rigQuantizationMedian resultBasisTTFT (ms)Peak VRAMMax contextEngines
M5 Max 128GB2-bit12.1 tok/sreported151- GB4,096llama.cpp

Context tested

The table above is the tested context for each exact rig and quantization cell. Empty fields remain empty rather than being filled with an estimate.