community pool / model answer

Gemopus-4-26B-A4B-it-GGUF

chat · Jackrong/Gemopus-4-26B-A4B-it-GGUF

94.5 tok/s · model median · 1 runs in the model record.

Reference rigQuantizationMedian resultBasisTTFT (ms)Peak VRAMMax contextEngines
Radeon RX 7900 XTX 24GB4-bit94.5 tok/sreported-15.6 GB640llama.cpp

Context tested

The table above is the tested context for each exact rig and quantization cell. Empty fields remain empty rather than being filled with an estimate.