community pool / model answer

reka-flash-3

chat · RekaAI/reka-flash-3

23.1 tok/s · model median · 23 runs in the model record.

Reference rigQuantizationMedian resultBasisTTFT (ms)Peak VRAMMax contextEngines
RTX 3060 12GB ×24-bit22.3 tok/smeasured4,80218.5 GB131,072llama.cpp
RTX 3090 24GB4-bit32.3 tok/smeasured3,950- GB131,072llama.cpp

Context tested

The table above is the tested context for each exact rig and quantization cell. Empty fields remain empty rather than being filled with an estimate.