community pool / model answer

MiniMax-M2.7-AWQ-4bit

chat · cyankiwi/MiniMax-M2.7-AWQ-4bit

27.3 tok/s · model median · 4 runs in the model record.

Reference rigQuantizationMedian resultBasisTTFT (ms)Peak VRAMMax contextEngines
GB10 Grace Blackwell 128GB4-bit27 tok/smeasured132- GB196,608vllm

Context tested

The table above is the tested context for each exact rig and quantization cell. Empty fields remain empty rather than being filled with an estimate.