community pool / model answer

MiniMax-M2.5-NVFP4

chat · lukealonso/MiniMax-M2.5-NVFP4

17.7 tok/s · model median · 1 runs in the model record.

Reference rigQuantizationMedian resultBasisTTFT (ms)Peak VRAMMax contextEngines
GB10 Grace Blackwell 256GB4-bit17.7 tok/sreported42,303- GB196,608vllm

Context tested

The table above is the tested context for each exact rig and quantization cell. Empty fields remain empty rather than being filled with an estimate.