community pool / model answer

LFM2-24B-A2B-GGUF

chat · LiquidAI/LFM2-24B-A2B-GGUF

393.2 tok/s · model median · 1 runs in the model record.

Reference rigQuantizationMedian resultBasisTTFT (ms)Peak VRAMMax contextEngines
RTX 5090 32GB4-bit393.2 tok/sreported19- GB2,048lmstudio

Context tested

The table above is the tested context for each exact rig and quantization cell. Empty fields remain empty rather than being filled with an estimate.