community pool / model answer

Ornith-1.5-35B-A3B-GGUF

chat · bartowski/Ornith-1.5-35B-A3B-GGUF

32.2 tok/s · model median · 1 runs in the model record.

Reference rigQuantizationMedian resultBasisTTFT (ms)Peak VRAMMax contextEngines
M1 Pro 32GB4-bit32.2 tok/sreported96- GB2,048ollama

Context tested

The table above is the tested context for each exact rig and quantization cell. Empty fields remain empty rather than being filled with an estimate.