bestmodel.run / model — DeepSeek-R1-Distill-Qwen-32B-GGUF (agent view)

category chat · bartowski/DeepSeek-R1-Distill-Qwen-32B-GGUF · 12 runs in the model record
answer: 18.1 tok/s (model median)

Honesty ladder: measured > reported > extrapolated > formula > no data yet.
Empty fields stay empty — never filled with an estimate.

  rig | quant | median result | basis | ttft | peak vram | max context
  RTX 3060 12GB ×2                   | 4-bit | 15.4 tok/s     | measured | ttft -ms | vram 2.5 GB | ctx 16,384
  RTX 3090 24GB                      | 4-bit | 22 tok/s       | measured | ttft -ms | vram - GB | ctx 65,536