bestmodel.run / model — NVIDIA-Nemotron-3.5-Lightning-30B-A3B-GGUF (agent view)

category chat · ggml-org/NVIDIA-Nemotron-3.5-Lightning-30B-A3B-GGUF · 100 runs in the model record
answer: 128.9 tok/s (model median)

Honesty ladder: measured > reported > extrapolated > formula > no data yet.
Empty fields stay empty — never filled with an estimate.

  rig | quant | median result | basis | ttft | peak vram | max context
  CMP 170HX 64GB                     | 8-bit | 138.7 tok/s    | measured | ttft 8,362ms | vram - GB | ctx 67,592
  RTX 3090 24GB                      | 4-bit | 353.7 tok/s    | reported | ttft 262ms | vram 21.4 GB | ctx 8,192
  RX 7900 XT 20GB ×2                 | 4-bit | 115.6 tok/s    | measured | ttft 73ms | vram - GB | ctx 2,048