bestmodel.run / model — SmolLM2-135M-Instruct (agent view)

category chat · HuggingFaceTB/SmolLM2-135M-Instruct · 5 runs in the model record
answer: 407.8 tok/s (model median)

Honesty ladder: measured > reported > extrapolated > formula > no data yet.
Empty fields stay empty — never filled with an estimate.

  rig | quant | median result | basis | ttft | peak vram | max context
  AMD Ryzen 7 7840HS                 | 2-bit | 440.2 tok/s    | reported | ttft -ms | vram - GB | ctx 2,048
  AMD Ryzen 7 7840HS                 | 4-bit | 375.4 tok/s    | reported | ttft -ms | vram - GB | ctx 2,048
  AMD Ryzen 7 7840HS                 | 8-bit | 305.4 tok/s    | reported | ttft -ms | vram - GB | ctx 2,048
  AMD Ryzen 7 7840HS                 | 16-bit | 183.5 tok/s    | reported | ttft -ms | vram - GB | ctx 2,048
  RTX 3060 12GB                      | 8-bit | 684.5 tok/s    | reported | ttft 138ms | vram 1.6 GB | ctx 4,608