bestmodel.run / model — Llama-3.1-Nemotron-70B-Instruct-HF (agent view)

category chat · nvidia/Llama-3.1-Nemotron-70B-Instruct-HF · 2 runs in the model record
answer: 5.2 tok/s (model median)

Honesty ladder: measured > reported > extrapolated > formula > no data yet.
Empty fields stay empty — never filled with an estimate.

  rig | quant | median result | basis | ttft | peak vram | max context
  Ryzen AI Max 395 128GB             | 4-bit | 5.2 tok/s      | reported | ttft -ms | vram - GB | ctx 16,384