bestmodel.run / model — granite-4.0-h-micro (agent view)

category chat · ibm-granite/granite-4.0-h-micro · 11 runs in the model record
answer: 45 tok/s (model median)

Honesty ladder: measured > reported > extrapolated > formula > no data yet.
Empty fields stay empty — never filled with an estimate.

  rig | quant | median result | basis | ttft | peak vram | max context
  GTX 1060 3GB                       | 4-bit | 45.2 tok/s     | measured | ttft 3,058ms | vram 2.5 GB | ctx 2,048
  RX 570 4GB                         | 4-bit | 7.9 tok/s      | reported | ttft 589ms | vram - GB | ctx 2,048
  RX 570 4GB ×2                      | 4-bit | 34.8 tok/s     | measured | ttft 293ms | vram - GB | ctx 2,048