bestmodel.run / model — gemma-4-E4B-it-GGUF (agent view)

category chat · ggml-org/gemma-4-E4B-it-GGUF · 5 runs in the model record
answer: 95.3 tok/s (model median)

Honesty ladder: measured > reported > extrapolated > formula > no data yet.
Empty fields stay empty — never filled with an estimate.

  rig | quant | median result | basis | ttft | peak vram | max context
  RTX A5000 24GB                     | 4-bit | 121 tok/s      | reported | ttft -ms | vram 3.7 GB | ctx 4,096
  RTX A5000 24GB                     | 8-bit | 95.3 tok/s     | reported | ttft -ms | vram 5.6 GB | ctx 4,096
  TECNO POVA 7 Ultra 5G / Mali-G615 MC6 11.23GB | 4-bit | 7.1 tok/s      | reported | ttft -ms | vram - GB | ctx 640