bestmodel.run / model — Qwen3.5-9B (agent view)

category chat · Qwen/Qwen3.5-9B · 44 runs in the model record
answer: 46.7 tok/s (model median)

Honesty ladder: measured > reported > extrapolated > formula > no data yet.
Empty fields stay empty — never filled with an estimate.

  rig | quant | median result | basis | ttft | peak vram | max context
  Arc Pro B60 24GB                   | 8-bit | 30.4 tok/s     | reported | ttft 366ms | vram - GB | ctx 4,096
  Arc Pro B60 24GB ×2                | 8-bit | 30.4 tok/s     | reported | ttft 367ms | vram - GB | ctx 4,096
  AMD Ryzen 7 8745H w/ Radeon 780M   | 4-bit | 13.9 tok/s     | reported | ttft 1,630ms | vram 4 GB | ctx 32,768
  Intel(R) Core(TM) Ultra 7 155H     | 4-bit | 8.5 tok/s      | reported | ttft -ms | vram - GB | ctx 2,048
  GTX 1080 Ti 11GB                   | 4-bit | 64.9 tok/s     | reported | ttft -ms | vram - GB | ctx 2,048
  GTX 1080 Ti 11GB                   | 5-bit | 34.3 tok/s     | reported | ttft -ms | vram 9 GB | ctx 8,192
  Radeon 8060S Graphics 103GB        | 4-bit | 255.8 tok/s    | reported | ttft 124ms | vram 7.7 GB | ctx 4,096
  Radeon AI Pro R9700 32GB           | 4-bit | 371.8 tok/s    | reported | ttft 63ms | vram 7.7 GB | ctx 4,096
  Radeon AI Pro R9700 57GB           | 4-bit | 15.8 tok/s     | reported | ttft 1,791ms | vram - GB | ctx 2,048
  Radeon RX 5700 XT 8GB              | 4-bit | 61.6 tok/s     | reported | ttft 148ms | vram 7.4 GB | ctx 4,096
  Radeon RX 6950 XT 16GB             | 4-bit | 222 tok/s      | reported | ttft 126ms | vram 7.4 GB | ctx 4,096
  RTX 3060 12GB                      | 3-bit | 43 tok/s       | reported | ttft 1,540ms | vram 6.4 GB | ctx 4,608
  RTX 3060 12GB                      | 4-bit | 51.4 tok/s     | measured | ttft 1,685ms | vram - GB | ctx 131,072
  RTX 3060 Ti 8GB                    | 4-bit | 63.5 tok/s     | reported | ttft 249ms | vram - GB | ctx 2,048
  RTX 3080 Ti 12GB                   | 8-bit | 15.4 tok/s     | reported | ttft 164,150ms | vram - GB | ctx 250,000
  RTX 3090 24GB ×2                   | 8-bit | 71.7 tok/s     | reported | ttft 675ms | vram - GB | ctx 2,048
  RTX 3090 Ti 24GB                   | 4-bit | 119.1 tok/s    | reported | ttft 156ms | vram 8 GB | ctx 8,192
  RTX 5080 16GB                      | 8-bit | 79.6 tok/s     | reported | ttft 82ms | vram - GB | ctx 4,096
  RTX 5090 32GB                      | 6-bit | 170 tok/s      | reported | ttft 46ms | vram - GB | ctx 2,048
  RTX PRO 6000 Blackwell 96GB        | 16-bit | 171.6 tok/s    | reported | ttft 402ms | vram 33.6 GB | ctx 8,192
  RX 7900 XTX 24GB                   | 4-bit | 337 tok/s      | measured | ttft 76ms | vram 7.4 GB | ctx 4,096
  Ryzen AI Max 395 128GB             | 4-bit | 37.2 tok/s     | measured | ttft -ms | vram 6.4 GB | ctx 32,768
  Tenstorrent P150 32GB              | 4-bit | 38.6 tok/s     | reported | ttft 676ms | vram - GB | ctx 2,048
  Ultra 7 155H 32GB                  | 4-bit | 6.5 tok/s      | reported | ttft -ms | vram - GB | ctx 2,048