community pool / model answer

Qwen3.5-0.8B-GGUF

chat · unsloth/Qwen3.5-0.8B-GGUF

143.8 tok/s · model median · 4 runs in the model record.

Reference rig	Quantization	Median result	Basis	TTFT (ms)	Peak VRAM	Max context	Engines
RTX 3060 12GB	16-bit	143.3 tok/s	reported	590	3.3 GB	4,608	llama.cpp
Tesla P100 32GB ×2	4-bit	209.4 tok/s	reported	109	1.3 GB	2,048	llama.cpp
Tesla P100-PCIE-16GB 16GB	5-bit	136.5 tok/s	reported	-	- GB	2,048	llama.cpp
Tesla P100-PCIE-16GB 16GB ×2	5-bit	144.3 tok/s	reported	-	- GB	2,048	llama.cpp

Context tested

The table above is the tested context for each exact rig and quantization cell. Empty fields remain empty rather than being filled with an estimate.