community pool / model answer

Ornith-1.5-9B-GGUF

chat · ornith-ai/Ornith-1.5-9B-GGUF

73.9 tok/s · model median · 4 runs in the model record.

Reference rig	Quantization	Median result	Basis	TTFT (ms)	Peak VRAM	Max context	Engines
Arc Pro B70 32GB	8-bit	49.6 tok/s	reported	-	- GB	8,192	llama.cpp
RTX 3060 12GB	4-bit	65 tok/s	reported	60	- GB	65,536	llama.cpp
RTX 3080 12GB	5-bit	92 tok/s	reported	762	9.5 GB	262,144	llama.cpp
RTX 3080 12GB	6-bit	82.8 tok/s	reported	800	8.5 GB	131,072	llama.cpp

Context tested

The table above is the tested context for each exact rig and quantization cell. Empty fields remain empty rather than being filled with an estimate.