community-verified · measured pool data

Can the RTX 4070 12GB run Qwopus3.6-35B-A3B-Coder-MTP-GGUF?

Yes — community-measured at 35.4 tok/s (6 runs at 4-bit).

Verified single-stream runs on the RTX 4070 12GB from the localmaxxing public pool. Every number on this page is measured — nothing here is estimated.

Quantization Median tok/s TTFT (ms) Peak VRAM Max context tested Engines
4-bit 35.4 43726 2,048 llama.cpp
Go deeper
I have a goal — find models that fit my use case → I have hardware — browse everything my rig can run → All machine × model answer pages →