community-verified · measured pool data
Can the RTX PRO 6000 Blackwell 96GB ×4 run GLM-5.2-NVFP4-REAP-504B-term?
Yes — community-measured at 86.8 tok/s (3 runs at 4-bit).
Verified single-stream runs on the RTX PRO 6000 Blackwell 96GB ×4 from the localmaxxing public pool. Every number on this page is measured — nothing here is estimated.
| Quantization | Median tok/s | TTFT (ms) | Peak VRAM | Max context tested | Engines |
|---|---|---|---|---|---|
| 4-bit | 86.8 | 356.7 | 93.4 GB | 1,000,000 | vllm |