Run Models Optimally On Your Local NVIDIA AI System
RTX Spark
GB
12 models available on this hardware at 128 GB.
Recipe details
- Execution
- Native
- Backend version
- b11901
- Backend min version
- b11370
- Peak GPU Memory
- 78 GB
- Draft model
- hf: mtp-Qwen3.8-Flash-Next-Q8_0.gguf
- Speculative Decoding
- MTP
- Concurrency
- 1
- Served model
unsloth/Qwen3.8-Flash-Next-GGUF- Port
- 9931
- Notes
- Target: four-shard UD-IQ4_XS at revision 084c631ac221016019d6e0a863afe92d90edd3b0. MTP head: mtp-Qwen3.8-Flash-Next-Q8_0.gguf. Projector: mmproj-BF16.gguf. Performance shown was measured on the earlier three-shard upload (revision 38bb39ee97821de2c9009abb7e93950eec396e66); this four-shard target has not been benchmarked or revalidated yet.
- Recipe ID
qwen/qwen3.8-flash-next/rtx-spark/windows/llama-cpp/78gb/iq4-xs/vision-mtp