Expert guides on VRAM requirements, GPU benchmarks, LLM hardware, and local AI inference.
Can You Run Qwen 3.8 Flash Next NVFP4 on One Machine? Yes, on a single DGX Spark, and the reason is the most useful thing on this page: you never load two fifths of it. NVIDIA’s own build is 132.68 GB of weights, which is 123.57 GiB. A Spark has a 128 GB unified pool … Read more
What Does Mixed Precision Quantization Do to the Gigabytes? It moves the big tolerant part of the model down to 4 bits and leaves the small fragile part alone, and on a Mixture of Experts model that is most of the weight for almost none of the damage. GLM-5.3-Flash goes from 328 GB as Z.ai … Read more
Which GGUF Quant Should You Download? Take the largest four-bit build that leaves room for your context. On Qwen 3.8 27B that is roughly 14 to 19 GB to download depending on who built it, and every campaign that measured a real task this month agrees it performs like the full-precision model. Below that the … Read more
How Much VRAM Does GLM 5.3 Need? The short answer, now that the weights are public: 258 GB at 2-bit, 473 GB at 4-bit, and 1.51 TB if you want the model as the lab trained it. Z.ai released GLM 5.3 in late August 2026 (Artificial Analysis dated the API evaluation to August 18, the … Read more
Two numbers sit on this page and they are not the same kind of number. The estimator gives you a bandwidth ceiling for one card and one model, derived from arithmetic you can check. The table under it holds measured LLM tokens per second figures other people published on real hardware, each one attributed to … Read more
GLM 5.3 Flash VRAM Requirements: The Short Answer Running Z.ai’s newest frontier MoE takes 191 GiB at Q4_K_M, 141 GiB at Q3_K_M, and still 104 GiB at the bottom of the quant ladder. No gaming card on the market holds any of those numbers. Most measured runs are on two DGX Sparks, some of them … Read more
Qwen3.8 Flash Next VRAM: 180B Total, 6B Active Qwen shipped the architecture that Qwen4 will be built on, and it breaks the way you are used to sizing a model. The card says: 125B parameters with 6B activated, plus 51B of n-gram embedding and 4B of MTP. That adds to 180B, and Hugging Face's own … Read more
M5 Ultra Mac Studio: What 512 GB at 1.2 TB/s Runs Apple announced the M5 Ultra Mac Studio and the M6 Mac mini today, with pre-orders open now and machines arriving 22 September. For local models the number that matters is not the 512 GB. It is the 1.2 TB/s. Here is why, and it … Read more
Qwen3.8 27B MoE: A Real One Exists Now Somebody carved a mixture of experts out of dense Qwen3.8 27B without training a new model. It is called Whittle MoE 27B-A17.8B, it is Apache 2.0, the GGUFs are already published, and it runs on a 24 GB card quantized. The headline everyone is repeating is “17.8B … Read more
FreeToken VRAM Requirements, and Why VRAM Is the Wrong Number Less than you think, and that is the wrong question. FreeToken runs a 35B model on an 8 GB laptop GPU, a 284B model on a 32 GB desktop card and GLM-5.2 at 753B on a single 96 GB workstation GPU. The number that decides … Read more
