Can a 24GB Mac Run Qwen3.8 Flash Next? (2026): Yes, via SSD
Yes, but not from memory. The smallest Qwen3.8 Flash Next file is about 62 GiB, so a 24GB Mac streams the experts from its SSD. MoEShift does that at about 10 tok/s on a 24GB M4 Pro Mac mini, with under 10 GB of peak memory. Ollama cannot run it on 24GB.
Bottom Line
- Yes, a 24GB Mac runs Qwen3.8 Flash Next, but from the SSD, not from memory. The smallest file is about 62 GiB. An SSD-streaming runtime reads the experts from disk as each token needs them.
- Measured: 10.44 tok/s decode at 6.4 GB peak memory with MoEShift on a 24GB Mac mini M4 Pro (IQ3_XXS, 8K context, the author’s own table). Strata on the same Mac: 8.4 tok/s at 14 GB.
- On a 24GB M5 Pro, the author reports 14.69 tok/s and 374 tok/s prefill, with the same 8.5GB of peak memory as the M4 Pro.
- Ollama cannot run it on 24GB. Its smallest Qwen3.8 Flash Next tag is 105GB.
- You need 120 GB of free SSD space. That matters more on a 24GB Mac than the 24GB does.
| Question | Answer (sources read 9 Nov 2026) |
|---|---|
| Runtime | MoEShift v0.1.0-alpha.3 (alpha, Apple silicon only) or Strata (Windows, Linux, Mac) |
| File | ISTA-DASLab GSQ-RCO IQ3_XXS, 70.6 GiB |
| Speed, M4 Pro 24GB | 10.44 tok/s short prompt, 9.9 tok/s after a 6,009-token prompt |
| Speed, M5 Pro 24GB | 14.69 tok/s short prompt (author’s HN post) |
| Peak memory | 6.4-8.5 GB process footprint |
| Free disk | 120 GB or more |
| Mac to buy now | Mac mini M5 Pro 24GB/512GB, from $1,699 (apple.com, Nov 2026) |
Choosing a Mac? See the tested hardware list with current prices.
Why 24GB Is Enough: Only the Active Experts Matter
Qwen3.8 Flash Next is a mixture-of-experts model. Qwen’s model card lists 125B parameters with 6B activated, plus a 51B n-gram embedding and a 4B MTP module. It has 512 experts, and each token uses 10 routed experts plus 1 shared expert across 48 layers.
So each token touches a small part of the file. An SSD-streaming runtime keeps the attention weights and a cache of recent experts in memory. It reads the other experts from the SSD when the router picks them. That is why the peak memory is under 10 GB while the file is about 70 GiB.
The cost is speed. Every expert miss is an SSD read, so the SSD sets the speed, not the GPU and not the 24GB.
The files (byte counts from the Hugging Face API, read 2026-11-09):
| File | Bytes | GiB |
|---|---|---|
| ISTA-DASLab GSQ-RCO Q2_0 | 66,423,878,624 | 61.9 |
| ISTA-DASLab GSQ-RCO IQ3_XXS (MoEShift’s test file) | 75,839,998,528 | 70.6 |
| ISTA-DASLab GSQ-RCO IQ3_S | 83,617,662,656 | 77.9 |
| Unsloth UD-IQ1_S (smallest Unsloth file) | 66,379,180,698 | 61.8 |
| Unsloth UD-Q4_K_XL | 111,334,654,778 | 103.7 |
| Ollama library, smallest tag (MLX / NVFP4) | 105GB (Ollama’s figure) | n/a |
Measured Speed on 24GB Macs
MoEShift vs Strata on a 24GB Mac mini M4 Pro. From the MoEShift README: IQ3_XXS, 8,192 context, 256 output tokens, Strata 0.2.7. Peak memory is the macOS footprint -p figure. These are the MoEShift author’s numbers.
| Test | MoEShift | Strata 0.2.7 |
|---|---|---|
| Short prompt (66 tokens), decode | 10.44 tok/s | 8.4 tok/s |
| Short prompt, peak memory | 6.4 GB | 14 GB |
| Long prompt (6,009 tokens), prefill | 160.8 tok/s | 61.8 tok/s |
| Long prompt, decode | 9.9 tok/s | 7.8 tok/s |
| Long prompt, peak memory | 7.5 GB | 14 GB |
| Long prompt, total time | 63.3 s | 129.9 s |
M4 Pro vs M5 Pro, both 24GB. From the author’s Hacker News post of 2026-11-09:
| Test | M4 Pro 24GB | M5 Pro 24GB | Change |
|---|---|---|---|
| Short prompt decode | 9.84 tok/s | 14.69 tok/s | +49% |
| Long prompt prefill (6,060 tokens) | 199 tok/s | 374 tok/s | +88% |
| Long prompt decode | 9.57 tok/s | 13.14 tok/s | +37% |
| Long prompt total time | 83.9 s | 55.1 s | -34% |
| Peak process memory | 8.5 GB | 8.5 GB | same |
A community run on a 32GB Mac mini M6 (MoEShift issue #1, 2026-10-30): 11.58 tok/s short-prompt decode, 216.6 tok/s prefill and 10.35 tok/s decode on a 6,060-token prompt, about 9.4 GB peak.
Two cautions. Both Mac tables come from the MoEShift author, and only one outside user has posted a run. The README headline says “up to 11 tokens per second”, but its own M4 Pro table peaks at 10.44.
The Thing to Check Before You Buy: the SSD, Not the RAM
The memory use was the same on both Macs. The speed was not. Peak memory was 8.5 GB on the M4 Pro and on the M5 Pro. The author credits the M5 Pro’s gain to “the higher SSD throughput of the M5 Pro”. Apple does not publish SSD speeds on its Mac mini or MacBook Pro spec pages, so that cause is his claim, not a spec. The memory bandwidth also differs: Apple lists 307 GB/s for the M5 Pro.
What it means for a buyer:
- More RAM is not what the test changed. The runtime fits in under 10 GB. Our inference: extra RAM helps only if the expert cache grows to use it, and nobody has published that test on a Mac.
- Keep the model on the internal SSD. An external drive adds a slower link to every expert miss. We have no measured number for that; test it before you rely on it.
- Plan the disk. MoEShift asks for 120 GB free. The IQ3_XXS file alone is 70.6 GiB. The base Mac mini M5 Pro has a 512GB SSD.
How to Run It
MoEShift installs through Homebrew and runs a setup wizard. It serves an OpenAI-compatible API on port 8080.
brew install davide-troiani/moeshift/moeshift moeshift # setup wizard: downloads the model and starts the server # API: http://127.0.0.1:8080/v1
MoEShift is an alpha release (v0.1.0-alpha.3, 2026-11-04), and its release notes say “Validated on M4 Pro.” It needs Apple silicon and at least 10 GB of RAM. For a more mature tool, use Strata (v0.2.13 released 2026-11-09). It supports Apple silicon M1 or newer, and our Strata hardware guide covers its memory modes.
Find your own number. Run the same prompt three times and take the median. The first run reads cold experts from the SSD and is slower. Numbers from other Macs do not transfer to yours, because the SSD differs by model and by capacity.
Which 24GB Mac, and When to Buy More
Apple sells two Mac mini chips with a 24GB option as of November 2026 (apple.com):
| Mac mini | 24GB config | Memory bandwidth (Apple) | Price |
|---|---|---|---|
| M5 Pro, 15-core CPU / 16-core GPU | 24GB / 512GB | 307 GB/s | From $1,699 |
| M6, 12-core CPU / 12-core GPU | 24GB / 512GB | 170 GB/s | Check apple.com (the base $899 model is 16GB) |
The M4 Pro in the tests above is no longer sold as a Mac mini. The M5 Pro 24GB is the closest Mac mini you can buy now, and it is the one with the published 14.69 tok/s. For a laptop, Apple lists the 14” MacBook Pro M5 Pro 24GB/1TB from $2,499.
Buy more memory if you want the model in RAM. Our Strata guide read Strata’s docs as the experts plus about 10GB of RAM: about 44GB for Q2_0 and 53GB for IQ3_XXS. A MacBook Pro M5 Pro 48GB holds Q2_0 in memory; 64GB holds IQ3_XXS. On Mac mini, Apple offers 48GB and 64GB only with the M5 Pro; check apple.com for the current price of those configurations. The 24GB route is the cheapest way in. The 64GB route removes the SSD from the speed path.
Caveats
- Every Mac speed on this page comes from the MoEShift author or one community run. No independent review exists yet.
- SSD streaming reads a lot of data from the drive on every prompt. We found no published data on its effect on a Mac’s SSD.
- A 24GB Mac also runs smaller models fully in memory and much faster. If you do not need a 125B model, see best local LLM for Mac mini.
Sources
- MoEShift README, releases and issue #1 (repo created 2026-10-21; v0.1.0-alpha.3 2026-11-04), read 2026-11-09
- Hacker News 50432586, “M4 Pro vs. M5 Pro (24GB): Qwen 3.8 Flash Next at 374 Tok/S Prefill with MoEShift”, 2026-11-09, read via the HN API
- Ollama v0.40.16 release notes (2026-11-09) and the qwen3.8-flash-next tags page, read 2026-11-09
- Qwen/Qwen3.8-Flash-Next model card, read 2026-11-09
- Hugging Face API file trees:
ISTA-DASLab/Qwen3.8-Flash-Next-GSQ-RCO-GGUF,unsloth/Qwen3.8-Flash-Next-GGUF, read 2026-11-09 - Strata repo and releases (v0.2.13, 2026-11-09), read 2026-11-09
- apple.com Mac mini and MacBook Pro store and specs pages (configurations, prices, memory bandwidth), read 2026-11-09
See Also
- Best hardware for Strata: RAM per expert pack, and the PC side of SSD streaming
- Can I run Qwen3.8 Flash Next locally?: the 128GB route, with the model in memory
- Qwen3.8 Flash Next 2-bit: the 64GB and 96GB routes
- Best local LLM for Mac mini: models that fit a Mac mini fully in memory
- Which Mac mini to buy for local LLM: the M6 vs M5 Pro choice
- Can you run a 160GB MoE on 8GB VRAM?: the same SSD-streaming idea on a PC