← All guides

Is the NVIDIA DGX Spark Worth $4,699 for Local AI? (August 2026)

The DGX Spark is the most argued-about box in local AI. It packs a GB10 Grace Blackwell chip and 128GB of unified memory into something that sits on a desk — and its 273 GB/s of memory bandwidth is a sixth of an RTX 5090's. Whether it is worth $4,699 depends entirely on which of three buyers you are, and most people asking are the wrong one.

Bottom Line

  • Price: $4,699 as of August 2026 — NVIDIA added an official $700 in February, blaming memory supply. The ASUS Ascent GX10 (same GB10 chip) now undercuts it at $3,999/1TB.
  • Speed: stack-dependent to a degree nobody expects: gpt-oss 120B decode ran ~11.7 tok/s on Ollama, ~38.5 on tuned llama.cpp, ~50 on SGLang — same box, ~4x spread.
  • The real product: CUDA parity with your deployment target, on a desk. Not tokens per second.
  • Verdict: worth it for NVIDIA-stack developers. Not worth it as a pure inference box — a ~$2,000-2,400 Ryzen AI Max+ 395 machine does that job at half the price.

What $4,699 actually buys

GB10 Grace Blackwell, 128GB unified memory, ConnectX networking for pairing two units, and the full NVIDIA software stack in a quiet desktop box. The price history matters: it launched at $3,999, and in February 2026 NVIDIA raised it to $4,699 in an official notice citing memory supply constraints — the same shortage that reset RAM and GPU prices everywhere.

The spec that defines it is 273 GB/s of memory bandwidth. An RTX 5090 moves ~1,792 GB/s — about 6.5x more. Token generation is bandwidth-bound, so no amount of Blackwell compute makes single-stream chat fast on this box. That is not a flaw discovered by reviewers; it is the design tradeoff: capacity and ecosystem over bandwidth.

The benchmark chaos, explained

The Spark’s launch reviews disagreed with each other by 4x, and both sides were measuring honestly:

Stackgpt-oss 120B decodeSource
Ollama~11.7 tok/scommunity review benchmarks
llama.cpp (tuned)~38.5 tok/sposted by the llama.cpp author
SGLang~50 tok/sNVIDIA developer forum testing

Two lessons. First, on this machine the software stack is worth more than 3x the hardware delta between it and its rivals — if you buy one, do not run Ollama defaults and conclude you were robbed. Second, all three numbers obey the same ceiling: gpt-oss 120B is MoE with a small active set, which is why it moves at all. A dense 70B reading ~40GB per token caps in single digits — if dense 70B is your goal, that money buys a much better rig.

The three buyers it is right for

  1. The deploy-to-NVIDIA developer. You prototype locally, ship to A100/H100/Blackwell in production, and need identical CUDA/TensorRT behavior. The Spark is the only 128GB desk box that gives you that. This is its honest, load-bearing use case.
  2. The DGX/NIM ecosystem team. Desk-side node, same containers, same tooling as the fleet.
  3. The two-Spark buyer. NVIDIA’s 200B-class and 1M-context configurations pair two units over ConnectX. Niche, real, and nothing else at this price does it.

If you are none of these, you are buying a badge.

What to buy instead

Same chip, less money: the ASUS Ascent GX10 — the same GB10 with 128GB — lists at $3,999 (1TB) as of August 2026, making it the cheapest way into this exact platform. The Spark’s extras (2TB, branding, ConnectX topology details) are worth checking against a $700 gap.

Same job, half the money: a 128GB Ryzen AI Max+ 395 box (~$2,000-2,400 street, volatile) is bandwidth-limited to the same order and runs the same MoE models at broadly comparable speeds — our model picks for it show gpt-oss 120B at 31-55 tok/s. No CUDA. If your stack is llama.cpp/Ollama anyway, that is $2,300-2,700 saved.

More speed, less capacity: if your models fit in 24-48GB, a used-GPU build demolishes every unified-memory box on generation speed.

The three boxes from this page:

Amazon affiliate links — we earn a small commission at no cost to you.

Sources

See Also

Need OpenClaw fixed live?

Remote rescue sessions for gateway, auth, tunnel, VPS, and model access problems.

See Rescue Session

Read next

Two Used RTX 3090s or One RTX 5090? 48GB Slow vs 32GB Fast (August 2026)
Dual used RTX 3090s cost $2,000-2,600 for 48GB of VRAM. One RTX 5090 costs $4,300-5,000 for 32GB. The 2026 price spike flipped this comparison: the dual build is now half the price AND holds a 70B. Here is the honest tradeoff, including the 700W problem.
Best Models to Run on AMD Ryzen AI Max+ 395 Boxes (August 2026)
Best local LLMs for AMD Ryzen AI Max+ 395 (Strix Halo) 128GB mini-PCs in August 2026. Qwen3-30B-A3B at ~100 tok/s, gpt-oss 120B at 31-55 tok/s, Llama 4 Scout at ~18 tok/s, dense 70B at ~5 tok/s. Framework Desktop, GMKtec EVO-X2, HP Z2 Mini G1a compared against DGX Spark and Mac Studio — with August 2026 prices, which the memory shortage has moved a long way.
Best Models to Run on the ASUS Ascent GX10 (August 2026)
Best local LLMs for the ASUS Ascent GX10 in August 2026. Same GB10 chip as DGX Spark, 128GB unified memory at 273 GB/s, from $3,999 as of August 2026 (up from a $2,999 launch). Qwen 3.6 35B-A3B NVFP4 hits 91.5 tok/s single-stream on a real GX10; 707 tok/s aggregate at 64 concurrent.
Best Models to Run on NVIDIA DGX Spark (August 2026): 1, 2, 3 & 4-Spark Setups
Best local LLMs for the NVIDIA DGX Spark in August 2026, by cluster size. 1 Spark: Qwen 3.6 35B NVFP4 (106 tok/s) or DeepSeek V4 Flash. 2 Sparks: DeepSeek V4 Flash DSpark at 1M context. 3 Sparks: GLM-5.2 with vision. 4 Sparks: unpruned GLM-5.2 744B at 1M context.