← All guides

Server ECC RDIMM vs DDR5 (2026): 4x Cheaper per GB

If you want 256GB or more of RAM to run a large MoE model on CPU, desktop DDR5 is the wrong aisle. Registered DDR4 ECC server memory costs about a quarter as much per gigabyte. The catch is that a 4x discount on a market that has itself risen 60-80% is not the same thing as cheap.

Planning a big-RAM inference box?

See our AI training options. We'll check your channel population and confirm the model actually uses the bandwidth you paid for, free.

🎮 THE DDR4 SERVER PATH

RDIMM needs a server board. These two parts go together — the memory is useless without the platform, and the platform is what gives you the eight channels.

Bottom Line

  • DDR4 ECC RDIMM: $9.14/GB median. Range $4.53 to $14.34/GB. Cheapest listing is an A-Tech 16GB DDR4-2133 module at $4.53/GB.
  • DDR5 ECC RDIMM: $38.48/GB median. Range $29.56 to $46.49/GB. That is a 4.2x gap.
  • 512GB costs roughly $4,680 in DDR4 at the median, or about $19,700 in DDR5. For capacity-bound CPU inference, this is not a close decision.
  • The honest catch: DDR4 is not cheap, it is only cheaper. It has risen 60-80% since early 2025. A 4x discount on an inflated market still costs thousands.
  • RDIMM does not fit a desktop board. You are buying a server platform too. Budget for it.
  • Buy channels, not speed. Eight populated channels beat four fast modules for inference throughput.

All prices read from the DatacenterDisk live tracker on 2026-09-07. That tracker refreshes every four to five hours and the DDR5 median moved 3.9% in the week before we read it. Treat any figure here as a snapshot, not a quote.

Ready to buy? See the tested hardware list with current prices.

Why This Question Exists At All

Large mixture-of-experts models changed the arithmetic of local inference. A model with 400B total parameters but 20B active per token does not need 400GB of fast VRAM. It needs 400GB of some memory and enough bandwidth to stream the active experts.

That reframes the build. Instead of chasing an impossible stack of GPUs, you buy a lot of ordinary system RAM and run on CPU. We walked through that argument in EPYC server CPUs for MoE inference.

The moment you accept that framing, one question dominates the budget: what is the cheapest way to buy 256GB or more of RAM?

The Gap, Measured

DDR4 ECC RDIMMDDR5 ECC RDIMM
Median$9.14/GB$38.48/GB
Cheapest listing$4.53/GB (16GB DDR4-2133)$29.56/GB (16GB DDR5-4800)
Range$4.53 – $14.34/GB$29.56 – $46.49/GB
Risen since early 202560-80%100-116%

Read 2026-09-07 from the DatacenterDisk live tracker.

The ratio at the median is 4.2x. At the cheapest-listing end it is 6.5x, because the DDR4 market has a long tail of old slow modules and DDR5 does not yet.

What that buys you, at 2026-09-07 prices:

CapacityDDR4 at medianDDR4 at cheapestDDR5 at median
128GB~$1,170~$580~$4,925
256GB~$2,340~$1,160~$9,850
512GB~$4,680~$2,319~$19,700

For a build whose entire purpose is holding a large model in memory, that table ends the argument. You go DDR4.

The Three Things That Discount Costs You

Most pages stop at the ratio. The ratio is the easy half.

1. RDIMM will not go in your desktop

Registered DIMMs have a register between the memory controller and the DRAM chips. It is what lets a board address this much memory at all, and it is why a consumer AM5 or LGA1700 motherboard physically will not run them.

So the real comparison is not “DDR4 RDIMM versus DDR5 UDIMM”. It is “a used server platform plus DDR4 RDIMM” versus “a desktop plus DDR5 UDIMM”. Add the board and the CPU before you compare.

For single-socket SP3 EPYC builds we point at the ASRock Rack ROMED8-2T, because it gives eight DDR4 channels, which is the specification the whole MoE argument rests on.

2. Cheap DDR4 is cheap because it is slow

That $4.53/GB listing is DDR4-2133. It is the oldest speed grade in the tracker, and that is exactly why it is at the bottom of the range.

Once the model fits in memory, bandwidth sets your tokens per second, not capacity. A build that fills all eight channels with DDR4-3200 will generate meaningfully faster than the same capacity in four channels of anything.

The practical rule: buy the number of modules that fills every channel on your board first, then optimise speed grade with whatever budget is left. Eight slow modules beat four fast ones.

3. “Four times cheaper” is not “cheap”

This is the sentence the buying guides skip.

DDR4 server memory has risen 60-80% since early 2025. DDR5 rose 100-116%. Both markets are casualties of the same thing: wafer capacity reallocated toward HBM for AI accelerators, which is the memory that goes into the datacenter GPUs everyone is buying.

So DDR4’s advantage is real but it is a discount on a market that already moved against you. 512GB at $4,680 is the cheap option in 2026. Two years ago the same capacity cost a fraction of that. If you are comparing against a price you remember, you will be unpleasantly surprised — the same trap we documented for consumer memory in should I buy RAM now?.

When DDR5 Is Still Right

Three cases, and none of them is “it is newer”.

  • You already own the platform. If you have a current-generation server board, the RDIMM type is decided for you.
  • Your capacity target is small. At 64GB or 128GB the absolute gap is a few thousand dollars rather than fifteen, and DDR5’s per-channel bandwidth advantage starts to matter more than the price.
  • The box is not only for inference. If it runs databases or builds as well, buying current-generation hardware you can keep for six years is a defensible call.

For a machine bought specifically to hold a large MoE model, none of these apply.

What We Would Actually Build

If capacity is the goal and the budget is real: a single-socket SP3 EPYC board with all eight DDR4 channels populated, using 32GB or 64GB registered ECC modules rather than the cheapest 16GB ones. That lands 256GB to 512GB somewhere between $2,300 and $4,700 in memory, on a platform that costs a fraction of a current-generation equivalent.

Then check the bandwidth you actually got before you tune anything else. Half the disappointing CPU-inference builds we see are correctly sized and wrongly populated — the RAM is all there, sitting on two channels.

See Also

Need OpenClaw fixed live?

Remote rescue sessions for gateway, auth, tunnel, VPS, and model access problems.

See Rescue Session

Read next

Used EPYC Servers for CPU-Only MoE Inference in 2026
Can a used 8-channel EPYC server run a 400GB MoE model on CPU alone? Yes, at 4-6 tokens per second. Here are the measured numbers, the real 2026 cost of used DDR4, and why the cheap-RAM premise is weaker than it looks.
Best Models for the Biggest Mac Studio: 96GB New, 256GB Used
Apple pulled the 512GB M3 Ultra in March 2026 and the 256GB in May, then reversed it on August 25 with the M5 Ultra — 256GB is orderable again at $9,499, and the used M3 Ultra is now the value play. Best models for each tier: gpt-oss 120B (23-60 tok/s), Qwen3-VL 235B Q4 (~30 tok/s), GLM-4.7 358B Q3 (~15 tok/s), Llama 4 Maverick, and why DeepSeek V4 Flash finally runs local.
Best Local LLM for Mac Studio M5 Ultra (2026): 256GB
Apple announced the M5 Ultra Mac Studio on August 25, 2026 with 1.2TB/s bandwidth and a 256GB option — the first new 256GB Mac since Apple pulled the tier in May. What fits, projected tok/s, the $4,000 memory tax, and why you should wait for real benchmarks.
DGX Spark vs Mac Studio M3 Ultra for Local LLMs
Compare NVIDIA DGX Spark and Mac Studio M3 Ultra for local LLMs: 273 vs 819 GB/s bandwidth, prefill vs decode speed, 512GB memory, and 2026 pricing.