PersonalComputer
Guides

How Much RAM for Local AI and LLMs (Is 128GB RAM Worth It?)

How much system RAM you need to run LLMs locally, and when 128GB RAM makes sense: with a GPU, on CPU only, or on unified-memory machines.

Last updated21 Oct 2026
Fact-checked21 Oct 2026
Sources cited9
StandardsEditorial policy →

With a discrete GPU, system RAM matters in two ways: model files load through it, and any layers that do not fit in VRAM run from it (slowly). Without a GPU, or on unified-memory machines, RAM holds the whole model.

Estimated memory by model

ModelParams (total / active)Est. memory, Q4 @ 8k ctxEst. memory, Q8 @ 8k ctxCheapest fit in our data (Q4)
Llama 3.1 8B8.03B / 8.03B7.0 GB10.6 GBGeForce RTX 5060 ($299, GPU launch MSRP)
Qwen3 14B14.8B / 14.8B11.5 GB18.2 GBGeForce RTX 5060 Ti 16GB ($429, GPU launch MSRP)
Qwen3 32B32.8B / 32.8B22.5 GB37.3 GBGeForce RTX 3090 ($1,499, GPU launch MSRP)
Qwen3 30B-A3B (MoE)30.5B / 3.3B21.1 GB34.9 GBGeForce RTX 3090 ($1,499, GPU launch MSRP)
Llama 3.3 70B70.6B / 70.6B46.8 GB78.7 GBGMKtec EVO-X2 (128GB / 1TB) ($3,499.99, system, listed price)
gpt-oss-120b (MoE)117B / 5.1B64.7 GB126.8 GBGMKtec EVO-X2 (128GB / 1TB) ($3,499.99, system, listed price)

Parameter counts: Hugging Face: openai/gpt-oss-120b model card; Hugging Face: meta-llama/Llama-3.1-8B; Hugging Face: meta-llama/Llama-3.3-70B-Instruct; Hugging Face: Qwen3 model cards (e.g. Qwen/Qwen3-30B-A3B). Memory figures are our estimates (see methodology), not measurements.

Do you need 128GB RAM?

128 GB matters when the RAM itself holds the model: on unified-memory systems (Ryzen AI Max+ 395, DGX Spark, Mac Studio) it allows 70B dense models at 4-bit or large mixture-of-experts models such as gpt-oss-120b (estimates above). On a desktop with a discrete GPU, 128 GB of system RAM mainly helps with CPU offload, which is much slower. Current 128GB kit prices: see RAM prices.

Rule of thumb: on a GPU system, have system RAM at least equal to the model file size; on CPU-only or unified memory, have the estimated total plus 8–16 GB for the OS and apps. Unified-memory systems:

SystemChipMemoryMemory bandwidthPriceSource
GMKtec EVO-X2 (128GB / 1TB)AMD Ryzen AI Max+ 395128 GB unified256 GB/s (computed: 256-bit × 8000 MT/s)$3,499.99 (maker store, accessed 21 Oct 2026)GMKtec: EVO-X2 product page (128GB + 1TB variant); AMD: Ryzen AI Max+ 395 specifications
NVIDIA DGX Spark (128GB)NVIDIA GB10 Grace Blackwell128 GB unified273 GB/s$4,699 (NVIDIA Founders Edition MSRP from Feb 2026; current marketplace price TBD)
A 64GB configuration is sold through OEM partners.
NVIDIA: DGX Spark product page and specs; NVIDIA Developer Forums: DGX Spark price change announcement (Feb 2026)
Mac mini (M5 Pro, 64GB)Apple M5 Pro64 GB unified307 GB/sTBDApple: Mac mini technical specifications
Check a specific model against your hardware with Can My PC Run It?, or get a parts shortlist from the AI PC Builder.