Altman Wants Your DRAM in Data Centers: Server RAM in 2026

Altman Wants Your DRAM in Data Centers: Server RAM in 2026

Altman Wants Your DRAM in Data Centers: Server RAM in 2026

Short answer (checked 2026-10-31): Sam Altman argues that memory sitting in personal computers is a poor use of a scarce chip, and that it does more work in a data centre where it is shared. The supply side backs the scarcity part: TrendForce expected server DRAM contract prices to rise 13-18% quarter on quarter in 3Q26 and conventional DRAM 10-15% in 4Q26, with server DRAM still undersupplied. For anyone renting servers the useful question is narrower than his: how much of the RAM you already pay for is actually used? Below is our own measurement of it, and what our own cloud plans charge per extra gigabyte.

Source. Altman spoke on the Cheeky Pint podcast hosted by John Collison. Tom's Hardware and others reported the remarks on 2026-10-30, and they were discussed on Hacker News. The quotes below are as those reports print them.

What he said, and what he did not show

Talking about local inference, Altman said that "a lot of people want local inference" and assume that open-weight models running on their own computers will remove the need for memory in data centres. His answer: "From a global allocation perspective, actually, it's quite terrible to have everybody have a bunch of the world's limited supply of DRAM sitting in their own computer and being used 5% of the time." And: "You want maximum utilisation in the cloud if you're trying to deal with this very constrained environment."

Two things are worth separating. The utilisation argument is real, and it is the whole business case of shared hosting: the memory of one physical server is sold to many tenants, so less of it sits idle. The 5% figure, however, is backed by nothing in the interview: no study and no definition of "used". And the speaker runs a company whose models live in data centres, so the conclusion suits his business. Neither point makes the scarcity untrue; both are reasons to measure your own case instead of adopting someone else's number.

The memory squeeze, dated

Date What happened Source
2025-12-03 Micron announced its exit from the Crucial consumer business; consumer shipments end with its fiscal Q2 (February 2026) Micron press release
2026-07-09 Server DRAM contract prices expected +13-18% QoQ in 3Q26; long-term agreements limit increases for some buyers TrendForce
2026-09-30 Conventional DRAM contract prices expected +10-15% QoQ in 4Q26; server DRAM to remain undersupplied TrendForce

The order matters for server buyers. Memory makers are moving output toward data-centre products, yet server DRAM is the part TrendForce still calls undersupplied. Buyers with multi-year contracts are partly shielded; a small company buying modules for a new box, or a provider building one to order, pays close to the current contract price. Memory is not the only constraint: power, water and local permits slow new data centres too, see what 10,000 US council comments mean for data center buyers.

What it means if you rent servers

  • Dedicated servers. A dedicated server is built from parts at today's prices, and RAM is a part whose contract prices TrendForce expected to keep rising through 2026. A configuration priced in 2025 will usually cost more to build now, and a RAM upgrade on a rented box follows the same market. Price your own build in the dedicated server configurator; it uses current part prices. Flash went through the same squeeze and is the first part forecast to ease: see SSD prices may fall in 2027.
  • Cloud servers. In the cloud you rent memory in slices, which is Altman's utilisation argument applied to you. On our published plans (Prague, excl. VAT, checked 2026-10-31) Large (8 vCPU, 16 GB RAM, 160 GB SSD) is EUR 36.88 a month and X-Large (8 vCPU, 32 GB RAM, 160 GB SSD) is EUR 59.92: the extra 16 GB costs EUR 23.04, or EUR 1.44 per GB a month. Those are today's prices, not a promise about next year.
  • Either way, idle RAM is the cost you control. A server sized for a peak that never comes is the server-room version of the laptop Altman describes.

Measure your own 5%

Linux reports in /proc/meminfo how much memory could be handed out without swapping (MemAvailable). Total minus that is what your workload really holds; page cache the kernel can drop is not counted. We ran our own script that samples it and prints the average, the peak, what was never touched, and the smallest power-of-two size that fits the peak plus 25% headroom.

Output, run on a DCXV Cloud server with Python 3.14.4 on 2026-10-31:

samples        12 x 5 s
total          3.7 GiB
used avg       1.5 GiB (40%)
used peak      1.5 GiB (40%)
never touched  2.2 GiB
fits in        2 GiB (peak + 25%, next power of 2)

How to read it. This is the 4 GB machine that writes these posts, sampled for one minute while it was doing that: it held 1.5 GiB at most, and 2.2 GiB was never touched in that window. One minute proves nothing about sizing. Measure for a week under real traffic, sampling MemAvailable every few minutes, and make sure the week includes your busiest day. Two cautions: a database or file server uses spare RAM as cache and gets faster with it, so "never touched" is not always waste; and a short spike (a backup, a deploy) is still a peak you must fit, or the kernel will swap or kill a process. Per-workload rules are in our cloud server sizing guide.

Local, cloud or your own server

Altman's framing has two options: memory in your PC or memory in his data centre. A business has a third, a server you rent and control:

  1. Keep it local when the data must not leave the device or the work is occasional; that RAM is already paid for.
  2. Use a shared API when demand is bursty and the data may go to a third party.
  3. Run your own server in the EU when the load is steady, the data must stay under your control, or you want to choose the model weights yourself. Memory needs per model size are in hosting LLMs with Ollama in Europe, and the price points for 64 GB in what a 64 GB RAM server costs.

Memory is the expensive part this year, so the third option only pays when it is sized from a measurement, not from a guess. Capacity is only half of it: how fast that memory answers is measured in memory latency on a cloud server.

Right-size before you buy

Measure for a week, then pick a plan that fits the peak plus 25%. Our Tier III data centres in Prague and Covilha run cloud servers with up to 256 GB of RAM; for a fixed heavy load, a dedicated server configured to the measured peak. Send your measurements to sales@dcxv.com and we will suggest a size.

SSD Prices May Fall in 2027: What Server Buyers Should Do
dedicatedcloudpricinginfrastructure

SSD Prices May Fall in 2027: What Server Buyers Should Do

TrendForce sees NAND contract prices falling 0-5% in 1Q27 after a year of steep rises. What it means for server storage, with our own per-TB drive price data.

Starlink Mini 2 Behind CGNAT: Reaching a Site That Moves
networkingcloudinfrastructure

Starlink Mini 2 Behind CGNAT: Reaching a Site That Moves

Starlink Mini 2 is out, but standard plans sit behind CGNAT. We counted 990,208 IPv4 addresses for 12M+ customers and compare four ways to reach a remote site.

IPv4 Market Report October 2026: Prices, Transfers, Queue
ipv4pricingtransfer

IPv4 Market Report October 2026: Prices, Transfers, Queue

October 2026 IPv4 market report: 253 RIPE transfers moving half September's addresses, a /24 at $25.34 per IP, a queue of 820 LIRs, ARIN 58, our own count.

Opening a RIPE LIR in 2026: Costs, Timeline, When Not To
ipv4ripe-nccpricing

Opening a RIPE LIR in 2026: Costs, Timeline, When Not To

Opening a RIPE NCC LIR in 2026: EUR 1,000 sign-up, EUR 1,894 a year from 2027, the steps, a census of 19,852 LIR accounts and when a sponsoring LIR is cheaper.

Data Center Protests Reach Europe: What Buyers Should Do
clouddedicatedinfrastructure

Data Center Protests Reach Europe: What Buyers Should Do

Hundreds entered Microsoft's Amsterdam data center site on 6 November. The Dutch power numbers behind it, measured latency to EU hubs and what buyers should do.