Whereas shopping our web site just a few weeks in the past, I stumbled upon “How and When the Memory Chip Shortage Will End” by Senior Editor Samuel Okay. Moore. His evaluation focuses on the present DRAM scarcity brought on by AI hyperscalers’ ravenous urge for food for reminiscence, a serious constraint on the pace at which large language models run. Moore supplies a transparent clarification of the scarcity, notably for prime bandwidth reminiscence (HBM).
As we and the remainder of the tech media have documented, AI is a useful resource hog. AI electricity consumption might account for as much as 12 p.c of all U.S. energy by 2028. Generative AI queries consumed 15 terawatt-hours in 2025 and are projected to eat 347 TWh by 2030. Water consumption for cooling AI data centers is predicted to double and even quadruple by 2028 in comparison with 2023.
However Moore’s reporting shines a light-weight on an obscure nook of the AI increase. HBM is a selected sort of reminiscence product tailored to serve AI processors. Makers of these processors, notably Nvidia and AMD, are demanding increasingly reminiscence for every of their chips, pushed by the wants and needs of companies like Google, Microsoft, OpenAI, and Anthropic, that are underwriting an unprecedented buildout of data centers. And a few of these services are colossal: You’ll be able to learn in regards to the engineering challenges of constructing Meta’s mind-boggling 5-gigawatt Hyperion web site in Louisiana, in “What Will It Take to Build the World’s Largest Data Center?”
We realized that Moore’s HBM story was each necessary and distinctive, and so we determined to incorporate it on this difficulty, with some updates because the authentic printed on 10 February. We paired it with a current story by Contributing Editor Matthew S. Smith exploring how the memory-chip scarcity is driving up the value of low-cost computer systems just like the Raspberry Pi. The result’s “AI Is a Memory Hog.”
The large query now could be, When will the scarcity finish? Worth stress brought on by AI hyperscaler demand on all types of consumer electronics is being masked by cussed inflation mixed with a perpetually shifting tariff regime, at the least right here within the United States. So I requested Moore what indicators he’s in search of that might sign an easing of the reminiscence scarcity.
“On the availability aspect, I’d say that if any of the large three HBM corporations—Micron, Samsung, and SK Hynix—say that they’re adjusting the schedule of the arrival of latest manufacturing, that’d be an necessary sign,” Moore advised me. “On the demand aspect, will probably be fascinating to see how tech corporations adapt up and down the supply chain. Information facilities would possibly steer towards {hardware} that sacrifices some efficiency for much less reminiscence. Startups creating all types of merchandise would possibly pivot towards inventive redesigns that use much less reminiscence. Constraints like shortages can result in fascinating know-how options, so I’m trying ahead to masking these.”
To make certain you don’t miss any of Moore’s evaluation of this matter and to remain present on your entire spectrum of know-how growth, sign up for our weekly newsletter, Tech Alert.
From Your Website Articles
Associated Articles Across the Net
