DRAM: an industry in full flight
Generative AI and High Bandwidth Memory (HBM) fuel DRAM market growth.
OUTLINE:
During the memory market winter, DRAM demand bits stayed low, except for AI[3] servers and automotive electronics. Generative AI applications like ChatGPT drove interest in high-speed memory technologies like DDR5 DRAM and HBM, especially in data centers.
According to Simone Bertolazzi , Ph.D., Principal Analyst, Memory at Yole Group : “ 三星电子 , SK hynix and 美光科技 diverted more wafer capacity to HBM to meet demand, slowing overall bit production and increasing undersupply for non-HBM products. HBM wafer production is set to double in 2024.”
Driven by AI computing demand, HBM is expected to outpace the overall DRAM market significantly. HBM bit shipments grew by 93% in 2023 and are projected to grow by 147% in 2024, with a 45% CAGR[4] from 2023 to 2029, while data center DRAM bits will grow by 25%.
HBM market revenue could rise from US$2.7 billion in 2022 to US$14 billion in 2024, accounting for 3% and 19% of overall DRAM revenue, respectively.
In this context, the market research & strategy consulting company, Yole Group releases its market & technology report, Next-Generation DRAM 2024 - Focus on HBM and 3D DRAM. In its new memory report, the company provides a detailed analysis of the DRAM market and technology trends with a focus on DRAM scaling, high-bandwidth memory, and monolithic 3D DRAM. Yole Group’s experts comprehensively analyze the market, presents the latest technology trends, and describes the supply chain and the dedicated ecosystem.
From Simone Bertolazzi: “The development of 4F2 DRAM aims to shrink the chip area by approximately 30% compared to existing 6F2 structures, without requiring smaller lithography nodes. Additionally, the adoption of CBA[5] DRAM architectures, where the periphery circuit and memory array are processed on separate wafers and then stacked together using wafer-to-wafer hybrid bonding, is expected to commence with the introduction of 4F2 cells by 2027.”
Hybrid bonding will also be essential to advance HBM technology to enhance memory bandwidth and power efficiency and reduce stack thickness. The implementation of hybrid bonding is anticipated to start with the HBM4 generation around 2026, featuring up to 16 DRAM dies per stack and doubling the interface width to 2,048 bits.
While monolithic 3D DRAM is a promising long-term scaling solution, many aspects of its development remain uncertain, and the optimal strategy has yet to be defined. DRAM companies are exploring various approaches, including 1T-1C cells with horizontal capacitors and capacitor-less options like gain cells (2T0C) or 1T-DRAM based on the floating-body effect. The transition from 2D to 3D DRAM is expected to bring significant transformation to the DRAM industry, akin to the evolution seen with 3D NAND technology. Current models suggest that 3D DRAM could enter the market around 2030, reaching approximately ten million wafers per year by 2035, accounting for 38% of the projected DRAM wafer production.
Related articles
AI has been incorporated into smartphone features for several years, but the implementation of adapted LLM[6] in high-end devices could result in an early boost in the demand for DRAM and an acceleration in the phase-out of the smallest NAND storage capacity.
领英推荐
At Yole Group, analysts John Lorenz and Thibault Grossi estimate that the rise of AI-enabled smartphones could trigger additional demand for DRAM and NAND above the current forecast…Full article
HBM sector to outgrow the overall DRAM market and remain undersupplied into 2025.
The market for high bandwidth memory (HBM) is poised for rapid growth over the next five years, announces Yole Group in its latest analyses. According to the analysts, it is led by the continuous expansion of data-intensive artificial intelligence (AI) and high-performance computing (HPC) applications. As a result, the HBM sector will largely outgrow the overall DRAM market and remain undersupplied throughout 2024… Full analysis
Yole Group’s memory team invites you to follow the technologies, related devices, applications, and markets on www.yolegroup.com. Stay tuned!
[1] HBM: High Bandwidth Memory
[2] DRAM: Dynamic Random-Access Memory
[3] AI: Artificial intelligence
[4] CAGR: Compound Annual Growth Rate
[5] CBA: CMOS-Bonded Array
[6] LLM: Large Language Models
Source: www.yolegroup.com
Applied Data Scientist | IBM Certified Data Scientist | AI Researcher | Chief Technology Officer | Deep Learning & Machine Learning Expert | Public Speaker | Help businesses cut off costs up to 50%
1 年Impressive analysis, looking forward to diving deeper into the details! ??
Radiation Electronics CTO, just Retired
1 年Yes workers who can go inside chip can improve it
Your daily news source with 60K followers & 11 million impressions annually. Stay in the loop with exclusive semiconductor industry insights. INTERESTED IN COLLABORATION? E-MAIL ME at [email protected]
1 年The focus on HBM by industry leaders signals a promising rebound and strategic foresight for the semiconductor sector in 2024.