Semiconductor technologies evolving to meet generative AI demand - July 2024

Power and processor-hungry AI set to drive next stage of chip development – Generative artificial intelligence (AI) is redefining the value of work, and its exponential need for performance is driving demand for power consumption and processing capacity in ways that it is not yet clear how this will be met.

Tools based on generative AI have moved beyond niche technical applications to consumer use, changing the way images, video, music, and other content are produced. The impact is expected to reach almost every professional role, including lawyers, architects, doctors and more.

The AI server market is expected to expand at a compound annual growth rate of 36% from 2023 to 2029, outpacing overall data center growth.

Jerome Azemar , Sales Force Effectiveness Director at Yole Group, recently attended the International Semiconductor Executive Summit (ISES) Taiwan and among the key themes that emerged are the evolution in semiconductor technologies to meet demand.

HOW WILL HBM4 EVOLVE?

Generative AI and high-performance computing (HPC) are fueling growth in data center dynamic random-access memory (DRAM) demand.

Yole Group predicts that high-bandwidth memory (HBM) bit shipments will rise by around 48% between 2023 and 2029, with HBM’s share of the DRAM market rising above 6% from around 2% in 2023.

Read more...

?? GO DEEPER WITH YOLE GROUP'S ANALYSES

• Generative AI 2024 – Impact on Processors, Memory, Advanced Packaging, and Substrates
• Next-Generation DRAM 2024 – Focus on HBM and 3D DRAM
• Nvidia H100 Tensor Core GPU
• High-end Performance Packaging

?? WHAT'S NEW?

• Micron MRDIMM innovations deliver highest performance and lowest latency main memory to accelerate data center workloads
• Samsung validates industry’s fastest LPDDR5X DRAM for AI smartphones with MediaTek partnership
• SK hynix pumps billions into HBM chips to meet AI demand
• ARM microcontroller has up to 512kbytes embedded ReRAM

?? UPCOMING EVENTS

FMS

Don’t miss out on the largest memory and storage industry show that brings together the brightest minds and the most influential companies. ??

Join Yole Group as we showcase our latest products, solutions, and technological breakthroughs in memory & storage. ??

Visit our booth #1049 to explore our products, and engage in discussions with our team of experts. ??

Connect with Yole Group team and join our presentations!

?? Business Strategies and Memory Markets?panel with Simone Bertolazzi

?? Emerging non-volatile memory - Technology and market trends presentation by Simone Bertolazzi

?? Memory market recovery and focus on datacenter and CXL demand presentation by John Lorenz

?? LLM acceleration: hardware and memory trends presentation by John Lorenz

Stay tuned on yolegroup.com !

- Yole Group Communications Team - [email protected]

###