Why Latency-Tolerant Architectures Matter in the Age of AI Supercomputing
High Bandwidth Memory (HBM) has become the defining enabler of modern AI accelerators. From NVIDIA’s GB200 Ultra to AMD’s MI400, every new AI chip boasts faster and larger stacks of HBM, pushing memory bandwidth into the terabytes-per-second range. … Read More
Jonathan Klamkin, Ph.D. is founder and CEO of Aeluma, Inc. (ALMU). He is a Professor at the University of California Santa Barbara and has previously worked at Boston University, Scuola Superiore Sant’Anna, MIT Lincoln Laboratory, and BinOptics Corp. (a laser diode manufacturer that was acquired by Macom in 2015). He is the recipient… Read More
GTC is coming back to San Jose on March 17–21, 2025. Join thousands of developers, innovators, and business leaders to experience how AI and accelerated computing are helping humanity solve our most complex challenges.
From the must-see keynote by NVIDIA CEO Jensen Huang to over 1000 inspiring sessions, 300+ exhibits, technical… Read More
The December 2024 WSTS forecast called for strong 2024 semiconductor market growth of 19%. However, the strength is limited to a few product lines. Memory is projected to grow 81% in 2024. Logic is expected to grow 16.9%. The micro product line should show only 3.9% growth, while discretes, optoelectronics, sensors and analog … Read More
WSTS reported third-quarter 2024 semiconductor market growth of $166 billion, up 10.7 percent from second-quarter 2024. 3Q 2024 growth was the highest quarter-to-quarter growth since 11.6% in 3Q 2016, eight years ago. 3Q 2024 growth versus a year ago was 23.2%, the highest year-to-year growth since 28.3% in 4Q 2021.
Nvidia remained… Read More
The Impact of AI on Software and Hardware Development
Part 4 of this series analyzes how AI algorithmic processing is transforming software structures and significantly modifying processing hardware. It explores the marginalization of the traditional CPU architecture and demonstrates how software is increasingly dominating… Read More
KLA reported… Read More
The Impact of the AI Revolution on the Server Manufacturers
While some will designate my research as market research, I view it differently. Having done and bought plenty of market sizing research, I have not seen it lead to any change in behaviour or strategy. It has been used to confirm a strategy already decided and the “great” … Read More
You don’t know you’re at a peak until you start to descend, and Hot Chips 2024 is proof that AI hype is still climbing among semiconductor vendors. Juggernaut Nvidia, startups, hyperscalers, and major companies presented their AI accelerators (GPUs and neural-processing units—NPUs) and touched on the challenges of software,… Read More
Despite a severe setback, Nvidia pulled it off once again
There have been serious concerns about the ROI on AI and yield problems with Blackwell, but Nvidia pulled it off again and delivered a result significantly above guidance.
Beating the revenue guidance of $28B with 2B$ to just above 30B$, representing 15% QoQ and a 122% YoY … Read More
