Samsung SAFE – “HBM2E Memory Advances AI/ML Training Performance”

Join us on October 28th at Samsung SAFE. Frank Ferro will be giving a talk titled “HBM2E Memory Advances AI/ML Training Performance.”

Speaker: Frank Ferro
Title:  HBM2E Memory Advances AI/ML Training Performance
Abstract: Exponential data growth is driving performance requirements in data centers and networking infrastructure. The industry has responded to this enormous growth in data with new hardware platforms developed for both training and inference applications. But even these new designs are increasingly limited by memory bandwidth, particularly with AI/ML training where the size of models is growing by 10X annually. To remove this bottleneck, Samsung customers need new memory subsystems that significantly expand bandwidth and capacity. HBM2E memory represents the most powerful solution yet to address the AI memory bottleneck. This talk will discuss the new memory systems available in Samsung’s advanced process nodes, along with the design considerations for 2.5/3D memory implementation.