|
|
This video is part of the appearance, “Intel Optane Group Presents at Tech Field Day 25“. It was recorded as part of Tech Field Day 25 at 8:00-9:30 on April 8, 2022.
Watch on Vimeo
Watch on YouTube
Complexity of AI workloads scales rapidly and entails faster scaling of memory requirement than scaling of the memory technology. In this talk, we break down the memory requirement for recommendation models, as one of the main drivers of AI platforms, and make the case for a new tier of memory, optimized for capacity, to help cope with workload scaling. Using Intel Optane SSD with software-defined memory sales power and allows for a simpler serving paradigm. While the talk argues that CXL-attached memory is a viable solution, as a precursor, it presents empirical results of leveraging additional memory tier using currently available NVMe-attached Storage Class memory. Presented by Manoj Wadekar, Hardware Systems Technologist at Facebook, Ehsan Ardestani, Research Scientist and Technical Lead Manager, Meta, and Chris Petersen, Hardware Systems Technologist, Intel.
Personnel: Chris Petersen, Ehsan Ardestani, Manoj Wadekar