Watch on YouTube
Watch on Vimeo
Complexity of AI workloads scales rapidly and entails faster scaling of memory requirement than scaling of the memory technology. In this talk, we break down the memory requirement for recommendation models, as one of the main drivers of AI platforms, and make the case for a new tier of memory, optimized for capacity, to help cope with workload scaling. Using Intel Optane SSD with software-defined memory sales power and allows for a simpler serving paradigm. While the talk argues that CXL-attached memory is a viable solution, as a precursor, it presents empirical results of leveraging additional memory tier using currently available NVMe-attached Storage Class memory. Presented by Manoj Wadekar, Hardware Systems Technologist at Facebook, Ehsan Ardestani, Research Scientist and Technical Lead Manager, Meta, and Chris Petersen, Hardware Systems Technologist, Intel.
Personnel: Chris Petersen, Ehsan Ardestani, Manoj Wadekar
Thank you for being part of the Tech Field Day community! Our mailing list is a great way to stay up to date on our events and technical content, and we appreciate your signup.
We promise that we’ll never spam you, send ads, or sell your information. This list will only be used to communicate with our community about our events and content. And we’ll limit it to no more than one message per week.
Although we only need your email address, it would be nice if you provided a little more information to help us get to know you better!
