Deploy AI Everywhere From Edge to Data Center and Cloud with Intel

In this session, Ronak Shah, AI Product Director at Intel’s Data Center and AI Group, reflects on the full day of presentations at AI Field Day 4. In addition to Intel, the day included representatives from Nature Fresh Farms, VMware by Broadcom, Google Cloud, and Kamiwaza. He emphasizes the prevalence of AI deployments, particularly inferencing on CPUs, and why many customers opt for this approach.

• Nature Fresh Farms is highlighted as a case study for meeting critical requirements using CPUs without the need to transition to other hardware, thus simplifying infrastructure and managing costs.
• VMware’s perspective is summarized with the phrase “use CPUs when you can and GPUs when you must,” demonstrating that CPUs are sufficient for many smaller inferencing tasks.
• Google Cloud’s input supports the notion that the majority of inference work is done on CPU instances, especially among enterprise customers with real-time, smaller models.
• Kamiwaza’s contribution underlines the challenges of deploying AI systems and the importance of partners that simplify the journey for customers. The ease of deployment with CPUs and the quick adaptation to new generations, such as the fifth-gen Xeon, are also discussed.

The conversation touches on the evolving AI landscape, the need for education on AI deployment, and the importance of software in maximizing hardware potential.