Watch on YouTube
Watch on Vimeo
Elias Alagna, a Distinguished Technologist at HPE, walked through the software inside HPE Private Cloud AI and the governance it provides. The platform runs on HPE infrastructure and comes with NVIDIA AI Enterprise, NeMo, and NIM microservices preinstalled. It adds open-source tools such as Spark, single sign-on, and role-based access control. HPE also certifies partner software through its Unleash AI program, with Kamiwaza as one example, and customers can bring their own models by supplying a Helm chart. Asked whether customers can bring their own control plane, Alagna said HPE handles the Kubernetes cluster, base OS, and firmware underneath, but customers can layer their own higher-level orchestrator on top. A built-in KAI scheduler sets quotas and priorities, tracks what is in use, and monitors what each workload costs.
Alagna showed that setup is a one-time, GUI-driven process with APIs also available. Administrators enter an authentication key and network details such as IP addresses and a default gateway, then select the systems to bring into the cluster. He said the full process, from racking and stacking to handing the system to AI users, takes about eight hours. For users, the platform includes Open WebUI, an interface modeled on OpenAI’s that can run several models side by side to compare their outputs. LiteLLM serves as a proxy that decides where each workload runs. An agent framework lets administrators see how many agents are running, which tools they use, what policies apply to them, and what access they have requested, so agents act only within the limits they are given.
Jason Lee of Equinix closed by arguing that governance doesn’t stop at the rack, because enterprises also need to control where their data travels once it leaves the system. He introduced Equinix Fabric Geozones, which lets customers guarantee, with a click in the portal or through the API, that their traffic never leaves a defined region. He contrasted this with standard MPLS networks, which reroute traffic around a failed link wherever they can. With Geozones turned on, Canadian traffic that loses its link is dropped rather than rerouted through the United States, so data stays in Canada for compliance.
Personnel: Elias Alagna, Jason lee
Thank you for being part of the Tech Field Day community! Our mailing list is a great way to stay up to date on our events and technical content, and we appreciate your signup.
We promise that we’ll never spam you, send ads, or sell your information. This list will only be used to communicate with our community about our events and content. And we’ll limit it to no more than one message per week.
Although we only need your email address, it would be nice if you provided a little more information to help us get to know you better!