Introduction to Multi-Tenancy & Network Automation for AI Infrastructure Operators with Netris

Netris helps GPU-based AI infrastructure operators automate their networks, provide multi-tenancy and isolation, and offer essential cloud networking features like VPCs, internet gateways, and load balancers. Netris focuses on network software designed for AI and cloud infrastructure operators because the growing popularity of AI necessitates specialized networking solutions to handle demanding AI workloads. Netris’s technology is particularly well-aligned with NVIDIA’s networking offerings, which are based on the foundation of Mellanox and Cumulus networks.

The presentation highlights the importance of dynamic multi-tenancy for maximizing the utilization of expensive GPUs. Netris provides “cloud provider grade network automation software” that allows AI infrastructure operators to achieve security levels comparable to physical isolation while maintaining software-driven speed. This solves the problem of manual network configuration, which is time-consuming, error-prone, and doesn’t scale. Furthermore, Netris supports cloud networking functions like Internet gateways, NAT gateways, and load balancers, offering a complete solution that addresses the need for secure and flexible network management in AI environments.

Netris’s solution is built on three key pillars: VPCs for isolation, cloud networking functions for connectivity, and fabric management for network operations. They manage both Ethernet and InfiniBand fabrics, providing operators with a single pane of glass.  For InfiniBand fabrics, Netris integrates with NVIDIA’s UFM controllers. On the Ethernet side, Netris acts as the fabric manager for several vendors, including NVIDIA, Dell, and Arista, automating the management of network switches and streamlining operations. The goal is to offer a comprehensive, integrated network automation platform tailored for the demands of AI infrastructure.