Watch on YouTube
Watch on Vimeo
Upscale AI posits that traditional data center networking is a round peg in a square hole for AI, as existing infrastructures were designed for general-purpose web traffic rather than the massive, synchronized communication required by billions of parameters and trillion-token models. By focusing exclusively on AI traffic and removing the bloat of legacy enterprise features, Upscale AI aims to provide a reliable, predictive substrate that treats the entire cluster as a single, coordinated engine.
The technical strategy addresses the evolution of AI workloads from dense training to inference-centric agentic AI and persistent states. As models outgrow the memory capacity of single GPUs, parallelism, like slicing math problems across thousands of processors, becomes mandatory, creating a massive data movement problem. Upscale AI advocates for a distributed ecosystem where the network must be technology-agnostic to support a plethora of specialized ASICs, including GPUs, TPUs, and custom hyperscaler XPUs. This architecture moves away from reactive TCP-based recovery toward a lossless, RDMA-driven environment where the network proactively manages congestion to prevent computational stalls, ensuring that every GPU cycle is utilized to maximize tokens per watt.
To future-proof these investments, Upscale AI is developing a portfolio of scale-up and scale-out systems built on open standards like Ethernet, SONiC, and UA Link. Their scale-out systems leverage a partnership with NVIDIA’s Spectrum-X, while their scale-up innovation involves purpose-built silicon and trays to support heterogeneous compute and memory pooling. By utilizing a unified software stack based on SONiC, the company provides a common substrate that simplifies operational onboarding for neoclouds and enterprises. Ultimately, Upscale AI’s mission is to move beyond the current homogeneous nature of AI clusters, providing an open, standards-based fabric that allows diverse hardware to interoperate seamlessly for the next decade of AI innovation.
Personnel: Deepti Chandra
Thank you for being part of the Tech Field Day community! Our mailing list is a great way to stay up to date on our events and technical content, and we appreciate your signup.
We promise that we’ll never spam you, send ads, or sell your information. This list will only be used to communicate with our community about our events and content. And we’ll limit it to no more than one message per week.
Although we only need your email address, it would be nice if you provided a little more information to help us get to know you better!
