Watch on YouTube
Watch on Vimeo
Upscale AI, founded in 2025, recently emerged from stealth as a unicorn following $300 million in combined seed and Series A funding. With a team of industry veterans, Upscale AI is focused on building a clean sheet networking architecture specifically for the backend and lean front-end of AI clusters. The speakers emphasize that traditional data center networking is a round peg in a square hole for AI, as existing infrastructures were designed for general-purpose web traffic rather than the massive, synchronized communication required by billions of parameters and trillion-token models.
The presentation details the shift from a simple client-server model to a distributed ecosystem, where the network acts as the nervous system of an intelligent manufacturing plant or token factory. In this environment, the key performance indicators (KPIs) have shifted from bits per second to tokens per second and tokens per watt. As large language models (LLMs) outgrow the memory capacity of single GPUs, parallelism, such as slicing math problems across thousands of processors, becomes mandatory. This creates a massive data movement problem where any network synchronization stall or hot spot directly results in idle compute time and lost revenue, making predictability and low latency table stakes rather than optional features.
To address these challenges, Upscale AI is developing a portfolio that includes both scale-up and scale-out solutions built on open standards like Ethernet, SONiC, and the Ultra Ethernet Consortium (UEC). Their scale-out systems are designed around a partnership with NVIDIA’s Spectrum-X, while their scale-up innovation involves purpose-built silicon and trays to support heterogeneous compute environments. By focusing exclusively on AI traffic and removing the bloat of legacy enterprise features, Upscale AI aims to provide a reliable, predictive substrate that can proactively identify malfunctioning hardware. This architectural approach is intended to help operators maximize their token flywheel, ensuring that massive infrastructure investments yield the highest possible intelligence output per watt of power consumed.
Personnel: Deepti Chandra
Thank you for being part of the Tech Field Day community! Our mailing list is a great way to stay up to date on our events and technical content, and we appreciate your signup.
We promise that we’ll never spam you, send ads, or sell your information. This list will only be used to communicate with our community about our events and content. And we’ll limit it to no more than one message per week.
Although we only need your email address, it would be nice if you provided a little more information to help us get to know you better!
