Kamiwaza Private AI Inference Mesh and Data Engine

Luke Norris and Matt Wallace from Kamiwaza presented their mission to help enterprises achieve a trillion inferences a day, which they believe is key to the fifth industrial revolution. They discussed the massive scale at which they aim to operate, targeting Fortune 500 and Global 2000 companies, and addressing real-world use cases and problems. They explained the origin of the company name Kamiwaza, which means “superhuman” and reflects their goal to bring superhuman capabilities to enterprises.

The presenters focused on the importance of inferencing at scale, rather than model training, as they believe the latter is better left to very few experts employed by major tech companies. They emphasized that enterprises will use multiple foundational models and will need to manage these models effectively for various tasks. Kamiwaza aims to provide a full-stack generative AI solution that addresses the core problems of scale for an enterprise.

They introduced two key features of their solution: the Inference Mesh and the Distributed Data Engine. These features allow AI deployment anywhere, including on-premises, cloud, core, and edge, and work on a variety of hardware. They explained that the Inference Mesh and Distributed Data Engine work together to route inference requests efficiently, even when the data is in different locations. This hybrid approach is designed to enable massive scale data processing with LLMs (Large Language Models).