Kamiwaza – A Single API and SDK for GenAI Applications to Run in the Enterprise

Experience a live demo showcasing Kamiwaza’s capabilities, including how our platform seamlessly integrates third-party applications via our SDK and API across all locations and silicon. A technical demo showed data ingestion for the RAG process and how data and security integrations, such as authentication, are handled for both internal and third-party enterprise applications. Kamiwaza positions itself as a “Docker for Generative AI,” providing a single API and SDK to manage multiple GenAI applications, eliminating the need for individual stacks and security layers for each application. This approach allows for seamless interaction between various applications, significantly boosting efficiency and delivering tangible business outcomes.

The platform boasts hardware agnosticism, enabling large language models to run on diverse hardware, from single servers to large clusters. Bench testing demonstrates impressive throughput, with a 70B parameter model achieving 8,000 tokens per second on a single 8-way AMD MI300 server. Kamiwaza is offered in several tiers: a free community version, a per-GPU licensing model for smaller deployments, and a $25,000 enterprise edition with unlimited GPUs. The enterprise edition includes unique outcome-based support, where a dedicated GenAI architect helps clients achieve specific business goals, ensuring the platform delivers practical value and isn’t just shelfware.

Unlike other solutions focused solely on infrastructure, Kamiwaza also addresses the application layer through its “app garden” and provides integrations with other observability tools. While they are not currently integrating at the prompt level, they leverage existing solutions to provide a robust and scalable platform. Future development includes expanding the app garden to allow third-party developers to easily build and deploy their own applications and agents. The company’s vision is to facilitate a more modular and customizable enterprise GenAI ecosystem, challenging the traditional monolithic approach to enterprise software and enabling rapid development of tailored AI solutions.