MinIO AIStor, S3 Express API, NVIDIA GDS,m and BF3 Overview with MinIO

AB Periasamy, Co-CEO of MinIO, presented at Cloud Field Day 23, focusing on the AI-centric capabilities of MinIO AIStor. The presentation highlighted three key areas: S3 Express API compatibility, integration with NVIDIA GPUDirect Storage (GDS), and the forthcoming integration with NVIDIA BlueField 3 DPUs. These technologies aim to enhance performance and efficiency for AI and data-intensive workloads.

The discussion began with S3 Express, a refined subset of the Amazon S3 API designed for high-performance applications, particularly those involving AI workloads. MinIO has implemented the S3 Express API, offering users the choice between the regular S3 API and the S3 Express API, without requiring changes to data formats. The presentation emphasized that S3 Express eliminates performance bottlenecks, such as directory sorting and unnecessary checksum computations, that limit modern AI applications. It provides faster time-to-first-byte metrics compared to traditional S3.

Next, Periasamy introduced GPU Direct, an NVIDIA interface that allows direct data transfer between storage and GPU memory, thereby bypassing the CPU. The upcoming integration with MinIO will enable this functionality using the S3 API. This is done by utilizing a control plane via HTTP with RDMA as a data channel. The presentation concluded with a discussion of how integrating with NVIDIA BlueField 3 DPUs would enable an ultra-efficient JBOD-based storage solution, also known as JBOF. This new design will result in a low-power solution with high performance due to being a solely smart NIC-based system.