MinIO Presents at Storage Field Day 19

The Philosophy Behind MinIO with AB Periasamy

Watch on YouTube
Watch on Vimeo

AB Periasamy, Founder and CEO of MinIO, introduced the company at Storage Field Day as a high-performance, software-defined, distributed object storage solution designed to operate both independently and as an alternative to existing public cloud services, specifically Amazon S3. He discussed the philosophy behind MinIO, emphasizing its singular focus on creating a simple yet powerful object storage solution free from external dependencies. MinIO aims to be lightweight and manageable, running on various environments with minimal footprint, and is built with user experience in mind, particularly for developers integrating the storage solution into applications.

Throughout the presentation, Periasamy highlighted the importance of simplicity in design and function. He explained that while many existing storage solutions complicate their interfaces and rely heavily on legacy paradigms, MinIO was designed to create a modern object storage experience accessible to users of all technical backgrounds. With a base size of just 44 MB, MinIO encompasses all necessary functionalities within a single static binary, allowing it to run efficiently even in edge cases, like on 5G towers or Raspberry Pi clusters. The MinIO client is intentionally designed to allow for automation and management of large data sets, offering a more powerful toolset compared to traditional UNIX-like utilities.

Periasamy also underscored the significance of branding, market perception, and a community-driven approach in the growth of MinIO, pointing out that their strategy leverages open-source principles to establish trust without compromising on quality or support. In addressing why the company chose to focus on object storage rather than diversifying into other data management areas, he expressed that maintaining focus on delivering the best possible object storage solution would ultimately create a more significant impact in the industry. Overall, MinIO intends to empower businesses to manage their data more effectively while promoting a robust community and developer engagement.

Personnel: AB Periasamy

A Data Driven Picture of MinIO’s Reach

Watch on YouTube
Watch on Vimeo

In the presentation titled “A Data Driven Picture of MinIO’s Reach,” Jonathan Symonds, Chief Marketing Officer of MinIO, sheds light on the significant market impact the company has made in the realm of object storage within a short time frame. He highlights that MinIO has become the most widely deployed object storage server, with over 300 million Docker pulls, 20,000 GitHub stars, and a growing community of over 6,500 Slack members and 500 contributors. Symonds emphasizes the rapid growth trend of MinIO, which he describes as a “hockey stick” in trajectory, underscoring the reduced friction for users to adopt the solution due to its open-source nature. The metrics shared indicate that MinIO has surpassed traditional competitors like Ceph and Swift, demonstrating its growing popularity and effectiveness in the market.

Following Symonds, AB Periasamy, Founder and CEO of MinIO, elaborates on the enterprise traction and industry usage of the platform. He points out that MinIO’s deployments span across various sectors, with around 50% of Fortune 500 companies utilizing the service, including notable names such as Splunk, Nutanix, IBM, and McKesson. Periasamy provides insights into the diverse applications of MinIO, with a particular emphasis on its usage in technology solutions, healthcare, and financial services. He articulates that MinIO supports numerous use cases from big data applications to medical imaging, showcasing the versatility of the object storage solution in meeting the demands of various industries.

The presentation also highlights the community aspect of MinIO, illustrating a vibrant ecosystem of developers and organizations engaging with the platform. Symonds and Periasamy emphasize the collaborative nature of MinIO, with a clear commitment to maintaining the open-source model while monetizing through strong support offerings like Subnet. This subscription model not only provides significant revenue but also fosters long-term relationships with large clients, translating to a robust business model amid ongoing community engagement. They conclude by underlining MinIO’s commitment to delivering high-performance storage solutions while expanding its reach in both technical and enterprise environments, ultimately positioning MinIO as a key player in the future of object storage.

Personnel: AB Periasamy, Jonathan Symonds

A Review of MinIO’s Performance Benchmarks

Watch on YouTube
Watch on Vimeo

Jonathan Symonds, Chief Marketing Officer, and AB Periasamy, Founder and CEO, present MinIO’s performance benchmarks, asserting that MinIO has been engineered with a focus on speed from its inception, resulting in what they claim to be the fastest object storage system available. During the presentation, they showcased various benchmarks for S3 performance, emphasizing results with and without encryption while utilizing both traditional hard disk drives and modern NVMe SSDs. They provided comparisons of MinIO’s performance against legacy systems like HDFS and commercial cloud solutions such as AWS, illustrating MinIO’s capability to operate efficiently at scale.

The speakers elaborated on the technical underpinnings of MinIO that contribute to its superior performance. They highlighted its architecture as a single-layer object storage server that utilizes SIMD acceleration for optimized processing. A notable design element is the absence of a metadata database, which minimizes potential bottlenecks that can arise from bulk operations, allowing for atomic writes that enhance speed. They also discussed how MinIO is built using the Go programming language and assembly language to leverage hardware optimally, enabling it to handle demanding data workloads including big data analytics and machine learning applications.

The presentation concluded with a discussion on MinIO’s positioning within the evolving cloud environment, noting its applicability in use cases such as financial services and autonomous vehicles. The speakers argued that MinIO’s performance metrics not only make it a competitive alternative to HDFS but also facilitate cloud-native architectures for enterprises looking to modernize their data environments. They underscored the trend toward private cloud adoption and the expanding role of object storage in displacing traditional SAN and NAS setups, establishing MinIO as a strategically relevant choice for users looking to harness high-speed object storage capabilities in their infrastructures.

Personnel: AB Periasamy, Jonathan Symonds

AB Periasamy Presents the MinIO Internals

Watch on YouTube
Watch on Vimeo

AB Periasamy, Founder and CEO of MinIO, offered a comprehensive tour of the architecture and internals behind the MinIO object storage server during his presentation at Storage Field Day 19. He emphasized that MinIO operates more like a high-performance web server than a traditional storage system. Unlike typical object storage solutions that incorporate complex theories of consensus and distributed locking, MinIO adopts a single-layer architecture designed for atomic and consistent operations, significantly improving data handling efficiency. By utilizing inline erasure coding, encryption, and robust data replication, MinIO ensures data integrity, even during unexpected failures, which contributes to the company’s rapid growth and adoption in the market.

In his presentation, Periasamy outlined MinIO’s unique distribution model, allowing installations across multiple servers and data centers without hierarchical metadata or lock servers. This design means that all nodes have equal capabilities, enabling easy scaling. The architecture facilitates horizontal striping of objects across multiple drives and nodes, which enhances fault tolerance — users can lose several drives or nodes, and their data remains accessible. This is achieved through mathematical distributions that ensure even data allocation and quick data retrieval, resulting in remarkably efficient performance even in extensive deployments that can exceed petabyte scales. He noted the capability of organizations to manage multiple tenants simultaneously, simplifying multi-tenant environments.

Lastly, Periasamy discussed the importance of continuous data replication and real-time synchronization, which MinIO supports through notifications and a robust mirroring capability. This ensures that data remains synchronized across remote sites, making it reliable for mission-critical applications. He addressed security features and management tools that MinIO incorporates, such as dynamic password management and sophisticated identity management, which enhance data governance while maintaining a simplified user experience. By positioning MinIO in this way, the presentation illustrated not just the technical capabilities of the platform but also its fit within modern enterprise environments seeking flexible, scalable, and secure object storage solutions.

Personnel: AB Periasamy

The MinIO SUBNET Experience

Watch on YouTube
Watch on Vimeo

AB Periasamy, co-founder and CEO of MinIO, introduces the MinIO SUBNET experience, designed specifically for paying customers operating in critical production environments. Even though MinIO is fully open source, customers opt for paid support to enhance their deployment of MinIO, acknowledging its critical nature within their infrastructure. The rationale behind this decision stems from the specific context wherein customers, who are often already adept with the product, recognize the need for immediate support to prevent issues such as data loss and data breaches—concerns that have become paramount in today’s data-driven landscape. The pricing model ranges from free options for open-source projects to per-GB pricing for enterprise users, aiming to foster an integrative, supportive relationship that treats MinIO as an extension of the customer’s team.

Eco Willson, MinIO’s Support Lead, further explains the value of SUBNET, highlighting how it fundamentally transforms customer interactions. Traditional support models often leave critical avenues for collaboration unutilized, leading to frustration among expert users who prefer direct access to seasoned developers rather than level one support technicians. SUBNET addresses this issue by providing real-time, continuous communication facilitated through a chat interface reminiscent of platforms like Slack, allowing for a more personalized and immediate resolution process. By fostering an environment where customers experience dedicated support from the developers who understand the intricacies of the code, MinIO successfully contrasts itself with outdated support models that impose barriers between customers and expertise.

The essence of SUBNET is rooted in its simplicity and effectiveness, allowing the engineering team to engage seamlessly with customers about their technical challenges. Periasamy emphasizes that substantial success hinges on a product designed for self-supportability, alongside a healthy organizational culture that promotes collaboration between developers and support engineers. The ability to diagnose problems quickly is enhanced by minimizing unnecessary noise in logging and ensuring that engineers can access real-time telemetry of the customer’s environment. Collectively, these elements contribute to a robust support system that not only resolves immediate issues but also strengthens the overall customer relationship, enabling MinIO to respond effectively to the demands of modern cloud-native users.

Personnel: AB Periasamy, Eco Willson

MinIO as a Splunk SmartStore

Watch on YouTube
Watch on Vimeo

AB Periasamy, Founder and CEO, and Eco Willson, Support Lead, demonstrate MinIO as a Splunk SmartStore. MinIO can handle the performance and volume of data required to make Splunk a true enterprise IT operations data source.

The presentation outlines how Splunk recognized the rapid growth in log data and the limitation of traditional methods to handle this explosion in volume, particularly emphasizing the need to transition to a cloud-native architecture. This necessitated disaggregating storage and compute, allowing organizations to scale their infrastructures efficiently and respond to burgeoning storage needs.

The speakers highlight that Splunk evolved early on to address the disaggregation problem while others, such as MariaDB, are only now catching up. By leveraging MinIO as an object storage backend, Splunk can better accommodate the colossal amounts of data generated by enterprise IT operations. The presentation includes a demonstration showing how straightforward it is to configure Splunk to utilize MinIO. By adjusting a few lines in the Splunk configuration file, users can enable object storage, allowing Splunk to offload data to MinIO while maintaining operational efficiency with local cache management.

Additionally, the discussion on operational monitoring and automation reflects the priorities of modern DevOps teams. MinIO provides tools for system health monitoring and integrates seamlessly with Prometheus for alerting and dashboard visualization. However, the emphasis remains on automation, allowing DevOps professionals to set up rules for critical alerts rather than manually observing systems. By streamlining these processes, MinIO enables organizations to scale their Splunk environments effectively, supporting petabytes of data while maximizing performance and reliability.

Personnel: AB Periasamy, Eco Willson