|
This Showcase was published on March 20, 2024.
Presenters
Delegate Panel
In this showcase, Quantum presents Myriad; an all-flash file and object storage platform, designed to enhance performance and manageability for diverse storage needs.
Quantum End to End Data Lifecycle Solutions Overview
Jordan Winkelman, Field Solutions CTO at Quantum, presents an overview of Quantum’s evolution, services, and introduction to their new product, Myriad. Quantum, with a 44-year history in storage solutions, focuses on providing end-to-end solutions for AI, unstructured data, and media and entertainment, managing over 84 exabytes of data globally for more than 10,000 customers, including major broadcasters, media companies, and public institutions. The company’s products support various sectors, including video surveillance, healthcare, and cloud storage, with a significant presence in hyperscale tape archives.
Winkelman highlights Quantum’s recent acquisitions and innovations, such as the ActiveScale object store, Squarebox Software’s CatDV media asset management system, and Pivot3’s hyperconverged storage, showcasing Quantum’s shift towards AI and data analytics. This presentation is focused on Myriad, Quantum’s new all-flash file and object storage platform, designed to enhance performance and manageability for diverse storage needs.
Quantum’s portfolio includes a range of storage solutions from high-speed, performance-oriented platforms to cost-effective, secure tape storage, underpinned by AI operations and cloud-based analytics for comprehensive monitoring and support. This holistic approach aims to provide customers with seamless, integrated storage workflows, leveraging AI to enrich data and offer competitive advantages in content creation and management.
Personnel: Jordan Winkelman
Quantum Myriad All-Flash Scale-Out Architecture
Ben Jarvis, Lead Storage Architect, discusses the innovative architecture of the Quantum Myriad all-flash scale-out storage system. Myriad was designed from the ground up to handle high-performance video and HPC workloads, leveraging large scale-out internet-facing service paradigms. It utilizes a microservices container-based system running on Kubernetes, deployed on white box commodity hardware, and is optimized for NVMe flash storage and high-performance RDMA Ethernet networks.
The system is designed to invert traditional storage models by optimizing software to fully utilize the hardware’s capabilities, focusing on memory bandwidth and minimizing context switches. Myriad’s architecture supports inline data protection, data reduction through compression and deduplication, and presents a self-contained cluster to customers.
Jarvis explains the integration with Kubernetes for state management and the system’s approach to handling physical storage on nodes. Myriad operates on a transactional key-value store basis, supporting transactions necessary for a POSIX-compliant file system. It employs a redirected write system with data protection through mirroring and erasure encoding, optimizing for low-latency, high-concurrency operations. The system’s design avoids performance bottlenecks common in traditional storage systems by adopting a work-at-risk approach for managing transactions. This method allows for independent operations with synchronization only at the end, significantly reducing the probability of conflicts and enabling the system to scale efficiently. Myriad is optimized for workloads that do not involve simultaneous writes to the same file by multiple nodes, steering clear of legacy HPC workloads that do not align with its architectural advantages.
Personnel: Ben Jarvis
Quantum Myriad All-Flash File and Object Software Demonstration
In this presentation, Nick Elvester, General Manager of Primary Storage at Quantum, provides a comprehensive demonstration of the Myriad all-flash file and object storage software. He begins with an overview of the dashboard, highlighting features such as effective capacity, data reduction ratios, system health, and performance metrics including throughput and IOPS. Elvester explains the multi-file system capabilities of Myriad, allowing for efficient data management and storage optimization through features like snapshots, clones, and elastic file systems. The discussion also covers security concerns, particularly around protecting against insider threats, and outlines future plans for multi-factor authentication for critical administrative actions.
The architecture of the Myriad system includes Kubernetes for managing microservices and integrates load balancers for efficient network traffic handling. The nodes are optimized to evenly distribute data across NVMe devices to avoid hotspots and ensure longevity. Questions from the audience touch on NFS v4, API support, Kubernetes integration, and data protection strategies, including replication and backup solutions.
Overall, Quantum’s Myriad provides a scalable, efficient, and secure all-flash storage solution emphasizing flexibility, performance, and a future roadmap for expanded protocol support and enhanced security features.
Personnel: Nick Elvester