VAST Data DASE Architecture Optimized for Supermicro Hyperscale

Event:

Appearance: VAST Data Tech Field Day Showcase

Company: Supermicro, VAST Data

Video Links:

Personnel: John Mao, Lawrence Lam

John Mao from VAST Data and Lawrence Lam from Supermicro discuss their companies’ strategic partnership, focusing on AI and storage solutions. They highlight Supermicro’s significant presence in AI and its technological leadership and the company’s growth overall, particularly in AI and data centers. Supermicro’s early investment in GPU technology, despite AI and machine learning not being popular at the time, positioned the company ahead of its competitors. The partnership announcement includes the development of a joint solution combining VAST Data’s platform software with optimized Supermicro infrastructure, and a full-stack AI reference design and architecture to be revealed at GTC in March.

The conversation also touches on the importance of fast storage models to feed data to accelerators for AI training and the shift towards liquid cooling in data centers to overcome the physical limits of cooling GPUs, aiming for higher utilization ratios. Mao explains how VAST Data’s software-defined solution is being adapted for hyperscale optimization, catering to web scale and hyperscale customers with considerations for serviceability and scalability. The partnership aims to leverage Supermicro’s hardware innovations with VAST Data’s software to address the evolving needs of AI infrastructure, indicating a future where GPU servers might incorporate Bluefield optimization for enhanced performance.


Running VAST Data End to End on NVIDIA BlueField DPUs

Event:

Appearance: VAST Data Tech Field Day Showcase

Company: NVIDIA, VAST Data

Video Links:

Personnel: John Kim, John Mao

John Mao of VAST Data and John Kim of NVIDIA discuss their collaboration to integrate the data platform solution with NVIDIA’s BlueField Data Processing Units (DPUs). They discuss the benefits and technical aspects of using DPUs in data centers, emphasizing the acceleration and offloading of infrastructure tasks such as networking, storage, and security.

The conversation also highlights the implementation of the data platform leveraging BlueField-3 DPUs, showcasing how it brings storage and data closer to the compute layer, improving efficiency, security, and quality of service in large AI infrastructure deployments. They touch on the potential for power savings, the integration with NVIDIA’s software framework DOCA for block storage services, and the broader implications for service providers and enterprises.


Operationalizing AI at Scale with VAST Data

Event:

Appearance: VAST Data Tech Field Day Showcase

Company: VAST Data

Video Links:

Personnel: John Mao, Neeloy Bhattacharyya

John Mao of VAST Data introduces the company, highlighting its focus on AI workloads and its growth since its founding in 2016. VAST Data has achieved significant success, including raising a Series C round at a $9.1 billion valuation, doubling and tripling software sales annually, and maintaining cash flow positivity. The company has deployed 10 exabytes of data globally, with a 60% business focus on HPC and AI workloads.

Mao announces partnerships with cloud service providers specializing in AI workloads, such as Lambda, Core42, and Genesis Cloud, and mentions enterprise customers like Zoom and Pixar using VAST for AI/ML workloads. He shares the company’s origins, founded on the vision of creating a data center scale computer or “thinking machine,” and outlines the roadmap from storage systems to data management capabilities and transactional storage systems.

VAST Data’s architecture, the disaggregated shared everything model, separates logic from storage, allowing for scalability, reliability, and economic efficiency. This architecture underpins the company’s new capabilities, including a SQL-compliant, transactional, and scalable database called VAST Database, and the VAST Data Engine for event-driven processing. Mao discusses the integration of Apache Spark and Kafka into their platform, enabling containerized compute engines alongside storage. This approach allows for complex data workflows, such as triggering functions upon data ingestion for processing and metadata generation, aiming to provide a comprehensive data platform that extends beyond traditional storage solutions.


Nile Service Block – Unique Capabilities to Redefine the Foundation of Wired and Wireless Networks in the Enterprise

Event: Networking Field Day 34

Appearance: Nile Presents at Networking Field Day 34

Company: Nile

Video Links:

Personnel: Suresh Katukam

In this deep dive, Suresh Katukam from team Nile reviews the determinstic system design, campus zero trust security, and comprehensive data collection capabilities of the Nile Service Block. Purpose built to be delivered as a service for enterprise wired and wireless connectivity across campus and branch locations, Nile Service Block acts as the foundation of the Nile Access Service.


Live Demo – Closed Loop Automation for the Design and Installation of the Nile Service Block

Event: Networking Field Day 34

Appearance: Nile Presents at Networking Field Day 34

Company: Nile

Video Links:

Personnel: Ozer Dondurmacioglu, Shiv Mehra

In this live demo, Shiv Mehra from Nile demonstrates how the design and installation process for a Nile Service Block can be fully automated from site survey, site data gathering, bill-of-material creation, network topology maps, installation instructions and more. Before the demo, Shiv Mehra from Nile also reviews the fundamentals behind the Nile Service Block: vertically integrated Nile wired and wireless network purpose built to be delivered as a service.


Building the Next-Gen Enterprise Network with Nile – New Requirements, Guaranteed Outcomes

Event: Networking Field Day 34

Appearance: Nile Presents at Networking Field Day 34

Company: Nile

Video Links:

Personnel: Ozer Dondurmacioglu, Suresh Katukam

By incorporating day -N to day N operations within the wired and wireless network technology stack, it is in fact possible to guarantee performance for coverage, capacity and availability. With a brand new approach, team Nile is trying to completely eliminate manual workflows in designing, installing and maintaining an enterprise network. Tune in to learn why Nile is converting an enterprise network along with all its environmental context to a collection of data sets to automate its operations.


Delegate Roundtable: Is Cloud Networking More Cloud Or More Networking

Event: Networking Field Day 34

Appearance: Networking Field Day 34 Delegate Roundtable Discussion

Company: Tech Field Day

Video Links:

Personnel: Tom Hollingsworth

Join the Networking Field Day delegates along with Tom Hollingsworth as they discuss the advent of Cloud Networking and how it impacts current networking teams. The discussion encompasses the way that cloud networking is handled and abstracted as well as who should be responsible for performing those tasks and who ultimately does them. In addition, the delegates debate the skill set of a full stack engineer along with the gap between traditional networking learning and modern cloud environments.


Aviz Networks Network Copilot and Networking Enterprise Suite Technical Overview

Event: Networking Field Day 34

Appearance: Introducing Aviz Networks at Networking Field Day 34

Company: Aviz Networks

Video Links:

Personnel: Chid Perumal

In this video, witness live demos of our Open Network Enterprise Suite (ONES) and Network Copilot, showcasing their transformative impact on network management and operations. Explore our suite of products, including the Fabric Test Automation Suite (FTAS) to ensure the quality of SONiC deployments, ONES for advanced network management, Open Packet Broker (OPB) for enhanced network visibility, and Network Copilot for smarter networks.


Aviz Networks Overview and Networking 3.0 Unpacked

Event: Networking Field Day 34

Appearance: Introducing Aviz Networks at Networking Field Day 34

Company: Aviz Networks

Video Links:

Personnel: Ilona Gabinsky

In this introduction, learn how to unlock the potential of your network with our data-centric Networking 3.0 stack, designed for open, cloud, and AI-first networks. The Aviz Networking 3.0 stack redefines the landscape with a vendor-agnostic approach, supporting a wide range of ASICs, switches, clouds, and LLMs. At Aviz we enable open-source SONiC for NOS and open-source LLMs for generative AI. In this video, witness live demos of our Open Network Enterprise Suite (ONES) and Network Copilot, showcasing their transformative impact on network management and operations. Explore our suite of products, including the Fabric Test Automation Suite (FTAS) to ensure the quality of SONiC deployments, ONES for advanced network management, Open Packet Broker (OPB) for enhanced network visibility, and Network Copilot for smarter networks.


Forward Networks How Many Devices Do You Have – Network Lifecycle and Why You Need to Care

Event: Networking Field Day 34

Appearance: Forward Networks Presents at Networking Field Day 34

Company: Forward Networks

Video Links:

Personnel: Michael Wynston

Before Fiserv became a Forward Networks customer, the network team was faced with solving several enterprise network challenges: addressing CVE events, managing the perimeter, audits and compliance findings, and smoothly enabling automation. In this customer testimonial, Michael describes how Forward Enterprise uniquely delivered solutions for the known list of challenges, and also provided unexpected value by lowering the cost of data and validating network intent + network inventory.


The Power of A.I. in a Forward Networks Digital Twin

Event: Networking Field Day 34

Appearance: Forward Networks Presents at Networking Field Day 34

Company: Forward Networks

Video Links:

Personnel: Nikhil Handigol

Nikhil Handigol demonstrates how generative A.I. in unlocks network insights and shows the delegates how Forward Networks now seamlessly incorporates generative A.I. into its network digital twin software. Inside the most popular product feature, Network Query Engine, every user can perform natural language queries to access crucial network data in seconds.


Unlock Network Security and Reliability with a Forward Networks Digital Twin

Event: Networking Field Day 34

Appearance: Forward Networks Presents at Networking Field Day 34

Company: Forward Networks

Video Links:

Personnel: Mike Lossmann

In this product introduction, Mike Lossmann explains the secret sauce inside Forward Network’s flagship digital twin software, Forward Enterprise, and how network digital twin benefits more than just “networking people”. Forward Enterprise analyzes every possible network behavior, traces where every packet could ever go, and gives every user a queryable vendor-independent data model so NetOps, SecOps, CloudOps and even Compliance teams can get a mathematically-accurate view of the network.


Qlik AI Demo Showcase

Event: AI Field Day 4

Appearance: Qlik Presents at AI Field Day 4

Company: Qlik

Video Links:

Personnel: Sean Stauth

Global Director of AI and Machine Learning, Sean Stauth, demonstrates Qlik’s AI capabilities in market today. In this presentation, he showcase the strategic tenants of a trusted AI foundation, the turnkey benefits of AI-enhanced Solutions, and create custom solutions with self-service AI using real-world use cases with proven AI value: sales, operations, human resources, and IT/information security. Demonstrations include a mix of “day-in-the-life” data science/ML engineering development and end-user experiences with applications from both an analyst’s and executive’s points of view.

Stauth begins with a discussion of the strategic tenets of a trusted AI foundation, the benefits of AI-enhanced solutions, and the creation of custom solutions with self-service AI using real-world use cases in sales, operations, human resources, and IT/information security. His demonstrations cover a range of scenarios, including the use of Qlik’s supervised learning AutoML capability, which has been used to develop over 150,000 models.

Stauth demonstrates the “day-in-the-life” of data science and machine learning development, as well as end-user experiences with applications, providing perspectives from both analysts and executives. He shows how to use the AutoML platform to predict customer churn and build predictive applications with what-if scenarios. He also highlights the importance of explainability in AI models, which allows users to understand why predictions are made and ensures trust in the AI system.

Additionally, Stauth demonstrates the integration of generative AI with Qlik apps in operational use cases, the use of Qlik’s AI assistant with Microsoft Teams for collaboration, and key driver analysis built on top of the predictive AI engine. He emphasizes that the goal is not just to build models but to create apps and solutions that deliver real value to end users.

Stauth also addresses questions about the licensing and pricing of Qlik’s AI capabilities, the differentiation between various types of AI, and the importance of having guardrails and ethical considerations in place when using AI. The presentation concludes with a demonstration of generative AI integration using Amazon Bedrock, showcasing how natural language queries can be used to interact with data and derive insights.


Qlik AI-Enhanced and AI Roadmap Deep Dive

Event: AI Field Day 4

Appearance: Qlik Presents at AI Field Day 4

Company: Qlik

Video Links:

Personnel: Nick Magnuson, Ryan Welsh

In this presentation, VP of AI Strategy, Nick Magnuson, will share Qlik’s product direction for helping customers mitigate the risk, embrace the complexity, and scale the impact of AI by creating a trusted AI foundation, benefiting from AI-enhanced solutions, and creating custom solutions with self-service AI. Grounded in market and customer research, he shares how Qlik’s vision for helping customers integrate generative AI across their organizations. Joining Nick is Ryan Welsh, Field CTO and former CEO of Kyndi, an innovator in natural language processing, search, and generative AI, recently acquired by Qlik.

Magnuson outlines a three-pillar strategy for AI implementation: establishing a trusted AI foundation, infusing AI into their data integration and analytics products, and enabling customers to build custom AI solutions. He emphasizes the importance of data foundations, including data veracity, processing, observation, quality, integration, governance, and lineage. He also discusses the use of AI to make data foundation tasks more efficient, such as using natural language to generate SQL queries. He addresses questions about where the AI runs and clarifies that Qlik provides the pipeline for data movement, not a data warehouse, and mentions the acquisition of Talend for enhancing their portfolio.

The presentation includes a discussion about the use of AutoML, which has seen rapid adoption and has helped customers like ARH, a regional health system, save significant amounts of money by predicting patient no-shows and taking appropriate actions. Magnuson also touches upon the roadmap for AI, which includes advanced analytics and time series forecasting. He stresses the importance of feedback in shaping their AI strategy and notes the shift towards practical applications of generative AI in 2023.

Ryan Welsh, Field CTO and former CEO of Kyndi, speaks about the acquisition of Kyndi by Qlik and its implications. Kyndi specialized in natural language processing, search, and generative AI, and their technology aimed to provide trustworthy answers from unstructured text data. Welsh highlights the challenges of making large language models understand domain-specific content and explains how Kyndi’s technology addresses this issue.


Qlik AI Strategy Overview

Event: AI Field Day 4

Appearance: Qlik Presents at AI Field Day 4

Company: Qlik

Video Links:

Personnel: Mary Kern, Nick Magnuson

A recognized leader in analytics and data integration and quality, Qlik is trusted by 40,000 customers and 500 non- profits worldwide to help them use data, analytics and AI to create value by solving theirs and the world’s greatest challenges. In this presentation, VP of Analytics and AI Portfolio Marketing, Mary Kern, introduces Qlik’s strategy for helping organizations mitigate the risk, embrace the complexity, and scale the impact of AI.

Kern highlights Qlik’s history of innovation in visual analytics and its continued efforts in analytics, data integration, data quality, AI, and automation. She notes that Qlik supports over 40,000 organizations and 500 NGOs worldwide in leveraging data and AI to solve significant challenges. Kern discusses how Qlik took a step back to understand what organizations want from generative AI, finding that companies seek a partner to help them safely embrace AI, manage its complexity, and scale its positive impact. Qlik aids customers in building a trusted foundation for AI through broad data connectivity, intelligent data pipelines, data transformation engines, robust data catalogs, and lineage for traceability and trust.

Qlik offers turnkey AI solutions, enabling organizations to scale data-driven decisions across their teams through automated insights, natural language experiences, proactive alerts, and notifications. They also provide self-service AI solutions, including AutoML, data science, and generative AI offerings, under the umbrella of Qlik Stage. This set of solutions is designed to bring AI strategies to life while minimizing risk, handling complexity, and maximizing AI’s impact. Kern explains that Qlik has been an AI-enhanced analytics leader for years, using early LLMs like BERT to deliver prompt experiences in analytics. Qlik’s Insight Advisor acts as an AI assistant, helping developers auto-generate visualizations and dashboards, and enabling business users to ask questions and receive relevant answers in various formats and languages.

Qlik’s acquisition of predictive and AutoML capabilities allows customers to scale their data science investments by creating machine learning models to solve business problems. Kern cites examples of customers using Qlik’s AI capabilities, such as Airbus, Schneider Electric, and JB Hunt. During the Q&A, Kern and her colleague Nick elaborate on Qlik’s AutoML, which makes modeling more accessible to technical users. They discuss Qlik’s ability to handle both structured and unstructured data, with a focus on integrating data from diverse sources to find patterns that humans cannot interpret alone. They emphasize Qlik’s agnostic approach to data sources and its support for direct queries and in-memory computation to manage data effectively. The conversation also touches on Qlik’s use of open-source algorithms and standardized practices in AutoML. The company aims to simplify the process from experimentation to deployment, allowing users to easily integrate AI and machine learning into their existing Qlik dashboards and decision-making processes. Qlik’s platform facilitates the ingestion of data, transformation, and deployment of AI solutions without requiring heavy customer engagement or complex hardware setups.


Wherever There’s Data, There’s Possibility with Qlik

Event: AI Field Day 4

Appearance: Qlik Presents at AI Field Day 4

Company: Qlik

Video Links:

Personnel: Miranda Foster

Miranda Foster, VP of Corporate Communications, kicks off Qlik’s “Wherever There’s Data, There’s Possibility” session at AI Field Day with an overview of objectives, speakers, and presentations.

Foster welcomes attendees and outlines the agenda for the session. She highlights that AI is a critical component of Qlik’s company strategy, portfolio growth, and market approach. She mentions a recent acquisition of Kyndi, a company related to their AI portfolio.

Miranda then introduces the speakers for the session and also announces their user conference, Click Connect, scheduled to take place in Orlando from June 3rd to 5th.


Taming Unstructured Data Orchestration with Hammerspace

Event: AI Field Day 4

Appearance: Hammerspace Presents at AI Field Day 4

Company: Hammerspace

Video Links:

Personnel: Chad Smith, Floyd Christofferson

In this session, Floyd Christofferson and Chad Smith from Hammerspace will step through the key capabilities of Hammerspace Global Data Environment software, and how it automates unstructured data orchestration across multi-vendor, multi-site, and often multi-cloud storage environments. It will focus specifically on solutions to the problems of when data that is needed for AI pipelines is distributed across silos, sites, and clouds.

Christofferson and Smith discuss the capabilities of Hammerspace’s Global Data Environment software for automating unstructured data orchestration across various storage environments, including multi-vendor, multi-site, and multi-cloud infrastructures. They focus on how this can be particularly beneficial for AI workflows, where data is often distributed across different locations and silos.

Hammerspace’s solution involves separating file system metadata from the actual data, elevating it above the infrastructure layer into a global metadata control plane. This allows for a common view of files across different storage systems and locations, enabling transparent and automated data orchestration without disrupting user access or requiring data movement.

The software is Linux-based and includes two components: Anvil servers for metadata control and DSX nodes for I/O handling. It supports multi-protocol access, including NFS, parallel NFS, and S3, and allows for the setting of objective-based policies for data management, including protection, tiering, and geographical considerations.

Hammerspace can be installed on various platforms, including bare metal, cloud instances, and VMs, and it facilitates seamless integration of on-premises storage with cloud resources. This enables use cases like bursting AI workloads to the cloud, managing data across global sites, and optimizing compute resource costs by automating data movement to the most cost-effective locations.

Floyd provides examples of Hammerspace’s application in different industries, such as online gaming, rocket company Blue Origin, and a data center in London that saves costs by orchestrating render jobs to cheaper cloud regions.


Accelerating AI Pipelines with Hammerspace

Event: AI Field Day 4

Appearance: Hammerspace Presents at AI Field Day 4

Company: Hammerspace

Video Links:

Personnel: Chad Smith, Floyd Christofferson

In this session, Floyd Christofferson and Chad Smith from Hammerspace will look at solutions to achieve HPC-class performance to feed GPU-based AI pipelines while leveraging data in place on existing storage resources. This session will give real-world examples of how customers have adapted their existing infrastructure to accommodate the performance levels needed for AI and other high-performance workflows.

Christofferson and Smith discuss how Hammerspace can accelerate AI pipelines by addressing the challenges of managing and accessing unstructured data across various storage systems and locations. They introduce the concept of a global data environment that leverages a parallel global file system, allowing data to remain in place while providing high-performance access necessary for AI workloads. They begin by explaining the silo problem in AI pipelines, where unstructured data is spread across multiple storage types and locations, making it difficult to aggregate without moving it to a new repository. Hammerspace’s solution allows for the assimilation of file system metadata from existing storage, enabling a global view and access to data without physically moving it. This approach prevents copy sprawl, maintains data governance, and avoids additional capital and operational expenses.

The session highlights the introduction of a new product, Hammerspace Hyperscale NAS, which provides HPC-class parallel file system performance using standard protocols and networking, without requiring proprietary clients or altering existing infrastructure. This solution is said to be storage agnostic and can accelerate existing third-party storage, making it suitable for enterprises looking to incorporate AI workflows without significant upfront investment. The duo provides real-world examples, including a hyperscaler with a large AI training and inferencing environment, where Hammerspace’s technology enabled scalability without altering the existing infrastructure. Another example is a visual effects customer who achieved the required performance for rendering without changing their storage infrastructure.


Nature Fresh Farms – Maximizing Greenhouse Yield Using AI Powered by Intel

Event: AI Field Day 4

Appearance: Nature Fresh Farms Presents with Intel at AI Field Day 4

Company: Intel, Nature Fresh Farms

Video Links:

Personnel: Keith Bradley

Keith Bradley, VP of IT and Security at Nature Fresh Farms, presented on how the company uses AI to maximize greenhouse yield. Nature Fresh Farms is a 250-acre greenhouse operation that grows bell peppers, tomatoes, cucumbers, and strawberries in a controlled environment, focusing on increasing yield per square meter. They started 23 years ago with a 16-acre greenhouse and a data-forward approach, using computers to control the environment.

Over the years, they have developed around 32 AI models for different aspects of the farm, such as plant growth, pest control, and resource management. These models help the greenhouse transition from a reactive to a proactive state, optimizing conditions before weather changes affect the plants. The models rely on various sensors that collect data on light, CO2 levels, irrigation, and plant nutrition. The technology infrastructure includes a core data center where all the sensor data is aggregated and analyzed.

Nature Fresh Farms has seen a consistent increase in yield due to their AI models and has a closed-loop water system that recycles 99% of the water used. They also utilize natural gas to heat the greenhouses and capture CO2 emissions to stimulate plant growth.

Keith’s team consists of a small DevOps team that works closely with growers to collect and analyze data, which is then used to optimize the entire process from growing to shipping. The team is mostly in-house, with some contributions from vendors, especially from Europe. The company’s IT infrastructure is built on a hyper-converged system that allows them to scale easily and maintain high availability, which is critical as even a few hours of downtime can significantly impact the crops.

The presentation highlighted the real-world financial impact of AI in agriculture, moving beyond stereotypes of AI applications and demonstrating tangible benefits in optimizing greenhouse operations.


Deploy AI Everywhere From Edge to Data Center and Cloud with Intel

Event: AI Field Day 4

Appearance: Intel Presents at AI Field Day 4

Company: Intel

Video Links:

Personnel: Ronak Shah

In this session, Ronak Shah, AI Product Director at Intel’s Data Center and AI Group, reflects on the full day of presentations at AI Field Day 4. In addition to Intel, the day included representatives from Nature Fresh Farms, VMware by Broadcom, Google Cloud, and Kamiwaza. He emphasizes the prevalence of AI deployments, particularly inferencing on CPUs, and why many customers opt for this approach.

  • Nature Fresh Farms is highlighted as a case study for meeting critical requirements using CPUs without the need to transition to other hardware, thus simplifying infrastructure and managing costs.
  • VMware’s perspective is summarized with the phrase “use CPUs when you can and GPUs when you must,” demonstrating that CPUs are sufficient for many smaller inferencing tasks.
  • Google Cloud’s input supports the notion that the majority of inference work is done on CPU instances, especially among enterprise customers with real-time, smaller models.
  • Kamiwaza’s contribution underlines the challenges of deploying AI systems and the importance of partners that simplify the journey for customers. The ease of deployment with CPUs and the quick adaptation to new generations, such as the fifth-gen Xeon, are also discussed.

The conversation touches on the evolving AI landscape, the need for education on AI deployment, and the importance of software in maximizing hardware potential.