Nutanix GPT-in-a-Box Solution Simplifies Generative AI Adoption

Nutanix, a provider of hybrid multicloud computing, has launched a new offering for customers trying to jump-start their machine learning and AI innovation. Nutanix GPT-in-a-Box is an AI-ready platform that lets users maintain control over their data.

In addition, Nutanix provides services to help organizations size and configure hardware and software infrastructure that can then deploy a curated set of large language models (LLMs) using the leading open-source AI and MLOps frameworks on the platform. It allows customers to easily get AI-ready infrastructure to fine-tune and run generative pre-trained transformers (GPT), including LLMs at the edge or in their data center, the company said.

Moreover, Nutanix provides a full complement of security and data protection offerings ideal for AI data protection.

Helping customers tackle the biggest challenges they face in IT is at the core of what the company does, said Thomas Cornely, SVP, product management at Nutanix.

Nutanix’s Thomas Cornely

“[We] manage increasing multicloud complexity to data protection challenges, and now adoption of generative AI solutions, while keeping control over data privacy and compliance,” Cornely said. “Nutanix GPT-in-a-Box is an opinionated AI-ready stack that aims to solve the key challenges with generative AI adoption.”

The Ins and Outs of this Generative AI Solution

This new solution includes Nutanix Cloud Infrastructure platform, with the Nutanix Files Storage^, and Objects Storage solutions, the Nutanix AHV hypervisor and Kubernetes, along with Nvidia GPU acceleration, which can be sized for large to small scale.

Nutanix services help customers size their cluster and deploy an opinionated stack with the leading open-source deep learning and MLOps frameworks, inference server and a curated set of large language models such as Llama2, Falcon and MPT.

The platform allows data scientists and ML administrators to immediately consume these models with their choice of applications, enhanced terminal UI or standard CLI.

The platform can also be harnessed to run other GPT models, as well as fine tuning these models to leverage internal data, host on included Nutanix Files or Objects Storage services.

Many enterprises are grappling with how to quickly, efficiently and securely take advantage of the power of generative AI and AI/ML applications. This is especially the situation for use cases that cannot be run in the public cloud because of data sovereignty, governance and privacy concerns.

New use cases emerge every day as organizations look to utilize generative AI to improve customer service, developer productivity, operational efficiency and more. Many organizations see the opportunity with AI but are struggling with growing concerns regarding intellectual property leakage, compliance and privacy, Nutanix officials said. Additionally, organizations looking to build an AI-ready stack often struggle with how to best support ML administrators and data scientists, while the prospect of large AI investment costs has enterprises stalled in their AI and ML strategy.

IDC’s Greg Macatee

Customers struggle to balance the deep expertise required to install, configure and run workloads while dealing with their concerns around data security and protecting company IP. They also must control costs, said Greg Macatee, senior research analyst, infrastructure systems, platforms and technologies group at IDC.

“With GPT-in-a-Box, Nutanix offers customers a turnkey, easy-to-use solution for their AI use cases, offering enterprises struggling with generative AI adoption an easier on-ramp to deployment,” Macatee said.