Overview

Implementing a digital assistant with Red Hat OpenShift AI on Dell APEX Cloud Platform for Red Hat OpenShift has been created to address the needs of organizations that need to develop and run a custom LLM-based application using domain-specific information that is relevant to their own organization.

The technology behind AI is evolving at a rapid phase, and companies might lack AI experts or the time to design, deploy, and manage solution stacks at the necessary pace. Dell Technologies provides validated design guidance to enable customers to build their own AI solutions on Dell APEX Cloud Platform for Red Hat OpenShift with speed and confidence. Validated workload-optimized architectures can reduce customer proof-of-concept time and eliminate months of design and testing time that is required to plan correct configurations prior to the deployment.

Dell Technologies and Red Hat have teamed up to deliver customers a full-stack AI solution built on the Dell APEX Cloud Platform for Red Hat OpenShift utilizing Red Hat OpenShift AI. The partnership between Dell and Red Hat provides a powerful solution that brings reliability, performance, and scalability to AI workloads. Red Hat OpenShift AI offers organizations an efficient way to deploy an integrated set of common open-source and third-party tools to perform AI/ML modeling.

Building, deploying, and managing a LLM-based application can be complex. In this validated design, we have provided design guidance on deploying real-world LLM-based digital assistant on Dell APEX Cloud Platform for Red Hat OpenShift using Red Hat OpenShift AI and have successfully demonstrated the RAG capabilities to provide domain specific context to the LLM.