Your Browser is Out of Date

Nytro.ai uses technology that works best in other browsers.
For a full experience use one of the browsers below
Design Guide—Implementing a Digital Assistant with Red Hat OpenShift AI on Dell APEX Cloud Platform
Introduction Solution Concepts Solution Architecture and Requirements Solution Deployment
Introduction
Dell APEX Cloud Platform for Red Hat OpenShift
Object storage
Digital assistant deployment and configuration
Model serving environment
Data science project in Red Hat OpenShift AI
Project Workbench
LLM model preparation
Model deployment
Redis deployment
Document embeddings
Gradio deployment
Deployment summary
Solution execution Summary References Open-Source License

Introduction

Home > AI Solutions > Artificial Intelligence > Guides > Design Guide—Implementing a Digital Assistant with Red Hat OpenShift AI on Dell APEX Cloud Platform > Introduction

Introduction

  • Deploying a LLM-based application is a complex multi-step process that requires the right combination of hardware and software for a robust AI/ML platform. Dell APEX Cloud Platform for Red Hat OpenShift reduces this complexity by providing an AI/ML solution for data scientists and data engineers to seamlessly deploy a LLM model.

    We deployed a LLM based digital assistant using Red Hat OpenShift AI on Dell APEX Cloud Platform for Red Hat OpenShift. The goal of this solution is to enable users to ask queries related to domain specific data and get accurate answers to the questions within the scope of the digital assistant. This chapter describes the necessary steps to deploy and configure the overall solution.