Your Browser is Out of Date

Nytro.ai uses technology that works best in other browsers.
For a full experience use one of the browsers below
Design Guide—Implementing a Digital Assistant with Red Hat OpenShift AI on Dell APEX Cloud Platform
Introduction Solution Concepts Solution Architecture and Requirements Solution Deployment
Introduction
Dell APEX Cloud Platform for Red Hat OpenShift
Object storage
Digital assistant deployment and configuration
Model serving environment
Data science project in Red Hat OpenShift AI
Project Workbench
LLM model preparation
Model deployment
Redis deployment
Document embeddings
Gradio deployment
Deployment summary
Solution execution Summary References Open-Source License

Digital assistant deployment and configuration

Home > AI Solutions > Artificial Intelligence > Guides > Design Guide—Implementing a Digital Assistant with Red Hat OpenShift AI on Dell APEX Cloud Platform > Digital assistant deployment and configuration

Digital assistant deployment and configuration

  • Overview

    Deploying a digital assistant involves multiple steps, which includes preparing the environment and validating, deploying, and configuring the components. In this section we will briefly discuss the digital assistant deployment process.

    Prerequisites

    The following sections describe perquisites to the solution deployment.

    Configuring container registry

    OpenShift Container Platform provides an internal, integrated container image registry that can be deployed to locally manage container images in the Red Hat OpenShift Container Platform cluster environment.

    Follow the steps described in the GitHub repository to configure OpenShift Internal registry.

    Node Feature Discovery Operator deployment

    The Node Feature Discovery Operator (NFD) manages the detection of hardware configuration and features in an OpenShift Container Platform cluster by labeling the nodes with node-specific attributes, such as PCI cards, kernel, operating system version, and so on.

    Follow the steps described in GitHub repository to Install NFD Operator.

    Installing Nvidia GPU Operator

    The NVIDIA GPU Operator uses the operator framework available within Kubernetes to automate the management of all NVIDIA software components needed to provision GPU. The Node Feature Discovery (NFD) Operator is a prerequisite for the NVIDIA GPU Operator.

    Follow the steps described in GitHub repository to Install Nvidia GPU Operator.

    Red Hat OpenShift AI

    Red Hat OpenShift AI is an open-source machine learning platform. Red Hat OpenShift AI provides pre-configured tools and libraries that allows data scientists and developers to rapidly train, deploy, and monitor ML workloads and models on-premises and in the public cloud.

    Installing Red Hat OpenShift AI involves the following high-level tasks:

    • Confirm that your OpenShift cluster meets all requirements.
    • Configure an identity provider and add administrative users.
    • Subscribe to the OpenShift AI (RHODS) Add-on and install it.
    • Access and verify the OpenShift Data Science dashboard.

    For more information regarding installing Red Hat OpenShift AI, see the Red Hat web page.