Your Browser is Out of Date

Nytro.ai uses technology that works best in other browsers.
For a full experience use one of the browsers below
Design Guide—Implementing a Digital Assistant with Red Hat OpenShift AI on Dell APEX Cloud Platform
Introduction Solution Concepts Solution Architecture and Requirements Solution Deployment
Introduction
Dell APEX Cloud Platform for Red Hat OpenShift
Object storage
Digital assistant deployment and configuration
Model serving environment
Data science project in Red Hat OpenShift AI
Project Workbench
LLM model preparation
Model deployment
Redis deployment
Document embeddings
Gradio deployment
Deployment summary
Solution execution Summary References Open-Source License

Deployment summary

Deployment summary

  • Caikit was deployed to serve the Llama 2 model, TGI provided text generation, and Gradio and LangChain were used for the user interface and tool integration. The Llama 2 model was served using Caikit. Redis database was also deployed and the documents were embedded into its vector store.