Deploying a LLM-based application is a complex multi-step process that requires the right combination of hardware and software for a robust AI/ML platform. Dell APEX Cloud Platform for Red Hat OpenShift reduces this complexity by providing an AI/ML solution for data scientists and data engineers to seamlessly deploy a LLM model.
We deployed a LLM based digital assistant using Red Hat OpenShift AI on Dell APEX Cloud Platform for Red Hat OpenShift. The goal of this solution is to enable users to ask queries related to domain specific data and get accurate answers to the questions within the scope of the digital assistant. This chapter describes the necessary steps to deploy and configure the overall solution.