Your Browser is Out of Date

Nytro.ai uses technology that works best in other browsers.
For a full experience use one of the browsers below
Digital Assistant with Red Hat OpenShift AI on Dell APEX Cloud Platform for Red Hat OpenShift
Introduction Business challenges Solution overview
Solution overview
Solution benefits Partner overview Technology overview Solution architecture Solution deployment Digital assistant demonstration Conclusion References

Solution overview

Home > AI Solutions > Artificial Intelligence > White Papers > Digital Assistant with Red Hat OpenShift AI on Dell APEX Cloud Platform for Red Hat OpenShift > Solution overview

Solution overview

  • In this solution, we present a LLM based digital assistant that can answer user queries that are related to a domain specific knowledge base.

    A text based search is a search technique that looks for matches of a query within the entire text of a set of documents. It searches for all occurrences of the words or phrases that are specified in the query, regardless of the context within the document. As text-based searches are limited in obtaining the right data, a digital assistant can help retrieve more accurate and relevant results using semantic search. Semantic search is a more advanced search technique which takes the context, synonyms, related terms, and overall meaning of the query into consideration to retrieve more relevant information.

    This solution is designed using separate nodes for control plane, compute plane, block, and object storage, which enables nodes to scale independently based on compute and storage requirements.

    Dell APEX Cloud Platform for Red Hat OpenShift is designed in collaboration with Red Hat to optimize and extend OpenShift deployments on-premises with an integrated operational experience.

    The Red Hat OpenShift Container Platform provides a robust containerization and Kubernetes-based orchestration framework that enables organizations to build, deploy, and manage applications and databases efficiently across on-premises and multicloud environments.

    Utilizing object storage for LLMs and huge datasets is crucial for modern data-driven applications, due to their reliability and scalability. Dell ObjectScale object storage is leveraged in this solution to store Llama 2 model, relevant datasets, and artifacts. Dell ObjectScale is a software-defined enterprise-grade object storage. Built with a scale-out architecture, ObjectScale clusters can expand from a few terabytes to petabytes and beyond without limits on the number of object stores, buckets, or objects.

    Red Hat OpenShift AI offers organizations an efficient and supported way to deploy an integrated set of common open-source and third-party tools to perform ML modeling. The ML models developed using Red Hat OpenShift AI are portable to deploy in production, on containers, on-premises, at the edge, or in the public cloud.