Home > Servers > Specialty Servers > White Papers > Deploy GenAI on the PowerEdge XE9680 with Intel® Gaudi®3 Accelerators > Software configuration
Software configuration | PowerEdge XE9680 with 5th Generation Intel® Xeon® Processors |
Workload Orchestrator MLOps Platform | Kubernetes/Kubeflow 1.27.7 Kubeflow 1.27.7 |
Foundational Models | HuggingFace, Meta – LLAMA3-8B/70B
|
Gaudi® SW | Synapse v. 1.17.1 |
AI Frameworks & Toolkits | PyTorch 2.3.1, Optimum Habana 1.13.1, DeepSpeed 1.17.0, TGI 2.0.5, vLLM-fork v0.4.2 PEFT 0.11.1
|