Nodes

4 x Dell APEX MC-760

Server Model

Dell APEX MC-760

CPU

2 X Intel(R) Xeon(R) Platinum 8462Y+

GPU

NVIDIA A2

Memory

512 GB (16 X 32 GB, DDR-5,4800 MT/s)

Storage Controller

BOSS-N1 Monolithic

Dell HBA355i

Drives

2 X 894 GB NVMe SSD

24 X 745 GB SAS SSD

NICs

Broadcom Adv. Dual 25 Gb Ethernet, 2 port

Broadcom Adv. Dual 25 Gb Ethernet, 2 port

PSU

Dual, Redundant (1+1), Hot-Plug PSU,1800 W

Server BIOS version

1.5.6

iDRAC

6.10.85.00

GPU

94.07.5B.00.92

System CPLD

1.0.5

Dell OS Driver Pack

23.03.07

Identity Module

0.06

Power Supply

00.42.B2

TPM

7.2.2.0

HBA355i

24.15.10.00

BOSS-N1

2.1.13.2021

Broadcom Adv. Dual 25 Gb Ethernet

22.31.13.70

Broadcom NetXtreme Gigabit Ethernet

22.31.6

Server OS

RHCOS 4.13

Red Hat OpenShift Container Platform

4.13.12

Kubernetes

1.26.7

APEX Cloud Platform Foundation Software

03.00.00.00

Red Hat OpenShift Data Science

2.2.0

Red Hat OpenShift serverless

1.30.1

Red Hat OpenShift service mesh

2.4.4-0

Red Hat OpenShift distributed tracing platform

1.47.0-2

Nvidia GPU operator

23.6.1

Node Feature Discovery operator

4.13.0

Redis enterprise operator

7.2.4

Kiali operator

1.65.9

Python

3.11.4

LangChain

0.0.301

Llama 2

Llama-2-7b-Chat-hf

Gradio

3.46.1

Caikit

0.22.0

Caikit-nlp

0.2.1

TGI

1.1.0

Redis

2.8.4