The following figure shows the hardware used at the rack level in this reference architecture. In addition to servers and switches, the rack includes power distribution units (PDUs) and the cables that are required for network connectivity.
Figure 5. Ready Architecture for OpenShift Platform rack diagram
DevOps teams who manage large numbers of servers typically purchase servers of almost identical configuration to simplify the management of cluster nodes and the movement of servers from rack to rack, from cluster to cluster, or within a cluster. Dell EMC recognizes the benefits of uniformity in server node configuration.
This ready architecture uses a single base configuration for the PowerEdge R640 nodes that are used in the cluster role nodes: master, infrastructure, application/workload, and storage. Infrastructure nodes require the addition of two NVMe drives to this baseline configuration.
We applied the same concept to the configuration for the larger 2U PowerEdge R740xd storage node servers. The following table shows the PowerEdge Server R640 baseline configurations used in the reference architecture:
Important: At the time of ordering, new SKUs will be added and local current SKUs will replace those shown in the table.
Table 3. PowerEdge R640 baseline server configuration
Qty |
SKU |
Description |
1 |
210-AKWU |
PowerEdge R640 Server |
1 |
329-BDKC |
PowerEdge R640 motherboard |
1 |
321-BCQQ |
2.5 in. chassis with up to 10 hard drives, 8 NVMe drives, and 3 PCIe slots, 2 CPU only |
1 |
338-BLMH |
Intel Xeon Gold 6138 2.0 G, 20C/40T, 10.4 GT/s, 27 M Cache, Turbo, HT (125W) DDR4-2666 |
1 |
374-BBOC |
Intel Xeon Gold 6138 2.0 G, 20C/40T, 10.4GT/s, 27 M Cache, Turbo, HT (125W) DDR4-2666 |
1 |
370-ABWE |
DIMM blanks for system with 2 processors |
2 |
412-AAIQ |
Standard 1U Heatsink |
1 |
370-ADNU |
2,666 MT/s RDIMMs |
1 |
370-AAIP |
Performance-optimized |
12 |
370-ADNF |
32 GB RDIMM 2,666 MT/s dual rank |
1 |
405-AAJU |
HBA330 12 Gbps SAS HBA Controller (NON-RAID), minicard |
1 |
403-BBPZ |
BOSS controller card + with 2 M.2 Sticks 240 G (RAID 1), LP |
1 |
385-BBKT |
iDRAC9, Enterprise |
1 |
379-BCQV |
iDRAC Group Manager, enabled |
1 |
379-BCSG |
iDRAC, legacy password |
1 |
385-BBLG |
Static IP |
1 |
330-BBGN |
Riser Config 2, 3 x 16 LP |
1 |
406-BBLG |
Mellanox ConnectX-4 Lx Dual Port 25 GbE SFP 28 rNDC |
1 |
406-BBLD |
Mellanox ConnectX-4 Lx dual port 25 GbE SFP28 network adapter, low profile |
1 |
429-AAIQ |
No internal optical drive |
1 |
384-BBQI |
8 performance fans for the R640 server |
1 |
450-ADWS |
Dual, hot-plug, redundant power supply (1+1), 750W |
2 |
492-BBDH |
C13 to C14, PDU Style, 12 AMP, 2 ft. (.6m) power cord, North America |
1 |
800-BBDM |
UEFI BIOS boot mode with GPT partition |
1 |
770-BBBC |
ReadyRails sliding rails without cable management arm |
1 |
366-0193 |
Std Bios setting power management* - maximum performance |
2 |
400-AWLD |
Dell 1.6TB, NVMe, Mixed Use Express Flash, 2.5 SFF Drive, U.2, P4610 with Carrier, CK |
The following table shows the PowerEdge Server R740xd baseline configurations used in the reference architecture:
Important: At the time of ordering, new SKUs will be added and local current SKUs will replace those shown in the table.
Table 4. PowerEdge R740xd baseline server configuration
Qty |
SKU |
Description |
1 |
210-AKZR |
PowerEdge R740XD Server |
1 |
329-BDKH |
PowerEdge R740/R740XD motherboard |
1 |
321-BCRC |
Chassis up to 24 x 2.5 in. hard drives including 12 NVME drives, 2 CPU configuration |
1 |
338-BLMH |
Intel Xeon Gold 6138 2.0G, 20C/40T, 10.4GT/s, 27 M Cache, Turbo, HT (125W) DDR4-2666 |
1 |
374-BBOC |
Intel Xeon Gold 6138 2.0G, 20C/40T, 10.4GT/s, 27 M Cache, Turbo, HT (125W) DDR4-2666 |
1 |
412-AAIQ |
Standard 1U Heatsink |
1 |
370-ADNU |
2,666 MT/s RDIMMs |
12 |
370-ADNF |
32GB RDIMM 2,666 MT/s dual rank |
1 |
780-BCDI |
No RAID |
1 |
405-AANK |
HBA330 controller adapter, low profile |
1 |
365-0354 |
CFI, standard option not selected |
1 |
403-BBPT |
BOSS controller card + with 2 M.2 Sticks 240G (RAID 1), FH |
1 |
385-BBKT |
iDRAC9, Enterprise |
1 |
379-BCQV |
iDRAC Group Manager, enabled |
1 |
379-BCSG |
iDRAC, legacy password |
1 |
385-BBLG |
Static IP |
1 |
330-BBHD |
Riser Config 6, 5 x 8, 3 x1 6 slots |
1 |
406-BBLG |
Mellanox ConnectX-4 Lx Dual Port 25 GbE SFP28 rNDC |
1 |
406-BBLE |
Mellanox ConnectX-4 Lx Dual Port 25 GbE SFP28 network adapter |
1 |
384-BBPZ |
6 performance fans for R740/740XD |
1 |
450-ADWM |
Dual, hot-plug, redundant power supply (1+1), 1100W |
1 |
492-BBDH |
C13 to C14, PDU Style, 12 AMP, 2 ft (.6m) power cord, North America |
1 |
325-BCHU |
PowerEdge 2U standard bezel |
1 |
800-BBDM |
UEFI BIOS Boot Mode with GPT partition |
1 |
770-BBBQ |
ReadyRails sliding rails without cable management arm |
1 |
366-0193 |
Std Bios setting power management - maximum performance |
Select ONE of the rows below |
||
24 |
Check part at order time |
800 GB, 1.92 TB, or 3.84 TB SSD SAS Mix Use 12 Gbps 512e 2.5 in. hot-plug AG drive, 3 DWPD, 4380 TBW, CK |
12 |
Check part at order time |
Dell 1.6 TB, 3.2 TB or 6.4 TB, NVMe, mixed use express flash, 2.5 SFF drive, U.2, P4610 with Carrier, CK |
The following table describes the hardware configuration that is required to build the cluster design that we used for our validation work:
Table 5. Cluster configuration
Node name |
Qty. |
Configuration |
Bastion |
1 |
Dell EMC PowerEdge R640 baseline server configuration |
Master |
3 |
Dell EMC PowerEdge R640 baseline server configuration |
Infrastructure |
3 |
Dell EMC PowerEdge R640 baseline server configuration Add to each node: 2 x Dell 1.6 TB, NVMe, mixed use express flash, 2.5 in. SFF drive, U.2, P4610 with Carrier, CK (SKU 400-AWLD) |
Application |
4 or more |
Dell EMC PowerEdge R640 baseline server configuration |
Storage |
4 or more |
Dell EMC PowerEdge R740xd baseline server configuration |
The following table provides additional cluster configuration information:
Table 6. Additional cluster configuration reference information
Quantity |
Description |
Dell EMC reference |
1* |
Rack enclosure: APC AR3300 NetShelter SZ 42U |
|
1** |
Management switch: Dell EMC Networking S3048-ON |
|
2 |
Data switch: Dell EMC Networking S5248F-ON |
|
11 |
Bastion, infrastructure, master, application nodes: Dell EMC PowerEdge R640 |
|
4 |
Storage nodes: Dell EMC PowerEdge R740xd |
|
Dell EMC PowerEdge R640** |
||
2-4* |
Power distribution unit APC metered rack PDU 17.2 kW |
|
*Rack enclosures and power distribution units are site-specific. The physical dimensions and power requirements must be reviewed during a site survey.
**The configuration of the Dell EMC PowerEdge Server R640 equipped with 10 x NVMe SSD drives serving as storage nodes has been validated.