Architecture Overview

Physical architecture overview

Physical Layout

The following figure shows the physical architectural layout of the Ready Solution for Oracle with an XtremIO X2 storage array.

The figure also shows the high level connectivity between the various major components in the Ready Solutions for Oracle. A single point of failure is eliminated for all the critical hardware components, as follows:

Each of the database servers consists of highly available LAN and SAN connectivity with multiple network interface cards (NICs) and multiple host bus adapters (HBAs).
Two dual-port 10 GbE NICs and two dual-port 16 Gb/s HBAs in each database server provide sufficient bandwidth and high availability for Oracle database LAN and SAN traffic.
Redundant network ports are connected to separate 10 GbE switches for HA and bandwidth in case of failure.
HBA ports on the same HBA adapters are connected to separate FC switches for HA and bandwidth in case of failure.
Redundant ToR S4048-ON 10 Gb Ethernet switches provide sufficient 10 Gb ports and bandwidth to share both Oracle database public and private interconnect traffic. These switches also provide sufficient 40 GbE uplink ports to connect the Ready Solution for Oracle to the datacenter core switches.
Redundant DS-6510B 16 Gb/s Fibre Channel (FC) switches provide sufficient ports and bandwidth to share Oracle database SAN traffic between the database servers and the XtremIO X2 storage controllers.
A dual X-Bricks XtremIO X2 cluster storage array with redundant and active-active storage controllers provide sufficient capacity, bandwidth, and high availability for all the Oracle databases tested in the Ready Solution for Oracle.
Each FC port in each XtremIO X2 storage controller is connected to separate FC switches for high bandwidth and high availability (HA).
A management port from each major hardware component is connected to S3048-ON 1 GbE management switch.
On each of the database servers:
A dedicated iDRAC network port is connected to the management switch for out-of-band, bare-metal management of the server
The 1 GbE LAN on motherboard (LOM) network ports is connected to the management switch for in-band management of the server from within the operating system

Hardware components and sizing

The following table lists the major hardware components in the Ready Solution for Oracle with XtremIO X2 storage.

Table 2. Ready Solution for Oracle with XtremIO X2 storage: Components overview

Component	Description
Database servers	2 x Dell EMC 4S PowerEdge R940 servers for physical production databases 1 x Dell EMC 4S PowerEdge R940 server for virtual databases 1 x Dell EMC 2S PowerEdge R740 server for physical XVC databases
LAN switches	2 x Dell EMC Networking S4048-ON 10 Gb Ethernet switches
SAN switches	2 x Dell EMC Connectrix DS6510-B 16 Gb/s FC switches
Management switch	1 x S3048-ON 1 Gb Ethernet switch
Storage array	Dual X-Bricks XtremIO X2 cluster

Compute

The following table lists the hardware details of the database servers used for physical production databases in the Ready Solution for Oracle with XtremeIO X2 storage.

Table 3. Ready Solution for Oracle with XtremIO X2 storage: Physical production database server components

Component	Description
Servers	2 x PowerEdge R940 servers
Chassis	2.5” chassis with up to 8 hard drives
Processor per server	4 x Intel Xeon Gold 6150 18c 2.7 GHz
Memory per server	1,536 GB (24 x 64 GB QR DDR4 2666MT/s LRDIMMs)
Local disks per server	3 x 1.2 TB 10 K SAS 12 Gb/s 2.5 in. HDDs (includes 1 hot spare)
RAID controller	PERC H740P/H730P
iDRAC	iDRAC9 Enterprise
rNDC	Broadcom 5720 QP 1 Gb Base-T rNDC
Add-on NICs per server	2 x Broadcom 57412 DP 10 Gb SFP+ PCIe adapter
HBAs per server	2 x Emulex LPe31002-M6-D DP 16 Gb/s FC HBAs
Power supplies per server	2 x 1,600 W

Table 3. Ready Solution for Oracle with XtremIO X2 storage: Physical XVC databases server components

Component	Description
Server	1 x PowerEdge R740 server
Chassis	8 x 2.5 in. SAS/SATA hard disk drives (HDDs) for 2 CPU configuration
Processor	2 x Intel Xeon Gold 6136 12c 3.0 GHz
Memory	768 GB (24 x 32 GB DR DDR4 2667 MT/s RDIMMs)
Local disks	3 x 1.2 TB 10 K SAS 12 Gb/s 2.5 in. HDDs (includes 1 hot spare)
RAID controller	PERC H740P Adapter
iDRAC	iDRAC9 Enterprise
rNDC	Broadcom 5720 DP 1Gb + 57412 DP 10Gb NetXtreme- E rNDC
Add-on NICs	None
HBAs	2 x Emulex LPe16002B-M6-D DP 16 Gb/s FC HBAs
Power supply	2 x 1,100 W

Table 3. Ready Solution for Oracle with XtremIO X2 storage: Virtualized databases server components

Component	Description
Servers	1 x PowerEdge R940 server
Chassis	2.5” chassis with up to 8 hard drives
Processor	4 x Intel Xeon Gold 6150 18c 2.7 GHz
Memory	1,536 GB (48 x 32 GB DR DDR4 2667 MT/s RDIMMs)
Local disks	8 x 1.6 TB SAS 12 Gb/s 2.5 in. SSDs
RAID controller	PERC H740P
iDRAC	iDRAC9 Enterprise
rNDC	Broadcom 5720 QP 1 Gb Base-T rNDC
Add-on NICs	2 x Intel X710 DP 10 Gb SFP+ NICs
HBAs	2 x QLogic QLE2692 DP 16 Gb/s FC HBAs
Power supply	2 x 2,000 W

Storage

The following table lists the hardware details of the storage array used in this Ready Solution for Oracle with XtremIO X2 storage.

Table 6. Ready Solution for Oracle with XtremIO X2 storage: Storage components

Storage array	Dell EMC XtremIO X2 storage
System specification	Two X2-S X-Bricks Cluster
Operating system version	6.1.0-99_X2
Active-Active Controllers	4
Front-end FC ports	8
SSD enclosures	2
Number of SSDs	36
Raw/Usable capacity	13.1 TiB / 10 TiB
Infiniband switches	2

Network

The following table lists the network switches used in this Ready Solution for Oracle with XtremIO X2 storage.

Table 7. Ready Solution for Oracle with XtremIO X2 storage: Network switches

Switch function	Switch type
LAN	2 x Dell EMC Networking S4048-ON 10 GbE switches
SAN	2 x Dell EMC Connectrix DS-6510B 48-ports 16 Gb/s switches
Management	1 x Dell EMC Networking S3048-ON 1 GbE switch

Data Domain DD6300 systems for database backup