Powering your Elasticsearch Solution with Dell PowerEdge Servers and Intel® 3rd Generation Xeon® Processors
Download PDFWed, 02 Aug 2023 16:38:32 -0000
|Read Time: 0 minutes
Summary
This joint paper outlines a brief discussion on the key hardware considerations when configuring a successful deployment and recommends configurations based on Dell 15th Generation PowerEdge servers.
Elasticsearch is a distributed, open-source search and analytics engine for all types of data, including textual, numerical, geospatial, structured, and unstructured. This proposal contains recommended configurations for Elasticsearch clusters on the Kubernetes platform (Red Hat OpenShift Container Platform with the Elastic Cloud on Kubernetes (ECK) operator) running on 15th Generation Dell PowerEdge servers with 3rd Generation Intel Xeon Scalable processors.
Key considerations
- Faster and scalable performance - Elasticsearch running on Dell PowerEdge servers is built on high-performing Intel architecture and configured with 3rd Generation Intel Xeon Scalable processors. Indexing is faster and capacity can scale with your needs.
- Index more data - Elasticsearch can handle and store more data by increasing DRAM capacity and using PCIe Gen 4 NVMe disk drives. PowerEdge R650 and R750 servers are well suited to this requirement with memory capacity of up to 4TB and storage expansion of up to 10 high performance NVMe drives for the Control Plane and Master/Ingest and Hot tier nodes, as well as up to 12 high capacity SAS/SATA drives for the optional Cold Tier nodes.
- Reduced search times and increased # of concurrent searches - As data grows and needs to be accessed across the cluster, data-access response times are critical, especially for real-time analytics applications. Elasticsearch running on the latest Dell PowerEdge servers is built on a high-performing Intel architecture. Intel Ethernet network controllers, adapters, and accessories enable agility in the data center and support high throughput and low latency response times.
- Easy and secure installation - The Elastic Cloud on Kubernetes (ECK) operator is an official Elasticsearch operator certified on the Red Hat OpenShift Container Platform, providing ease of deployment, management, and operation of Elasticsearch, Kibana, APM Server, Beats, and Enterprise Search on OpenShift clusters. Elasticsearch clusters are secure by default (with enabled encryption and strong passwords).
- Multi data tiers - As data grows, costs do not also need to increase. With multiple tiers of data, you can extend capacity and drive storage costs down without performance loss. Each capacity layer can be scaled independently by using larger drives or mode nodes (or both), depending on your needs.
Available configurations
Elasticsearch cluster on Kubernetes (Red Hat OpenShift Kubernetes) platform | ||||
Required | Optional | |||
| OpenShift Control Plane Master Nodes | Elasticsearch Master / Ingest / Hot tier data nodes | Elasticsearch Warm tier data nodes (optional) | Elasticsearch Cold tier data nodes |
Functions | OpenShift services, Kubernetes services | Elasticsearch roles: master, ingest, hot tier data. Additional services, ex: Kibana | Elasticsearch roles: warm tier data | Elasticsearch roles: cold tier data |
Platform | Dell PowerEdge R650 chassis with up to 10x2.5” NVMe Direct Drives | Dell PowerEdge R750 chassis with up to 12x3.5” HDD with RAID | ||
CPU | 2 x Intel Xeon Gold 6326 processors (16cores @ 2.9GHz) or better | 2 x Intel Xeon Platinum 8380 processors (40cores @ 2.3GHz) | 2 x Intel Xeon Gold 5318Y processors (24cores @ 2.1GHz) | 2 x Intel Xeon Gold 5318N processors (24cores @ 2.1GHz) |
DRAM | 128GB (16x 8GB DDR4-3200) | 256 GB (16 x 16 GB DDR4-3200) | 128 GB (16 x 8 GB DDR4-3200) | |
Boot Device | Dell BOSS-S2 with 2x 240GB or 2x 480GB M.2 SATA SSD (RAID1) | |||
Storage | Not needed for all-NVMe configurations | Dell PERC H755 SAS/SATA RAID adapter | ||
Storage (NVMe) | 1x 1.6TB Enterprise NVMe Mixed-Use AG Drive U.2 Gen4 | 2x (up to 10x) 3.2TB Enterprise NVMe Mixed-Use AG Drive U.2 Gen4 | 10x 7.68TB Enterprise NVMe Read-Intensive AG Drive U.2 Gen4 | up to 12x 16TB / 18TB / 20TB 12Gbps SAS ISE 3.5” HDD, 7200RPM |
NIC | Intel E810-XXVDA2 for OCP3 (dual-port 25GbE) |
Learn more
Contact your Dell account team for a customized quote 1-877-289-3355.
Read the doc: What is Elasticsearch?
Read the doc: Data tiers | Elasticsearch Guide
Read the blog: Elastic Cloud on Kubernetes is now a Red Hat OpenShift Certified Operator