Home > Storage > PowerScale (Isilon) > Industry Solutions and Verticals > Hadoop and Big Data > Dell PowerScale and Cloudera CDP Private Cloud Base Reference Architecture > DFSIO testing with Isilon F800
This section describes a series of industry-standard benchmark tests that analyze the performance throughput and reliability of the Dell Isilon F800 node.
The performance lab environment was configured with eight Isilon F800 nodes, and eight PowerEdge R740 servers with the following specification (per server):
The back-end network between the compute nodes and Isilon system is 40 Gbps with Jumbo Frames set (MTU-9162) for the NICs and the switch ports.
This performance testing uses the DFSIO utility that comes with Cloudera enterprise. While it is not a perfect benchmark, it is useful in providing relative results within the environment. The goal was to perform a test that would keep as many cores in the NodeManagers running as continuously as possible. Since DFSIO creates a task for each file, this test was simple to deploy. With the compute side flooded, this scenario shows the effect on Isilon as an HDFS datastore.
Example DFSIO command:
yarn jar /opt/cloudera/parcels/CDH/lib/ /opt/cloudera/parcels/CDH/lib/hadoop-mapreduce/hadoop-mapreduce-client-
The major configuration applied is the size of each mapper and reducer. Using some simple YARN math, we used 2 vCores of each container, and since each server had 8 vCores, this would result in 40 containers per server. The allocated memory was 8 GB per container, which used 320 GB of the total 768 GB for each run.
As shown below, the F800 system provides good throughput results that reflect 18 GB/s for read and 16 GB/s for writes.
For more detailed results, see the DFSIO testing with Isilon F800 blog post.