Your Browser is Out of Date

Nytro.ai uses technology that works best in other browsers.
For a full experience use one of the browsers below
Cloudera Data Platform (CDP) 7.1.6 with PowerFlex and PowerScale
Revision history Executive Summary Product overview
Introduction
PowerFlex family
PowerFlex software components
PowerScale
Cloudera Data Platform
Solution overview CDP deployment Testing and Validation Conclusion Appendix A Solution components Appendix B References

PowerScale

Home > Storage > PowerFlex > White Papers > Cloudera Data Platform (CDP) 7.1.6 with PowerFlex and PowerScale > PowerScale

PowerScale

  • The Dell EMC PowerScale scale-out network-attached storage (NAS) platform provides Hadoop clients with direct access to big data through a Hadoop File System (HDFS) interface. Powered by the distributed Dell EMC PowerScale OneFS operating system, a PowerScale cluster delivers a scalable pool of storage with a global namespace. The distributed OneFS operating system combines the memory, I/O, CPUs, and disks of the nodes into a cohesive storage unit. This unit presents a global namespace as a single file system.

    Hadoop compute clients access the data that is stored in a PowerScale cluster by using the HDFS protocol. Every node in the cluster can act as a NameNode and a DataNode. Each node boosts performance and expands cluster capacity. For Hadoop analytics, the PowerScale scale-out distributed architecture minimizes bottlenecks, rapidly serves big data, and optimizes performance for analytics jobs. The NameNode daemon is a distributed process that runs on all the nodes in the cluster. A compute client can connect to any node in the cluster to access NameNode services. The nodes work together as peers in a shared-nothing hardware architecture with no single point of failure.

    A PowerScale cluster is platform agnostic for compute. You can run most of the common Hadoop distributions with a PowerScale cluster. Clients running different Hadoop distributions or versions can simultaneously connect to the cluster.

    Dell EMC PowerScale OneFS 8.2 and Cloudera Data Platform for Private Cloud Base 7.1.6 are Cloudera Quality Assurance Test Suite (QATS) certified. See Certification Report for the detailed information about the Certificate and QATS execution summary report.

    Follow the OneFS best practices guide and Dell EMC PowerScale Best Practice Guide for Hadoop Data Storage for configuring and managing the HDFS service on a Dell EMC PowerScale cluster to optimize data storage for Hadoop analytics.

    Dell Technologies recommends that you follow the Dell EMC PowerScale network design best practice for design considerations of the Dell EMC PowerScale external network to ensure maximum performance and an optimal user experience.