Your Browser is Out of Date

ShareDemos uses technology that works best in other browsers.
For a full experience use one of the browsers below
Architecture Guide—Dell EMC Ready Solutions for Data Analytics - Spark on Kubernetes
Spark environment
Overview Clustered execution Spark and Kubernetes Red Hat OpenShift Container Platform Running Spark on Kubernetes Storage interfaces Spark image Additional images Monitoring

Spark environment

Monitoring

  • The standard Spark history server can be used to monitor a Spark job while it is running. See figure 17.

    Figure 17: Spark history server

    The OpenShift web console can also be used to monitor overall cluster activity, including Spark jobs and other activity. See figure Figure .

    Figure 18: OpenShift pod monitoring