Your Browser is Out of Date

ShareDemos uses technology that works best in other browsers.
For a full experience use one of the browsers below
Architecture Guide—Dell EMC Ready Solutions for Data Analytics - Spark on Kubernetes
Spark environment
Spark environment Overview Clustered execution Spark and Kubernetes Red Hat OpenShift Container Platform Running Spark on Kubernetes Storage interfaces Spark image Additional images Monitoring

Spark environment

Monitoring

  • The standard Spark history server can be used to monitor a Spark job while it is running. See figure 17.

    Figure 17: Spark history server

    The OpenShift web console can also be used to monitor overall cluster activity, including Spark jobs and other activity. See figure Figure .

    Figure 18: OpenShift pod monitoring