The Ipsotek platform runs as a distributed system. The critical components for processing camera traffic are the Processing nodes. The Ipsotek Management node load balances workload among the available Processing nodes. In a Large deployment there could be 40 processing nodes. It is important to monitor that all Processing nodes are correctly joined to the cluster. Since the Processing nodes also contain GPU's it is useful to monitor GPU utilization across the Ipsotek cluster.
In order to easily monitor the Processing nodes, the Ipsotek VIConfigure administrator console has the option to get "Processing Node Information" in the Server Settings menu. This view lists the connected Processing nodes.
The Processing node information also covers the GPU utilization for each node that is processing camera traffic. The key metrics are:
- Hostname - The name of the processing node
- GPU % - The overall GPU percent utilization
- Free RAM MB - The amount of memory free on the GPU
- Decoder % - The utilization of the GPU hardware decoder
- Encoder % - The utilization of the GPU hardware encoder
In addition to the high-level view of the Processing nodes, a low-level monitoring portal is included in the Ipsotek deployment. This portal is based on Kibana and streams active events from all servers in the Ipsotek system. Any errors or warnings in any part of the system show up on the log monitoring dashboard. This is useful to trace a system issue or to monitor if a particular GPU is out of resources.