Terminology used in this paper is defined as follows:
- Stream: Number of input source streams in form of recorded or live videos, in these tests we used single and multiple input pre-recorded videos.
- Batch size: Number of input samples to be processed simultaneously .
- Engine count: Number of copies or instances of the model loaded in the GPU memory.
- Interval: Number of consecutive batches or frames between skips during inference.