Summary
Differences and calculation method for throughput (frames per second, FPS) and latency values.
Description
Questions regarding the formulas used for calculating throughput or FPS in OpenVINO™ DL Workbench.
Resolution
- Throughput (frames per second, FPS) is a measurement used when it comes to batch inputs.
- Divide the number of inputs that were processed by the processing time:
Throughput (FPS) = Inferred number of images / Processing time in seconds
- Latency value measures inference time (ms) required to process a single input.
Additional information
Refer to the What Is Inference Performance documentation for more details.