Is Inferencing INT8 Model on a New CPU Expected to Be Faster than on an Old CPU?
Content Type: Product Information & Documentation | Article ID: 000091932 | Last Reviewed: 05/18/2023
Inferred INT8 model on a new CPU and the inference speed is faster compared to inferencing with an old CPU.
The slow inference on an old CPU is expected based on the system configuration and hardware specifications.
Refer to the Intel® Distribution of OpenVINO™ toolkit Benchmark Results for the inference performance on a specified hardware configuration.