Article ID: 000091932 Content Type: Product Information & Documentation Last Reviewed: 05/18/2023

Is Inferencing INT8 Model on a New CPU Expected to Be Faster than on an Old CPU?

BUILT IN - ARTICLE INTRO SECOND COMPONENT
Summary

Information of inference performance on a specified hardware configuration.

Description

Inferred INT8 model on a new CPU and the inference speed is faster compared to inferencing with an old CPU.

Resolution

The slow inference on an old CPU is expected based on the system configuration and hardware specifications.

Refer to the Intel® Distribution of OpenVINO™ toolkit Benchmark Results for the inference performance on a specified hardware configuration.

Related Products

This article applies to 1 products