Accuracy Difference between CPU and Intel® Neural Compute Stick 2 (Intel® NCS2) When Running Inference on YOLOv5 Model

Custom trained YOLOv5 model have different accuracy between CPU and Intel® Neural Compute Stick 2 (Intel® NCS2). CPU gives higher accuracy than Intel® NCS2. Release notes state that the performance issue in MYRIAD plugin has been fixed.

In the Release Notes, the fixes for Yolo-V5 accuracy were based on the developer running the Accuracy_Check using the dataset for validation. The developer found that disabling HW optimization for convolution solves the issue with accuracy and the root cause was the very first convolution in the net.

The Fixed Yolo-v5 accuracy for the MYRIAD plugin mentioned in the Release Note was based on fixing the above problem.