Performance Data for Consumer Edge Use Cases
Generic Use Cases
Find the latest performance data by choice of Intel processors for generic Edge use cases across Health, Education and Consumer Industries.
GPU Systems - Detection
Pipeline: Decode and Detection
Mode: Power save
| Platform Name | CPU | Discrete Accelerator | Device | Frameworks | Model | Video Type/Resolution | Presicion | Cumulative Throughput* | Num of Streams** | Latency*** | Batch Size | Wall Power |
|---|---|---|---|---|---|---|---|---|---|---|---|---|
| ADL-S | Intel® 12th Gen i7-12700TE | - | MULTI:GPU,CPU | OpenCV 4.7.0 DLStreamer 1.7.0 Gstreamer 1.20.3 Openvino 2022.2 |
detection - yolov5s classification - efficientnet-b0 |
RTSP Camera (AVC 3840x2160 @15FPS) |
INT8 | 13 | NA | 1 | NA | |
| ADL-H | Intel® 12th Gen i7-12700H | - | MULTI:GPU,CPU | OpenCV 4.7.0 DLStreamer 1.7.0 Gstreamer 1.20.3 Openvino 2022.2 |
detection - yolov5s classification - efficientnet-b0 |
RTSP Camera (AVC 3840x2160 @15FPS) |
INT8 | 16 | NA | 1 | NA | |
| ADL-PS | Intel® 12th Gen i7-12800HL | - | MULTI:GPU,CPU | OpenCV 4.7.0 DLStreamer 1.7.0 Gstreamer 1.20.3 Openvino 2022.2 |
detection - yolov5s classification - efficientnet-b0 |
RTSP Camera (AVC 3840x2160 @15FPS) |
INT8 | 15 | NA | 1 | NA | |
| RPL-S | 13th Gen Intel® Core™ i7-13700E | - | MULTI:GPU,CPU | OpenCV 4.7.0 DLStreamer 1.7.0 Gstreamer 1.20.3 Openvino 2022.2 |
detection - yolov5s classification - efficientnet-b0 |
RTSP Camera (AVC 3840x2160 @15FPS) |
INT8 | 13 | NA | 1 | NA | |
| RPL-H | 13th Gen Intel® Core™ i7-13800HE | - | MULTI:GPU,CPU | OpenCV 4.7.0 DLStreamer 1.7.0 Gstreamer 1.20.3 Openvino 2022.2 |
detection - yolov5s classification - efficientnet-b0 |
RTSP Camera (AVC 3840x2160 @15FPS) |
INT8 | 15 | NA | 1 | NA |
CPU and GPU Systems - Detection
Pipeline: Decode and Detection
Mode: Power save
| Platform Name | CPU | Discrete Accelerator | Device | Frameworks | Model | Video Type/Resolution | Presicion | Cumulative Throughput* | Num of Streams** | Latency*** | Batch Size | Wall Power |
|---|---|---|---|---|---|---|---|---|---|---|---|---|
| ADL-S | Intel® 12th Gen i7-12700TE | - | iGPU | OpenCV 4.7.0 DLStreamer 1.7.0 Gstreamer 1.20.3 Openvino 2022.2 |
detection - yolov5s classification - efficientnet-b0 |
RTSP Camera (AVC 3840x2160 @15FPS) |
INT8 | 9 | NA | 1 | NA | |
| ADL-H | Intel® 12th Gen i7-12700H | - | iGPU | OpenCV 4.7.0 DLStreamer 1.7.0 Gstreamer 1.20.3 Openvino 2022.2 |
detection - yolov5s classification - efficientnet-b0 |
RTSP Camera (AVC 3840x2160 @15FPS) |
INT8 | 14 | NA | 1 | NA | |
| ADL-PS | Intel® 12th Gen i7-12800HL | - | iGPU | OpenCV 4.7.0 DLStreamer 1.7.0 Gstreamer 1.20.3 Openvino 2022.2 |
detection - yolov5s classification - efficientnet-b0 |
RTSP Camera (AVC 3840x2160 @15FPS) |
INT8 | 14 | NA | 1 | NA | |
| RPL-S | 13th Gen Intel® Core™ i7-13700E | - | iGPU | OpenCV 4.7.0 DLStreamer 1.7.0 Gstreamer 1.20.3 Openvino 2022.2 |
detection - yolov5s classification - efficientnet-b0 |
RTSP Camera (AVC 3840x2160 @15FPS) |
INT8 | 9 | NA | 1 | NA | |
| RPL-H | 13th Gen Intel® Core™ i7-13800HE | - | iGPU | OpenCV 4.7.0 DLStreamer 1.7.0 Gstreamer 1.20.3 Openvino 2022.2 |
detection - yolov5s classification - efficientnet-b0 |
RTSP Camera (AVC 3840x2160 @15FPS) |
INT8 | 13 | NA | 1 | NA | |
| Xeon | Intel® Xeon® Gold 6330 | Intel® Flex 170 | dGPU | OpenCV 4.7.0 DLStreamer 1.8.0 Gstreamer 1.20.3 Openvino 2022.2 |
detection - yolov5s classification - efficientnet-b0 |
RTSP Camera (AVC 3840x2160 @15FPS) |
INT8 | 68 | NA | 1 | NA | |
| Serpent Canyon | Intel® 12th Gen i7-12700H | Intel® Arc™ A770 Graphics | iGPU | OpenCV 4.7.0 DLStreamer 1.8.0 Gstreamer 1.20.3 Openvino 2022.2 |
detection - yolov5s classification - efficientnet-b0 |
RTSP Camera (AVC 3840x2160 @15FPS) |
INT8 | 15 | NA | 1 | NA | |
| Serpent Canyon | Intel® 12th Gen i7-12700H | Intel® Arc™ A770 Graphics | dGPU | OpenCV 4.7.0 DLStreamer 1.8.0 Gstreamer 1.20.3 Openvino 2022.2 |
detection - yolov5s classification - efficientnet-b0 |
RTSP Camera (AVC 3840x2160 @15FPS) |
INT8 | 59 | NA | 1 | NA |
You can run the performance benchmarks using existing models or your own models.
Hardware and software configuration (measured May 24, 2023):
Hardware configuration for 12th gen Intel® Core™ i7-12700TE (ADL-S) processor: 8 performance cores, 4 efficient cores, 35 watts TDP, 1 x 16GB DDR5 memory, 512 GB storage, Intel® UHD Graphics 770 (ADL-s GT1), 32 execution units, BIOS version ADLSFWI1.R00.3381.B00.2209130710, operating system: Ubuntu* 22.04 LTS customized image (host), Ubuntu 20.04.5 LTS (Docker*) with Intel® Distribution of OpenVINO™ toolkit v2022.2, Intel® Deep Learning Streamer Pipeline Framework v1.7.0, Video Acceleration API (VA-API) Libva package v2.15.0, Intel® Media SDK v22.5.3, OpenCL™ software v22.35.24055, Intel® oneAPI Level Zero: GPU v1.3.24055, GStreamer v1.20.3. Measurements may vary.
Hardware configuration for 12th gen Intel Core i7-12700H NUC (ADL-H) processor: 6 performance cores, 8 efficient cores, 45 watts TDP, 1 x 16 GB DDR5 memory, 512 GB storage, eligible for Intel® Iris Xe graphics, 96 execution units, BIOS version ASUSTeK* Computer Inc. v1.05.00, operating system: Ubuntu 22.04 LTS customized image (host), Ubuntu 20.04.5 LTS (Docker) with Intel Distribution of OpenVINO toolkit v2022.2, Intel Deep Learning Streamer Pipeline Framework v1.7.0, Video Acceleration API (VA-API) Libva package v2.15.0, Intel Media SDK v22.5.3, OpenCL software v22.35.24055, Intel oneAPI Level Zero: GPU v1.3.24055, GStreamer v1.20.3. Measurements may vary.
Hardware configuration for 12th gen Intel Core i7-12800 (ADL-PS) processor: 6 performance cores, 8 efficient cores, 45 watts TDP, 1 x 16GB DDR5 memory, 512 GB storage, Intel UHD Graphics 770 (ADL GT2), 96 execution units, BIOS version ADLPFWI1.R00.3354.B00.2208261835, operating system: Ubuntu 22.04 LTS customized image (host), Ubuntu 20.04.5 LTS (Docker) with Intel Distribution of OpenVINO toolkit v2022.2, Intel Deep Learning Streamer Pipeline Framework v1.7.0, Video Acceleration API (VA-API) Libva package v2.15.0, Intel Media SDK v22.5.3, OpenCL software v22.35.24055, Intel oneAPI Level Zero: GPU v1.3.24055, GStreamer v1.20.3. Measurements may vary.
Hardware configuration for 12th gen Intel Core i7-12700 processor (formerly code named Serpent Canyon: NUC12SNKi72): 6 performance cores, 8 efficient cores, 80 watts TDP, 2 x 8 GB DDR4 memory, 256 GB storage, Intel graphics (DG2)/Intel Graphics (ADL GT2), 96 iGPU and 512 dGPU execution units, BIOS version SNADL357.0056.2022.1102.1218, operating system: Ubuntu 22.04 LTS customized image (host), Ubuntu 20.04.5 LTS (Docker) with Intel Distribution of OpenVINO toolkit v2022.3, Intel Deep Learning Streamer Pipeline Framework v1.8.0, Video Acceleration API (VA-API) Libva package v2.17.0, Intel Media SDK 23.1.0, OpenCL software v22.49.25018.23, Intel oneAPI Level Zero: GPU v1.3.25018.23, GStreamer v1.20.3. Measurements may vary.
Hardware configuration for 13th gen Intel® Core™ i7-13700E (RPL-S) processor: 8 performance cores, 8 efficient cores, 65 watts TDP, 1 x 16 GB DDR5 memory, 512 GB storage, Intel® UHD Graphics (RPL-S), 32 execution units, BIOS version RPLISFI1.R00.3441.A02.2212120717, operating system: Ubuntu 22.04 LTS customized image (host), Ubuntu 20.04.5 LTS (Docker) with Intel Distribution of OpenVINO toolkit v2022.2, Intel Deep Learning Streamer Pipeline Framework v1.7.0, Video Acceleration API (VA-API) Libva package v2.15.0, Intel Media SDK v22.5.3, OpenCL software v22.35.24055, Intel oneAPI Level Zero: GPU v1.3.24055, GStreamer v1.20.3. Measurements may vary.
Hardware configuration for 13th gen Intel Core i7-13700HE (RPL-H) processor: 6 performance cores, 8 efficient cores, 45 watts TDP, 1 x 16 GB DDR5 memory, 512 GB storage, Intel UHD Graphics (RPL-P), 96 execution units, BIOS version RPLIPFI1.R00.3207.A02.2208190339, operating system: Ubuntu 22.04 LTS customized image (host), Ubuntu 20.04.5 LTS (Docker) with Intel Distribution of OpenVINO toolkit v2022.2, Intel Deep Learning Streamer Pipeline Framework 1.7.0, Video Acceleration API (VA-API) Libva package v2.15.0, Intel Media SDK v22.5.3, OpenCL software v22.35.24055, Intel oneAPI Level Zero: GPU v1.3.24055, GStreamer v1.20.3. Measurements may vary.
Hardware configuration for Intel® Xeon® Gold 6330 CPU at 2.00 GHz: 28 cores, 205 watts TDP, 16 x 16 GB DDR4 memory, 256 GB storage, Intel® Data Center GPU Flex Series 170, 512 execution units, BIOS version SE5C620.86B.01.01.0004.2110190142, operating system: Ubuntu 22.04 LTS customized image (host), Ubuntu 20.04.5 LTS (Docker) with Intel Distribution of OpenVINO toolkit v2022.3, Intel Deep Learning Streamer Pipeline Framework v1.8.0, Video Acceleration API (VA-API) Libva package v2.17.0, Intel Media SDK v23.1.0, OpenCL software v22.49.25018.23, Intel oneAPI Level Zero: GPU v1.3.25018.23, GStreamer v1.20.3. Measurements may vary.
- Wall power refers to platform power consumption.
- Accuracy (if listed) was validated with the specified dataset.