| Intel PyTorch 2.1 | ResNet50 v1.5 | Image Recognition | fp32 | 129.97 img/s | 0.161257103 | 128 |
| Intel PyTorch 2.1 | ResNet50 v1.5 | Image Recognition | bf16 | 327.96 img/s | 0.420294498 | 128 |
| Intel PyTorch 2.1 | ResNet50 v1.5 | Image Recognition | bf32 | 146.18 img/s | 0.180068983 | 128 |
| Intel TensorFlow 2.14 | ResNet50 v1.5 ImageNet (224 x224) | Image Recognition | fp32 | 137.36 img/s | 0.163106335 | 1024 |
| Intel TensorFlow 2.14 | ResNet50 v1.5 ImageNet (224 x224) | Image Recognition | bf16 | 317.83 img/s | 0.377479275 | 1024 |
| Intel TensorFlow 2.14 | ResNet50 v1.5 ImageNet (224 x224) | Image Recognition | bf32 | 152 img/s | 0.180806014 | 1024 |
| Intel PyTorch 2.1 | DLRM Criteo Terabyte | Recommender | fp32 | 265,503.91 rec/s | 323.9907136 | 32768 |
| Intel PyTorch 2.1 | DLRM Criteo Terabyte | Recommender | bf16 | 783,058.09 rec/s | 980.36669 | 32768 |
| Intel PyTorch 2.1 | DLRM Criteo Terabyte | Recommender | bf32 | 369,848.15 rec/s | 447.8448004 | 32768 |
| Intel TensorFlow 2.14 | SSD-ResNet34 COCO 2017 (1200 x1200) | Object Detection | fp32 | 52.49 img/s | 0.069833963 | 896 |
| Intel TensorFlow 2.14 | SSD-ResNet34 COCO 2017 (1200 x1200) | Object Detection | bf16 | 190.53 img/s | 0.251641022 | 896 |
| Intel TensorFlow 2.14 | SSD-ResNet34 COCO 2017 (1200 x1200) | Object Detection | bf32 | 68.08 img/s | 0.089474168 | 896 |
| Intel PyTorch 2.1 | RNNT LibriSpeech | Speech Recognition | fp32 | 3.38 fps | 0.00431651 | 32 |
| Intel PyTorch 2.1 | RNNT LibriSpeech | Speech Recognition | bf16 | 27.32 fps | 0.032853123 | 64 |
| Intel PyTorch 2.1 | RNNT LibriSpeech | Speech Recognition | bf32 | 11.05 fps | 0.013210908 | 32 |
| Intel PyTorch 2.1 | MaskR-CNN COCO 2017 | Object Detection | fp32 | 3.76 img/s | 0.004518796 | 112 |
| Intel PyTorch 2.1 | MaskR-CNN COCO 2017 | Object Detection | bf16 | 10.04 img/s | 0.011990064 | 112 |
| Intel PyTorch 2.1 | MaskR-CNN COCO 2017 | Object Detection | bf32 | 3.94 img/s | 0.004759719 | 112 |
| Intel PyTorch 2.1 | BERTLarge Wikipedia 2020/01/01 seq len=512 | Natural Language Processing | fp32 | 3.76 sent/s | 0.004518796 | 28 |
| Intel PyTorch 1.13 | BERTLarge Wikipedia 2020/01/01 seq len=512 | Natural Language Processing | bf16 | 10.04 sent/s | 0.011990064 | 56 |
| Intel PyTorch 1.13 | BERTLarge Wikipedia 2020/01/01 seq len=512 | Natural Language Processing | bf32 | 3.94 sent/s | 0.004759719 | 56 |
| Intel TensorFlow 2.14 | BERTLarge Wikipedia 2020/01/01 seq len=512 | Natural Language Processing | fp32 | 4.28 sent/s | 0.00517258 | 128 |
| Intel TensorFlow 2.14 | BERTLarge Wikipedia 2020/01/01 seq len=512 | Natural Language Processing | bf16 | 9.75 sent/s | 0.011582599 | 128 |
| Intel TensorFlow 2.14 | BERTLarge Wikipedia 2020/01/01 seq len=512 | Natural Language Processing | bf32 | 4.79 sent/s | 0.005754722 | 128 |
| Intel TensorFlow 2.14 | Transformer MLPerf | Language Translation | fp32 | 12,072.19 sent/s | 11.53 | 42000 |
| Intel TensorFlow 2.14 | Transformer MLPerf | Language Translation | bf16 | 28757.83 sent/s | 28.89 | 42000 |
| Intel TensorFlow 2.14 | Transformer MLPerf | Language Translation | bf32 | 11, 995.37 sent/s | 11.78 | 42000 |