| Model | #HPU | Precision | Throughput | Latency‡ | Batch | Framework Version |
|---|---|---|---|---|---|---|
| Stable Diffusion v2.1 (512x512)** | 1 | bf16 | 1.23 img/sec | 813 ms | 1 | Lightning 2.2.0 |
| Stable Diffusion v2.1 (768X768)** | 1 | bf16 | 0.4 img/sec | 2500 ms | 1 | Lightning 2.2.0 |
| Bert FT (torch.compile) | 1 | bf16 | 814 token/sec | 29.48 ms | 24 | |
| Resnet50 (torch.compile) | 1 | bf16 | 17018 img/sec | 15.04 ms | 256 | |
| Unet2D | 1 | bf16 | 7525 img/sec | 8.5 ms | 64 | Lightning 2.3.3 |
| Unet3D | 1 | bf16 | 114.74 img/sec | 17.43 ms | 2 | Lightning 2.3.3 |