Intel® Gaudi® 3: The AI Difference Maker
Meet your new, high-performance option for every type of enterprise AI workload.
Intel® Gaudi® 3: The AI Difference Maker
A Better Approach to Enterprise AI
Built on the high-efficiency Intel® Gaudi® platform with proven MLPerf benchmark performance, Intel® Gaudi® 3 AI accelerators are built to handle demanding training and inference.
Support AI workloads in your data center or in the cloud—from node to mega cluster, all running on the Ethernet infrastructure you likely already own. Whether you need a single accelerator or thousands, Intel® Gaudi® 3 can play a pivotal role in your AI success.
Save Time and Power
Train Models in Less Time
1.5x
faster than NV H100 on average1
Output Results Faster
1.5x
faster inference than NV H100 on average2
Use Less Power
1.4x
higher inference power efficiency than NV H100 on average3
Train Models in Less Time
1.5x
faster than NV H100 on average1
Output Results Faster
1.5x
faster inference than NV H100 on average2
Use Less Power
1.4x
higher inference power efficiency than NV H100 on average3
Designed for the Real-World Demands of AI
Intel® Gaudi® 3 AI accelerators empower you to use open, community-based software and industry-standard Ethernet networking to scale systems more flexibly.
Adopt with Ease
Designed for rapid ROI. Getting started with Intel® Gaudi® 3 AI accelerators is simple—regardless of whether you’re starting from scratch, fine-tuning off-the-shelf models, or migrating from a GPU-based approach. For more information on development, visit Intel® Gaudi® Software.
Optimized for Developers
Take advantage of software tools and developer resources to get up to speed effortlessly.
Support for New and Existing Models
Customize reference models, start fresh, or migrate existing models using open source tools, including resources from Hugging Face.
Integrated with PyTorch
Keep working with the library your team already knows.
Easy Migration of GPU-Based Models
Quickly port your existing solutions using our purpose-built software tools.
Simplify Development End to End
Go from proof of concept to production in less time. From migration to deployment, Intel® Gaudi® 3 AI Accelerators come supported by a powerful portfolio of software tools, resources, and training. Get to know what’s available to help simplify your AI efforts.
Scale Effortlessly
Bring AI into the real world. Intel® Gaudi 3 AI Accelerators are designed to deliver simple, cost-effective AI scalability for even the largest and most complex deployments.
More I/O
Take advantage of 33 percent more I/O connectivity per accelerator compared to H100,4 so you can enable massive scale-up and scale-out with optimized cost efficiency.
Built for Ethernet
Use the networking infrastructure you already own and support future needs with standard Ethernet hardware.
Open
Avoid risky investments in locked, proprietary technologies such as NVLink, NVSwitch, and InfiniBand.
Supercharge Your AI Use Case
Make the amazing possible at any scale. Intel® Gaudi® 3 AI accelerators support state-of-the-art generative AI and LLMs in the data center and pair with Intel® Xeon® processors—the host CPU of choice for leading AI systems—to deliver enterprise performance and reliability.
![An iconic representation of a computer monitor. Within the monitor screen, the outline of a cube oriented at an angle is shown](/content/dam/www/central-libraries/us/en/images/2024-05/3d-imaging-icon-smaller.png.rendition.intel.web.128.96.png)
3D Generation
![An iconic representation of a computer monitor. Within the monitor screen, outlines of two people are shown with two triangles made from multiple vertical lines, representing sound, shown in the space between their faces](/content/dam/www/central-libraries/us/en/images/2024-05/translation-icon-smaller.png.rendition.intel.web.128.96.png)
Language Translation
![An iconic representation of a computer monitor. Within the monitor screen, a question mark is shown](/content/dam/www/central-libraries/us/en/images/2024-05/q-and-a-icon-smaller.png.rendition.intel.web.128.96.png)
Question Answering
![An iconic representation of a computer monitor. Within the monitor screen, the outline of a hand giving a thumbs up and a hand giving a thumbs down are shown](/content/dam/www/central-libraries/us/en/images/2024-05/sentiment-icon-smaller.png.rendition.intel.web.128.96.png)
Sentiment Analysis
![An iconic representation of a computer monitor. Within the monitor screen, a four piece puzzle is shown with the lower right piece not yet connected to the others](/content/dam/www/central-libraries/us/en/images/2024-05/application-classification-icon-smaller.png.rendition.intel.web.128.96.png)
Text Classification
![An iconic representation of a computer monitor. Within the monitor screen, the letter T is shown](/content/dam/www/central-libraries/us/en/images/2024-05/text-generation-icon-smaller.png.rendition.intel.web.128.96.png)
Text Generation and Summarization
![An iconic representation of a computer monitor. Within the monitor screen, the outline of two mountains an a circle representing the sun are shown](/content/dam/www/central-libraries/us/en/images/2024-05/image-generation-icon-smaller.png.rendition.intel.web.128.96.png)
Text-to-Image Generation
![An iconic representation of a computer monitor. Within the monitor screen, a play button is shown](/content/dam/www/central-libraries/us/en/images/2024-05/video-generation-icon-smaller.png.rendition.intel.web.128.96.png)
Video Retrieval
![An iconic representation of a computer monitor. An asterisk is shown centered on the screen between two text brackets](/content/dam/www/central-libraries/us/en/images/2024-05/summarization-icon-smaller.png.rendition.intel.web.128.96.png)
Visual Question Answering
Deploy Intel® Gaudi® 3 AI Accelerators via OEM Designs
We’re working with our OEM partners to bring Intel® Gaudi® 3 AI accelerators to the market. For more information on purchasing, please reach out to your OEM partner or Intel representative.
Invest with Confidence
Join our mission for AI innovation. When you buy Intel® Gaudi® 3 AI accelerators, you join a continuing advancement road map that will help steward AI into the future and unlock full-scale deployments across industries.
Intel® Gaudi® 3 AI Accelerator
Next Generation
Explore Intel® Gaudi® 3 Products
Get the Latest on AI Trends and Technologies
Subscribe to stay connected with Intel
Product and Performance Information
Gaudi 3 training vs. H100; average performance projected across multiple models, multiple configurations: Llama2 7B & 13B, GPT-3 175B.
Gaudi 3 inference vs. H100; average performance projected across multiple models, multiple configurations: Llama2 7B & 70B, Falcon 180B.
Gaudi® 3 inference power efficiency vs. H100; average performance projected across multiple models, multiple configurations: Llama2 7B & 70B, Falcon 180B H100 and H200 data sources: https://developer.nvidia.com/deep-learning-performance-training-inference/ai-inference and https://developer.nvidia.com/deep-learning-performance-training-inference/training. Intel results obtained in April 2024. Results may vary.
NVIDIA H100 GPU (900 GB/s closed NVLink connectivity) vs. Intel® Gaudi® 3 accelerator (1200 GB/s open standard RoCE).