FAQ

Visit the Intel® Developer Cloud console to access a node with eight Intel Gaudi 2 accelerators. Access is granted on an hourly basis for a reasonable cost. For details, see Get Access.

Use the GPU Migration Toolkit preinstalled in the Intel Gaudi software. The toolkit converts Python* code with CUDA* and other GPU-specific commands to code that Intel Gaudi accelerators can understand. The toolkit runs in real time and does not modify the original code. You need to add the GPU_migration library into the model script. The GPU Migration Toolkit User Guide details how to ensure the model is functional on Intel Gaudi accelerators.

Find fully documented and optimized models at the following GitHub* repositories: Model References and Optimum for Intel Gaudi accelerators from Hugging Face*. These repositories contain instructions on how to download the dataset and run the models. For more information, see Get Started.

Get Started provides information on how to migrate models to the Intel Gaudi processor, as well as videos and direct links to detailed documentation. For first-time users of Intel Gaudi processors, refer to the Intel® Developer Cloud Quick Start Guide.

Start with the Optimum for Intel Gaudi accelerators library. This is a dedicated library that allows all Hugging Face Transformer- and Diffusion-based models to run on Intel Gaudi accelerators. To get started, see Using Hugging Face.

We recommend that most users run the Docker* image for PyTorch* from Intel, as this contains all the Intel Gaudi software, drivers, and libraries needed to run models successfully. To pull and run Docker images for Intel Gaudi accelerators, refer to the Docker installation instructions.

Performance numbers for training and inference, including the latest MLPerf* performance numbers, can be found on Model Performance Data.

Visit the Intel Gaudi AI Accelerator Developer Forum to post questions and see responses from Intel team members and the broader community.

To identify the most current version of software, see the Release Notes. To find the current version of Intel Gaudi software on your platform, see the Software Stack Verification section in the Intel Gaudi software documentation.

Yes. Use the Tensor Processor Core (TPC*) software development kit for Intel Gaudi accelerators to write kernels. This is a TPC-C-based kernel library, so custom CUDA kernels need to be converted to TPC kernels for Intel Gaudi accelerators. For more information, see TPC Programming.

If you have questions not answered here, post them in the Intel Gaudi AI Accelerator Developer Forum. For specific questions related to using PyTorch* models on GitHub*, post in the Issues tab of the Model-References GitHub repository.

Stay informed: Register for the latest Intel Gaudi AI Accelerator developer news, events, training, and updates.