FPGA AI Suite: Getting Started Guide

Download PDF
ID 768970
Date 9/06/2024
Public
Document Table of Contents
Document Table of Contents x
1. FPGA AI Suite Getting Started Guide 2. FPGA AI Suite Components 3. FPGA AI Suite Installation Overview 4. Installing the FPGA AI Suite Compiler and IP Generation Tools 5. Installing the FPGA AI Suite PCIe-Based Design Example Prerequisites 6. FPGA AI Suite Quick Start Tutorial 7. Running the Hostless DDR-Free Design Example A. FPGA AI Suite Getting Started Guide Archives B. FPGA AI Suite Getting Started Guide Document Revision History
3. FPGA AI Suite Installation Overview x
3.1. FPGA AI Suite Directory Structure
4. Installing the FPGA AI Suite Compiler and IP Generation Tools x
4.1. Supported FPGA Families 4.2. Operating System Prerequisites 4.3. Installing the FPGA AI Suite with System Package Management Tools 4.4. Installing OpenVINO™ Toolkit 4.5. Installing Quartus® Prime Pro Edition Software 4.6. Setting Required Environment Variables 4.7. Installing Intel® Threading Building Blocks (TBB) 4.8. Finalizing Your FPGA AI Suite Installation
4.3. Installing the FPGA AI Suite with System Package Management Tools x
4.3.1. Installing the FPGA AI Suite Into an Alternative Location
5. Installing the FPGA AI Suite PCIe-Based Design Example Prerequisites x
5.1. PCIe-based Design Example Hardware Prerequisites 5.2. PCIe-based Design Example Operating System Prerequisites 5.3. PCIe-based Design Example Software Prerequisites
5.3. PCIe-based Design Example Software Prerequisites x
5.3.1. Additional Software Prerequisites for the PCIe-based Design Example for Agilex™ 7 Devices
6. FPGA AI Suite Quick Start Tutorial x
6.1. Creating a Working Directory 6.2. Preparing OpenVINO™ Model Zoo 6.3. Preparing a Model 6.4. Running the Graph Compiler 6.5. Preparing an Image Set 6.6. Programming the FPGA Device 6.7. Performing Inference on the PCIe-Based Example Design 6.8. Building an FPGA Bitstream for the PCIe Example Design 6.9. Building the Example FPGA Bitstreams 6.10. Preparing a ResNet50 v1 Model 6.11. Performing Inference on the Inflated 3D (I3D) Graph 6.12. Performing Inference on YOLOv3 and Calculating Accuracy Metrics 6.13. Performing Inference Without an FPGA Board
6.12. Performing Inference on YOLOv3 and Calculating Accuracy Metrics x
6.12.1. Preparing a YOLOv3 Model 6.12.2. Preparing a COCO Validation Dataset and Annotations 6.12.3. Inference on YOLOv3 and Calculating Accuracy Scores
1. FPGA AI Suite Getting Started Guide
2. FPGA AI Suite Components
3. FPGA AI Suite Installation Overview
4. Installing the FPGA AI Suite Compiler and IP Generation Tools
5. Installing the FPGA AI Suite PCIe-Based Design Example Prerequisites
6. FPGA AI Suite Quick Start Tutorial
7. Running the Hostless DDR-Free Design Example
A. FPGA AI Suite Getting Started Guide Archives
B. FPGA AI Suite Getting Started Guide Document Revision History

4.4. Installing OpenVINO™ Toolkit

The FPGA AI Suite requires the OpenVINO™ Toolkit 2023.3 for Linux.
To prepare OpenVINO™ Toolkit for FPGA AI Suite:
  1. Install the required OpenVINO™ Toolkit components.
  2. Configure your OpenVINO™ environment.

    You must configure the OpenVINO™ environment each time you want to use the OpenVINO™ Toolkit. For convenience, you can add the configuration to your .bashrc file.

The installer might issue an error message that indicates the OpenCL is not installed and is needed for GPU operation of OpenVINO™ . You can safely ignore this error message. The FPGA AI Suite does not require OpenVINO™ GPU support.

Recommended Python Version

OpenVINO™ Toolkit supports Python versions 3.7-3.10. The recommended version for your operating system is as follows:
  • Red Hat* Enterprise Linux* 8: Python 3.8.
  • Ubuntu* 20: Python 3.8.
  • Ubuntu* 22: Python 3.10.

Installing Required OpenVINO™ Toolkit Components

FPGA AI Suite requires you to install the OpenVINO™ Runtime and OpenVINO™ Development Tools separately.

If you plan run the FPGA AI Suite in a WSL 2 environment, ensure that you complete these instructions from an Ubuntu* command prompt in your WSL 2 environment and not from a Windows* command line.

The location where you install the OpenVINO™ Runtime is often referred to as <openvino_installdir> in FPGA AI Suite documentation. Typically, this location is /opt/intel or /home/<user>/intel.

To install the required OpenVINO™ Toolkit components:
  1. [RHEL 8 and Ubuntu 20 only] Create a Python 3.8 virtual environment and start it:
    Important: This step is not required on Ubuntu* 22.04. If you use Ubuntu* 22.04, skip to the next step where you install the OpenVINO™ 2023.3 Runtime.
    1. Install Python 3.8:
      Red Hat* Enterprise Linux* : 
      sudo yum install python3.8
      Ubuntu* Linux* 20: 
      sudo apt update

sudo apt install python3.8 python3.8-venv -y
    2. Verify your Python installation with the following command:
      python3.8 -V

      This command should return output indicating that you are using Python 3.8. For example:

      Python 3.8.16

    3. Create a new directory and switch to it:
      mkdir ~/build-openvino-dev && cd ~/build-openvino-dev
    4. Create a Python 3.8 virtual environment:
      python3.8 -m venv openvino_env

source openvino_env/bin/activate
    5. Confirm that you are in the new Python virtual environment:
      python -V

      This command should return output indicating that you are using Python 3.8. For example:

      Python 3.8.5

  2. Install the OpenVINO™ 2023.3 Runtime:
    1. If you do not have an opt/intel folder, create one as follows:
      sudo mkdir /opt/intel
    2. If you do not have a ~/Downloads folder, create one as follows:
      mkdir ~/Downloads
    3. Go to your Downloads folder:
      cd ~/Downloads
    4. Download the OpenVINO™ 2023.3 Runtime archive file for your system, extract the files, and move them to the /opt/intel folder as follows:
      • Red Hat* Enterprise Linux* 8:
        curl -L https://storage.openvinotoolkit.org/\
repositories/openvino/packages/2023.3/linux/\
l_openvino_toolkit_rhel8_2023.3.0.13775.ceeafaf64f3_x86_64.tgz \
--output openvino_2023.3.0.tgz

tar -xf openvino_2023.3.0.tgz

sudo mv \
l_openvino_toolkit_rhel8_2023.3.013775.ceeafaf64f3_x86_64 \
/opt/intel/openvino_2023.3.0
      • Ubuntu* 20:
        curl -L https://storage.openvinotoolkit.org/\
repositories/openvino/packages/2023.3/linux/\
l_openvino_toolkit_ubuntu20_2023.3.0.13775.ceeafaf64f3_x86_64.tgz \
--output openvino_2023.3.0.tgz

tar -xf openvino_2023.3.0.tgz

sudo mv \
l_openvino_toolkit_ubuntu20_2023.3.013775.ceeafaf64f3_x86_64 \
/opt/intel/openvino_2023.3.0
      • Ubuntu* 22:
        curl -L https://storage.openvinotoolkit.org/\
repositories/openvino/packages/2023.3/linux/\
l_openvino_toolkit_ubuntu22_2023.3.013775.ceeafaf64f3_x86_64.tgz \
--output openvino_2023.3.0.tgz

tar -xf openvino_2023.3.0.tgz

sudo mv \
l_openvino_toolkit_ubuntu22_2023.3.013775.ceeafaf64f3_x86_64 \
/opt/intel/openvino_2023.3.0
    5. Install system dependencies required by the OpenVINO™ Runtime by running the provided script:
      • Red Hat* Enterprise Linux* :
        cd /opt/intel/openvino_2023.3.0/install_dependencies/

sed -i -e 's/http:\/\/mirror.centos.org\/centos\/8-stream\/AppStream\/$arch\/os\/Packages\/ocl-icd-2.2.12-1.el8.$arch.rpm/https:\/\/repo.almalinux.org\/almalinux\/8\/AppStream\/$arch\/os\/Packages\/ocl-icd-2.2.12-1.el8.$arch.rpm/' ./install_openvino_dependencies.sh

sed -i -e 's/yum install "\$iopt" "\${pkgs\[@\]}"/yum install \${iopt:+\$iopt} "\${pkgs[@]}"/' ./install_openvino_dependencies.sh

sudo -E ./install_openvino_dependencies.sh
      • Ubuntu* Linux* :
        cd /opt/intel/openvino_2023.3.0/install_dependencies/

sudo -E ./install_openvino_dependencies.sh
    6. Create a symbolic link:
      cd /opt/intel

sudo ln -s openvino_2023.3.0 openvino_2023
      Important: If you have already installed a previous release of OpenVINO™ 2023, a symbolic link to the openvino_2023 folder might already exist. Unlink the previous link with the sudo unlink openvino_2023 command, and then re-run the commands in this step.
    7. Configure the OpenVINO™ Runtime environment variables with the following command:
      source /opt/intel/openvino_2023/setupvars.sh
  3. Install the OpenVINO™ Development Tools:
    1. Upgrade the Python pip command:
      python -m pip install --upgrade pip
    2. Install the openvino-dev package:
      pip install "openvino-dev[<frameworks>]==2023.3.0"

      Where <frameworks> is a comma-separated list of the deep learning frameworks that you want your OpenVINO™ development tools to support. The following values are supported: caffe, kaldi, mxnet, onnx, pytorch, tensorflow, tensorflow2.

      For example, to install the OpenVINO™ development tools to support the Caffe, PyTorch*, and TensorFlow* frameworks, run the following command: 
      pip install "openvino-dev[caffe, pytorch, tensorflow]==2023.3.0"
      Tip: This command might produce the following error message: 
      ERROR: tensorflow 2.13.1 has requirement numpy<=1.24.3,>=1.22, but you'll have numpy 1.24.4 which is incompatible
      Thjs error message is pip-specific indicating that some packages in the local Python environment do not conform to OpenVINO™ development tools requirements. You can safely ignore this warning message. The openvino-dev package is still successfully installed.
  4. Install OpenCV as follows:
    • On Red Hat* Enterprise Linux* systems, OpenCV is available from the CodeReady Linux Builder repository. Enable the repository and install OpenCV with the following commands:
      sudo subscription-manager repos \
--enable codeready-builder-for-rhel-8-x86_64-rpms

sudo yum update

sudo yum install opencv opencv-devel

pip3 install opencv-python
    • On Ubuntu* Linux systems, OpenCV is available in the default repositories. Install OpenCV with the following commands:
      sudo apt update

sudo apt install libopencv-dev python3-opencv

    If you need a version of OpenCV optimized for your hardware, you might need to build OpenCV from source. For instructions, refer to "Approach #2: Build OpenCV against specific version of OpenVINO™ " section of OpenCV usage with OpenVINO .

Configuring the OpenVINO™ Environment

You must configure the OpenVINO™ environment each time you want to use the OpenVINO™ Toolkit. For convenience, you can add the configuration to your .bashrc file.

To configure the OpenVINO™ environment, start a Linux terminal session and run the following commands: 
source ~/build-openvino-dev/openvino_env/bin/activate

unset python_version

source <openvino_installdir>/openvino_2023/setupvars.sh

You can add these comments to your .bashrc file to configure the OpenVINO™ environment for you automatically when you log on.

Next Step

After installing OpenVINO™ toolkit, continue your installation with the steps in Installing Quartus Prime Pro Edition Software.

Related Information
Level Two Title