Intel® oneAPI Collective Communications Library (oneCCL) Developer Guide and Reference

Download PDF
ID 772609
Date 10/31/2024
Public
Document Table of Contents
Document Table of Contents x
Intel® oneAPI Collective Communications Library
Intel® oneAPI Collective Communications Library x
Release Notes Installation Guide Sample Application Use oneCCL package from CMake Programming Model General Configuration Advanced Configuration oneCCL API Environment Variables Notices and Disclaimers
Programming Model x
Host Communication Device Communication Limitations
General Configuration x
Execution of Communication Operations Transport Selection
Advanced Configuration x
Selection of Collective Algorithms Low-precision Datatypes Caching of Communication Operations Prioritization of Communication Operations Fusion of Communication Operations Enabling OFI/verbs/dmabuf Support
oneCCL API x
Initialization oneCCL Concepts Communication Operations
oneCCL Concepts x
Communicator Context Device Event Key-value Store Stream
Communication Operations x
Datatypes Collective Operations Point-To-Point Operations
Collective Operations x
Allgather Allgatherv Allreduce Alltoall Alltoallv Barrier Broadcast Group Calls Reduce ReduceScatter
Intel® oneAPI Collective Communications Library

Intel® oneAPI Collective Communications Library

Intel® oneAPI Collective Communications Library (oneCCL) provides an efficient implementation of communication patterns used in deep learning.

oneCCL features include:

  • Built on top of lower-level communication middleware – Intel® MPI Library and libfabrics.

  • Optimized to drive scalability of communication patterns by allowing to easily trade off compute for communication performance.

  • Works across various interconnects: InfiniBand*, Cornelis Networks*, and Ethernet.

  • Provides common API sufficient to support communication workflows within Deep Learning / distributed frameworks (such as PyTorch*, Horovod*).

oneCCL package comprises the oneCCL Software Development Kit (SDK) and the Intel® MPI Library Runtime components.

Get Started

Developer Guide

Developer Reference

Level Two Title