Intel® oneAPI Collective Communications Library Developer Guide and Reference

Download PDF
ID 772609
Date 7/13/2023
Public

A newer version of this document is available. Customers should click here to go to the newest version.

Document Table of Contents
Document Table of Contents x
Intel® oneAPI Collective Communications Library
Intel® oneAPI Collective Communications Library x
Release Notes Installation Guide Sample Application Use oneCCL package from CMake Programming Model General Configuration Advanced Configuration oneCCL API Environment Variables oneCCL Benchmark User Guide Notices and Disclaimers
Programming Model x
Sample Application Sample Application Limitations
General Configuration x
Execution of Communication Operations Transport Selection
Advanced Configuration x
Selection of Collective Algorithms Low-precision Datatypes Caching of Communication Operations Prioritization of Communication Operations Fusion of Communication Operations Enabling OFI/verbs/dmabuf Support
oneCCL API x
Initialization oneCCL Concepts Communication Operations
oneCCL Concepts x
Communicator Context Device Event Key-value Store Stream
Communication Operations x
Datatypes Collective Operations Point-To-Point Operations
Collective Operations x
Allgatherv Allreduce Alltoall Alltoallv Barrier Broadcast Reduce ReduceScatter
Intel® oneAPI Collective Communications Library

Intel® oneAPI Collective Communications Library

Intel® oneAPI Collective Communications Library (oneCCL) provides an efficient implementation of communication patterns used in deep learning.

oneCCL features include:

  • Built on top of lower-level communication middleware – Intel® MPI Library and libfabrics.

  • Optimized to drive scalability of communication patterns by allowing to easily trade off compute for communication performance.

  • Works across various interconnects: InfiniBand*, Cornelis Networks*, and Ethernet.

  • Provides common API sufficient to support communication workflows within Deep Learning / distributed frameworks (such as PyTorch*, Horovod*).

oneCCL package comprises the oneCCL Software Development Kit (SDK) and the Intel® MPI Library Runtime components.

Get Started

Developer Guide

Developer Reference

Benchmark User Guide

Level Two Title