Intel® oneAPI Collective Communications Library (oneCCL) Developer Guide and Reference
ID
772609
Date
3/24/2025
Public
A newer version of this document is available. Customers should click here to go to the newest version.
Visible to Intel only — GUID: GUID-970F63F5-2AA2-4183-8993-11680A0D3280
Fusion of Communication Operations
In some cases, it may be beneficial to postpone execution of communication operations and execute them all together as a single operation in a batch mode. This can reduce operation setup overhead and improve interconnect saturation.
oneCCL provides several knobs to enable and control such optimization:
The fusion is enabled by CCL_FUSION.
The advanced configuration is controlled by:
NOTE:
For now, this functionality is supported for allreduce operations only.