Intel® oneAPI Deep Neural Network Developer Guide and Reference
Visible to Intel only — GUID: GUID-934CC5A6-A76A-4328-B5DF-49D32CFCA28C
Visible to Intel only — GUID: GUID-934CC5A6-A76A-4328-B5DF-49D32CFCA28C
Compiled Partition Cache
Overview
A set of functions that provide compiled partition cache control. More…
// global functions int dnnl::graph::get_compiled_partition_cache_capacity(); void dnnl::graph::set_compiled_partition_cache_capacity(int capacity); dnnl_status_t DNNL_API dnnl_graph_get_compiled_partition_cache_capacity(int* capacity); dnnl_status_t DNNL_API dnnl_graph_set_compiled_partition_cache_capacity(int capacity);
Detailed Documentation
A set of functions that provide compiled partition cache control.
Global Functions
int dnnl::graph::get_compiled_partition_cache_capacity()
Returns the number of compiled partition that can be held in the compiled partition cache at the same time.
void dnnl::graph::set_compiled_partition_cache_capacity(int capacity)
Sets a number of compiled partitions that can be held in the compiled partition cache at the same time.
The default capacity of compiled partition cache is 1024.
Parameters:
capacity |
Compiled partition cache capacity to set. The default cache capacity is 1024. If a new capacity is less than a number of compiled partition that the compiled partition cache already has, then the excess entries will be evicted. Setting the capacity to 0 clears the compiled partition cache and disables it. Concurrently modifying capacity is safe. |
Returns:
dnnl_invalid_arguments if the capacity value is invalid, and dnnl_success on success.
dnnl_status_t DNNL_API dnnl_graph_get_compiled_partition_cache_capacity(int* capacity)
Returns the number of compiled partitions that can be held in the compiled partition cache at the same time.
Parameters:
capacity |
Compiled partition cache capacity to query. Concurrently accessing capacity is safe. |
Returns:
dnnl_invalid_arguments if the capacity value is invalid, and dnnl_success on success.
dnnl_status_t DNNL_API dnnl_graph_set_compiled_partition_cache_capacity(int capacity)
Sets a number of compiled partitions that can be held in the compiled partition cache at the same time.
The default capacity of compiled partition cache is 1024.
Parameters:
capacity |
Compiled partition cache capacity to set. The default cache capacity is 1024. If a new capacity is less than a number of compiled partition that the compiled partition cache already has, then the excess entries will be evicted. Setting the capacity to 0 clears the compiled partition cache and disables it. Concurrently modifying capacity is safe. |
Returns:
dnnl_invalid_arguments if the capacity value is invalid, and dnnl_success on success.