Contents

Compiled Partition Cache

Overview

A set of functions that provide compiled partition cache control. More…

// global functions

int dnnl::graph::get_compiled_partition_cache_capacity();
void dnnl::graph::set_compiled_partition_cache_capacity(int capacity);
dnnl_status_t DNNL_API dnnl_graph_get_compiled_partition_cache_capacity(int* capacity);
dnnl_status_t DNNL_API dnnl_graph_set_compiled_partition_cache_capacity(int capacity);

Detailed Documentation

A set of functions that provide compiled partition cache control.

Global Functions

int dnnl::graph::get_compiled_partition_cache_capacity()

Returns the number of compiled partition that can be held in the compiled partition cache at the same time.

void dnnl::graph::set_compiled_partition_cache_capacity(int capacity)

Sets a number of compiled partitions that can be held in the compiled partition cache at the same time.

The default capacity of compiled partition cache is 1024.

Parameters:

capacity

Compiled partition cache capacity to set. The default cache capacity is 1024. If a new capacity is less than a number of compiled partition that the compiled partition cache already has, then the excess entries will be evicted. Setting the capacity to 0 clears the compiled partition cache and disables it. Concurrently modifying capacity is safe.

Returns:

dnnl_invalid_arguments if the capacity value is invalid, and dnnl_success on success.

dnnl_status_t DNNL_API dnnl_graph_get_compiled_partition_cache_capacity(int* capacity)

Returns the number of compiled partitions that can be held in the compiled partition cache at the same time.

Parameters:

capacity

Compiled partition cache capacity to query. Concurrently accessing capacity is safe.

Returns:

dnnl_invalid_arguments if the capacity value is invalid, and dnnl_success on success.

dnnl_status_t DNNL_API dnnl_graph_set_compiled_partition_cache_capacity(int capacity)

Sets a number of compiled partitions that can be held in the compiled partition cache at the same time.

The default capacity of compiled partition cache is 1024.

Parameters:

capacity

Compiled partition cache capacity to set. The default cache capacity is 1024. If a new capacity is less than a number of compiled partition that the compiled partition cache already has, then the excess entries will be evicted. Setting the capacity to 0 clears the compiled partition cache and disables it. Concurrently modifying capacity is safe.

Returns:

dnnl_invalid_arguments if the capacity value is invalid, and dnnl_success on success.

class dnnl::graph::graph Constant Tensor Cache