Visible to Intel only — GUID: GUID-5C92AAB4-C785-41F7-9AF8-9468C910E3F4
Abs
AbsBackward
Add
AvgPool
AvgPoolBackward
BatchNormForwardTraining
BatchNormInference
BatchNormTrainingBackward
BiasAdd
BiasAddBackward
Clamp
ClampBackward
Concat
Convolution
ConvolutionBackwardData
ConvolutionBackwardWeights
ConvTranspose
ConvTransposeBackwardData
ConvTransposeBackwardWeights
Dequantize
Divide
DynamicDequantize
DynamicQuantize
Elu
EluBackward
End
Exp
GroupNorm
GELU
GELUBackward
HardSigmoid
HardSigmoidBackward
HardSwish
HardSwishBackward
Interpolate
InterpolateBackward
LayerNorm
LayerNormBackward
LeakyReLU
Log
LogSoftmax
LogSoftmaxBackward
MatMul
Maximum
MaxPool
MaxPoolBackward
Minimum
Mish
MishBackward
Multiply
Pow
PReLU
PReLUBackward
Quantize
Reciprocal
ReduceL1
ReduceL2
ReduceMax
ReduceMean
ReduceMin
ReduceProd
ReduceSum
ReLU
ReLUBackward
Reorder
Round
Select
Sigmoid
SigmoidBackward
SoftMax
SoftMaxBackward
SoftPlus
SoftPlusBackward
Sqrt
SqrtBackward
Square
SquaredDifference
StaticReshape
StaticTranspose
Subtract
Tanh
TanhBackward
TypeCast
Wildcard
enum dnnl_alg_kind_t
enum dnnl_normalization_flags_t
enum dnnl_primitive_kind_t
enum dnnl_prop_kind_t
enum dnnl_query_t
enum dnnl::normalization_flags
enum dnnl::query
struct dnnl_exec_arg_t
struct dnnl_primitive
struct dnnl_primitive_desc
struct dnnl::primitive
struct dnnl::primitive_desc
struct dnnl::primitive_desc_base
enum dnnl_rnn_direction_t
enum dnnl_rnn_flags_t
enum dnnl::rnn_direction
enum dnnl::rnn_flags
struct dnnl::augru_backward
struct dnnl::augru_forward
struct dnnl::gru_backward
struct dnnl::gru_forward
struct dnnl::lbr_augru_backward
struct dnnl::lbr_augru_forward
struct dnnl::lbr_gru_backward
struct dnnl::lbr_gru_forward
struct dnnl::lstm_backward
struct dnnl::lstm_forward
struct dnnl::rnn_primitive_desc_base
struct dnnl::vanilla_rnn_backward
struct dnnl::vanilla_rnn_forward
Visible to Intel only — GUID: GUID-5C92AAB4-C785-41F7-9AF8-9468C910E3F4
struct dnnl::memory::desc
Overview
A memory descriptor. More…
#include <dnnl.hpp>
struct desc: public dnnl::handle
{
// construction
desc();
desc(
const dims& adims,
data_type adata_type,
format_tag aformat_tag,
bool allow_empty = false
);
desc(
const dims& adims,
data_type adata_type,
const dims& strides,
bool allow_empty = false
);
desc(dnnl_memory_desc_t md);
desc(const std::vector<uint8_t>& blob);
// methods
desc submemory_desc(
const dims& adims,
const dims& offsets,
bool allow_empty = false
) const;
desc reshape(const dims& adims, bool allow_empty = false) const;
desc permute_axes(const std::vector<int>& permutation, bool allow_empty = false) const;
int get_ndims() const;
memory::dims get_padded_dims() const;
memory::dims get_padded_offsets() const;
memory::dim get_submemory_offset() const;
memory::dims get_strides() const;
int get_inner_nblks() const;
memory::dims get_inner_blks() const;
memory::dims get_inner_idxs() const;
int get_num_handles() const;
dim get_nnz() const;
memory::sparse_encoding get_sparse_encoding() const;
memory::data_type get_data_type(int index = 0) const;
memory::format_kind get_format_kind() const;
memory::dims get_dims() const;
size_t get_size(int index = 0) const;
std::vector<uint8_t> get_blob();
bool is_zero() const;
bool operator == (const desc& other) const;
bool operator != (const desc& other) const;
static desc csr(
const dims& adims,
data_type adata_type,
dim nnz,
data_type index_dt,
data_type pointer_dt,
bool allow_empty = false
);
static desc coo(
const dims& adims,
data_type adata_type,
dim nnz,
data_type index_dt,
bool allow_empty = false
);
static desc packed(
const dims& adims,
data_type adata_type,
dim nnz,
bool allow_empty = false
);
};Inherited Members
public:
// methods
handle<T, traits>& operator = (const handle<T, traits>&);
handle<T, traits>& operator = (handle<T, traits>&&);
void reset(T t, bool weak = false);
T get(bool allow_empty = false) const;
operator T () const;
operator bool () const;
bool operator == (const handle<T, traits>& other) const;
bool operator != (const handle& other) const;Detailed Documentation
A memory descriptor.
Construction
desc()Constructs a zero (empty) memory descriptor.
Such a memory descriptor can be used to indicate absence of an argument.
desc(
const dims& adims,
data_type adata_type,
format_tag aformat_tag,
bool allow_empty = false
)Constructs a memory descriptor.
NOTE:
The logical order of dimensions corresponds to the abc... format tag, and the physical meaning of the dimensions depends both on the primitive that would operate on this memory and the operation context.
Parameters:
adims |
Tensor dimensions. |
adata_type |
Data precision/type. |
aformat_tag |
Memory format tag. |
allow_empty |
A flag signifying whether construction is allowed to fail without throwing an exception. In this case a zero memory descriptor will be constructed. This flag is optional and defaults to false. |
desc(
const dims& adims,
data_type adata_type,
const dims& strides,
bool allow_empty = false
)Constructs a memory descriptor by strides.
NOTE:
The logical order of dimensions corresponds to the abc... format tag, and the physical meaning of the dimensions depends both on the primitive that would operate on this memory and the operation context.
Parameters:
adims |
Tensor dimensions. |
adata_type |
Data precision/type. |
strides |
Strides for each dimension. |
allow_empty |
A flag signifying whether construction is allowed to fail without throwing an exception. In this case a zero memory descriptor will be constructed. This flag is optional and defaults to false. |
desc(dnnl_memory_desc_t md)Construct a memory descriptor from a C API dnnl_memory_desc_t handle.
The resulting handle is not weak and the C handle will be destroyed during the destruction of the C++ object.
Parameters:
md |
The C API memory descriptor. |
desc(const std::vector<uint8_t>& blob)Construct a memory descriptor from a binary blob.
Parameters:
blob |
A binary blob previously queried from a memory descriptor. |
Methods
desc submemory_desc(
const dims& adims,
const dims& offsets,
bool allow_empty = false
) constConstructs a memory descriptor for a region inside an area described by this memory descriptor.
Parameters:
adims |
Sizes of the region. |
offsets |
Offsets to the region from the encompassing memory object in each dimension. |
allow_empty |
A flag signifying whether construction is allowed to fail without throwing an exception. In this case a zero memory descriptor will be returned. This flag is optional and defaults to false. |
Returns:
A memory descriptor for the region.
desc reshape(const dims& adims, bool allow_empty = false) constConstructs a memory descriptor by reshaping an existing one.
The new memory descriptor inherits the data type. This operation is valid only for memory descriptors that have format_kind set to dnnl::memory::format_kind::blocked or dnnl::memory::format_kind::any.
The operation ensures that the transformation of the physical memory format corresponds to the transformation of the logical dimensions. If such transformation is impossible, the function either throws an exception (default) or returns a zero memory descriptor depending on the allow_empty flag.
The reshape operation can be described as a combination of the following basic operations:
Add a dimension of size 1. This is always possible.
Remove a dimension of size 1. This is possible only if the dimension has no padding (i.e. padded_dims[dim] == dims[dim] && dims[dim] == 1).
Split a dimension into multiple ones. This is possible only if the product of all tensor dimensions stays constant and the dimension being split does not have padding (i.e. padded_dims[dim] = dims[dim]).
Join multiple consecutive dimensions into a single one. As in the cases above, this requires that the dimensions do not have padding and that the memory format is such that in physical memory these dimensions are dense and have the same order as their logical counterparts. This also assumes that these dimensions are not blocked.
Here, ‘dense’ means: stride for dim[i] == (stride for dim[i + 1]) * dim[i + 1];
And ‘same order’ means: i < j if and only if stride for dim[j] <= stride for dim[i].
WARNING:
Some combinations of physical memory layout and/or offsets or dimensions may result in a failure to make a reshape.
Parameters:
adims |
New dimensions. The product of dimensions must remain constant. |
allow_empty |
A flag signifying whether construction is allowed to fail without throwing an exception. In this case a zero memory descriptor will be returned. This flag is optional and defaults to false. |
Returns:
A new memory descriptor with new dimensions.
desc permute_axes(const std::vector<int>& permutation, bool allow_empty = false) constConstructs a memory descriptor by permuting axes in an existing one.
The physical memory layout representation is adjusted accordingly to maintain the consistency between the logical and physical parts of the memory descriptor. The new memory descriptor inherits the data type.
The new memory descriptor inherits the data type. This operation is valid only for memory descriptors that have format_kind set to dnnl::memory::format_kind::blocked or dnnl::memory::format_kind::any.
The logical axes will be permuted in the following manner:
for (i = 0; i < get_ndims(); i++)
new_desc.dims()[permutation[i]] = dims()[i];Example:
std::vector<int> permutation = {1, 0}; // swap the first and
// the second axes
dnnl::memory::desc in_md(
{2, 3}, data_type, memory::format_tag::ab);
dnnl::memory::desc expect_out_md(
{3, 2}, data_type, memory::format_tag::ba);
assert(in_md.permute_axes(permutation) == expect_out_md);Parameters:
permutation |
Axes permutation. |
allow_empty |
A flag signifying whether construction is allowed to fail without throwing an exception. In this case a zero memory descriptor will be returned. This flag is optional and defaults to false. |
Returns:
A new memory descriptor with new dimensions.
int get_ndims() constReturns a number of dimensions of the memory descriptor.
Returns:
A number of dimensions.
memory::dims get_padded_dims() constReturns padded dimensions of the memory descriptor.
Returns:
A copy of the padded dimensions vector.
memory::dims get_padded_offsets() constReturns padded offsets of the memory descriptor.
Returns:
A copy of the padded offsets vector.
memory::dim get_submemory_offset() constReturns a submemory offset of the memory descriptor.
Returns:
A submemory offset.
memory::dims get_strides() constReturns strides of the memory descriptor.
NOTE:
This API is only applicable to memory descriptors with format kind dnnl_blocked.
Returns:
A copy of the strides vector.
An empty dnnl::memory::dims if the memory descriptor does not have strides.
int get_inner_nblks() constReturns a number of inner blocks of the memory descriptor.
NOTE:
This API is only applicable to memory descriptors with format kind dnnl_blocked.
Returns:
A number of inner blocks.
memory::dims get_inner_blks() constReturns inner blocks of the memory descriptor.
NOTE:
This API is only applicable to memory descriptors with format kind dnnl_blocked.
Returns:
A copy of the inner blocks vector.
An empty dnnl::memory::dims if the memory descriptor does not have inner blocks.
memory::dims get_inner_idxs() constReturns inner indices of the memory descriptor.
NOTE:
This API is only applicable to memory descriptors with format kind dnnl_blocked.
Returns:
A copy of the inner indices vector.
An empty dnnl::memory::dims if the memory descriptor does not have inner indices.
int get_num_handles() constReturns number of handles.
Returns:
A number of handles.
dim get_nnz() constReturns a number of non-zero entries of the memory descriptor.
Returns:
A number non-zero entries.
memory::sparse_encoding get_sparse_encoding() constReturns the sparse encoding of the memory descriptor.
Returns:
the sparse encoding kind.
memory::data_type get_data_type(int index = 0) constReturns the data type of the memory descriptor.
Returns:
The data type.
memory::format_kind get_format_kind() constReturns the format kind of the memory descriptor.
Returns:
the format kind.
memory::dims get_dims() constReturns dimensions of the memory descriptor.
Potentially expensive due to the data copy involved.
Returns:
A copy of the dimensions vector.
size_t get_size(int index = 0) constReturns size of the memory descriptor in bytes.
Parameters:
index |
Data index. Defaults to 0. |
Returns:
The number of bytes required to allocate a memory buffer for data with a particular index described by this memory descriptor including the padding area.
std::vector<uint8_t> get_blob()Returns a binary blob associated with the given memory descriptor.
Returns:
The memory descriptor blob associated with the memory descriptor
bool is_zero() constChecks whether the memory descriptor is zero (empty).
Returns:
true if the memory descriptor describes an empty memory and false otherwise.
bool operator == (const desc& other) constAn equality operator.
Parameters:
other |
Another memory descriptor. |
Returns:
Whether this and the other memory descriptors have the same format tag, dimensions, strides, blocking, etc.
bool operator != (const desc& other) constAn inequality operator.
Parameters:
other |
Another memory descriptor. |
Returns:
Whether this and the other memory descriptors describe different memory.
static desc csr(
const dims& adims,
data_type adata_type,
dim nnz,
data_type index_dt,
data_type pointer_dt,
bool allow_empty = false
)Function for creating a memory descriptor for CSR sparse encoding.
The created memory descriptor will describe a memory object that contains 3 buffers. The buffers have the following meaning and assigned numbers (index):
0: values
1: indices
2: pointers
Parameters:
adims |
Tensor dimensions. |
adata_type |
Data precision/type. |
nnz |
Number of non-zero entries. |
index_dt |
Data type of indices. |
pointer_dt |
Data type of pointers. |
allow_empty |
A flag signifying whether construction is allowed to fail without throwing an exception. In this case a zero memory descriptor will be constructed. This flag is optional and defaults to false. |
static desc coo(
const dims& adims,
data_type adata_type,
dim nnz,
data_type index_dt,
bool allow_empty = false
)Function for creating a memory descriptor for COO sparse encodings.
The created memory descriptor will describe a memory object that contains n+1 buffers for an n-dimensional tensor. The buffers have the following meaning and assigned numbers (index):
0: values
1: indices for dimension 0
2: indices for dimension 1 …
n: indices for dimension n-1
Parameters:
adims |
Tensor dimensions. |
adata_type |
Data precision/type. |
nnz |
Number of non-zero entries. |
index_dt |
Data type of indices. |
allow_empty |
A flag signifying whether construction is allowed to fail without throwing an exception. In this case a zero memory descriptor will be constructed. This flag is optional and defaults to false. |
static desc packed(
const dims& adims,
data_type adata_type,
dim nnz,
bool allow_empty = false
)Function for creating a memory descriptor for packed sparse encoding.
The created memory descriptor cannot be used to create a memory object. It can only be used to create a primitive descriptor to query the actual memory descriptor (similar to the format tag any).
WARNING:
The meaning and content of the handles of the memory object that is created using the queried memory descriptor are unspecified therefore using the content is an undefined behavior.
Parameters:
adims |
Tensor dimensions. |
adata_type |
Data precision/type. |
nnz |
Number of non-zero entries. |
allow_empty |
A flag signifying whether construction is allowed to fail without throwing an exception. In this case a zero memory descriptor will be constructed. This flag is optional and defaults to false. |