ReLU¶
General¶
ReLU applies following formula on every element of \(\src\) tensor (the variable names follow the standard Naming Conventions):
\[\begin{split}dst = \begin{cases} src & \text{if}\ src > 0 \\ 0 & \text{if}\ src \leq 0 \end{cases}\end{split}\]
Operation attributes¶
ReLU operation does not support any attribute.
Execution arguments¶
The inputs and outputs must be provided according to below index order when constructing an operation.
Inputs¶
Index |
Argu |
|
|---|---|---|
0 |
|
Required |
Outputs¶
Index |
Argu |
|
|---|---|---|
0 |
|
Required |
Supported data types¶
ReLU operation supports the following data type combinations.
Src |
D |
|---|---|
f32 |
f32 |
bf16 |
bf16 |
f16 |
f16 |