ReLUBackward

General

ReLUBackward operation computes gradient for ReLU.

Operation attributes

Attribute Name

Description

Value Type

Supported Values

Required or Optional

use_dst

If true, use dst of ReLU operation to calculate the gradient. Otherwise, use src .

bool

true (default), false

Optional

Execution arguments

The inputs and outputs must be provided according to below index order when constructing an operation.

Inputs

Index

Argument Name

Required or Optional

0

src / dst

Required

1

diff_dst

Required

Outputs

Index

Argument Name

Required or Optional

0

diff_src

Required

Supported data types

ReLUBackward operation supports the following data type combinations.

Src / Dst

Diff_dst

Diff_src

f32

f32

f32

f16

f16

f16

bf16

bf16

bf16