GELUBackward¶
General¶
GELUBackward operation computes gradient for GELU.
Operation attributes¶
GELUBackward operation does not support any attribute.
Execution arguments¶
The inputs and outputs must be provided according to below index order when constructing an operation.
Inputs¶
Index |
Argument Name |
Required or Optional |
|---|---|---|
0 |
|
Required |
1 |
|
Required |
Outputs¶
Index |
Argument Name |
Required or Optional |
|---|---|---|
0 |
|
Required |
Supported data types¶
GELUBackward operation supports the following data type combinations.
Src |
Diff_dst |
Diff_src |
|---|---|---|
f32 |
f32 |
f32 |
f16 |
f16 |
f16 |
bf16 |
bf16 |
bf16 |