ReLU function

VARP ReLU(
  1. VARP x, {
  2. double slope = 0.0,
})

Given an input value x, it computes the output as x if x > 0 and slope * x if x <= 0.

Args:

  • x: A variable.
  • slope: A float, a positive float value, it leakes the negative part by multiplying with slope rather than setting it to 0.0f.

Returns:

  • output: A variable with the same type as x.

Implementation

VARP ReLU(VARP x, {double slope = 0.0}) => VARP.fromPointer(C.mnn_expr_Relu(x.ptr, slope));