Lably
Skip to content

Ramp function

  • 2 min read
  • 4 chapters

Related on Lably

Through Graph of a function, Inclined plane and Machine learning

In mathematics, the ramp function is also known as the positive part.

In machine learning, it is commonly known as a ReLU activation function or a rectifier in analogy to half-wave rectification in electrical engineering. In statistics (when used as a likelihood function) it is known as a tobit model.

This function has numerous applications in mathematics and engineering, and goes by various names, depending on the context. There are differentiable variants of the ramp function.

Definitions

The ramp function (R(x) : R → R0+) may be defined analytically in several ways. Possible definitions are:

  • A piecewise function: R(x):={x,x≥0;0,x<0
  • Using the Iverson bracket notation: R(x):=x⋅[x≥0] or R(x):=x⋅[x>0]
  • The max function: R(x):=max(x,0)
  • The mean of an independent variable and its absolute value (a straight line with unity gradient and its modulus): R(x):=x+|x|2 this can be derived by noting the following definition of max(a, b), max(a,b)=a+b+|a−b|2 for which a = x and b = 0
  • The Heaviside step function multiplied by a straight line with unity gradient: R(x):=xH(x)
  • The convolution of the Heaviside step function with itself: R(x):=H(x)∗H(x)
  • The integral of the Heaviside step function: R(x):=∫−∞xH(ξ)dξ
  • Macaulay brackets: R(x):=⟨x⟩
  • The positive part of the identity function: R:=id+
  • As a limit function: R(x):=lima→∞{1a,x=0x1−e−ax,x≠0

It could approximated as close as desired by choosing an increasing positive value a>0.

Sign in to keep reading

3 more chapters are free with a Lably account.

More in Human body