LeCun normal initializer.
Draws samples from a random distribution. * *
If the distribution is TRUNCATED_NORMAL, it draws samples from a truncated normal distribution
centered on 0
with
stddev = sqrt(1 / fanIn)
where fanIn
is the number of input units in the
weight tensor.
If the distribution is UNIFORM, itraws samples from a uniform distribution within
[-limit, limit]
, where limit = Math.sqrt(3 / fanIn)
(fanIn
is
the number of input units in the weight tensor)
Examples:
LeCun Normal:
long seed = 1001l; LeCunNormal<TFloat32, TFloat32> initializer = new org.tensorflow.framework.initializers.LeCunNormal<>(tf, Distribution.TRUNCATED_NORMAL, seed); Operand<TFloat32> values = initializer.call(tf.constant(Shape.of(2,2)), TFloat32.class);
LeCun Uniform:
long seed = 1001l; LeCunNormal<TFloat32, TFloat32> initializer = new org.tensorflow.framework.initializers.LeCunNormal<>(tf, Distribution.UNIFORM, seed); Operand<TFloat32> values = initializer.call(tf.constant(Shape.of(2,2)), TFloat32.class);*
NOTE: *
For a LeCunNormal equivalent initializer, use TRUNCATED_NORMAL
for the distribution parameter. *
For a LeCunUniform equivalent initializer, use UNIFORM
*
for the distribution parameter. *
Inherited Constants
Inherited Fields
Public Constructors
LeCun(Ops tf, VarianceScaling.Distribution distribution, long seed)
Creates a LeCunNormal Initializer
|
Inherited Methods
Public Constructors
public LeCun (Ops tf, VarianceScaling.Distribution distribution, long seed)
Creates a LeCunNormal Initializer
Parameters
tf | the TensorFlow Ops |
---|---|
distribution | The distribution type for the Glorot initializer. |
seed | the seed for random number generation. An initializer created with a given seed will always produce the same random tensor for a given shape and dtype. |