public class
Nadam
Nadam Optimizer that implements the NAdam algorithm.
Much like Adam is essentially RMSprop with momentum, Nadam is Adam with Nesterov momentum.
See Also
Constants
| float | BETA_ONE_DEFAULT | |
| float | BETA_TWO_DEFAULT | |
| float | EPSILON_DEFAULT | |
| String | FIRST_MOMENT | |
| float | LEARNING_RATE_DEFAULT | |
| String | MOMENTUM | |
| String | SECOND_MOMENT |
Inherited Constants
Public Constructors
Public Methods
| String |
getOptimizerName()
Get the Name of the optimizer.
|
Inherited Methods
Constants
public static final float BETA_ONE_DEFAULT
Constant Value:
0.9
public static final float BETA_TWO_DEFAULT
Constant Value:
0.999
public static final float EPSILON_DEFAULT
Constant Value:
1.0E-8
public static final String FIRST_MOMENT
Constant Value:
"m"
public static final float LEARNING_RATE_DEFAULT
Constant Value:
0.001
public static final String MOMENTUM
Constant Value:
"momentum"
public static final String SECOND_MOMENT
Constant Value:
"v"
Public Constructors
public Nadam (Graph graph, float learningRate)
Creates a Nadam Optimizer
Parameters
| graph | the TensorFlow graph |
|---|---|
| learningRate | the learning rate, defaults to 0.001 |
public Nadam (Graph graph, float learningRate, float betaOne, float betaTwo, float epsilon)
Creates a Nadam Optimizer
Parameters
| graph | the TensorFlow graph |
|---|---|
| learningRate | the learning rate, defaults to 0.001 |
| betaOne | The exponential decay rate for the 1st moment estimates. Default is 0.9. |
| betaTwo | The exponential decay rate for the exponentially weighted infinity norm. Default is 0.999. |
| epsilon | A small constant for numerical stability. Default is 1e-8. |
public Nadam (Graph graph, String name, float learningRate)
Creates a Nadam Optimizer
Parameters
| graph | the TensorFlow graph |
|---|---|
| name | the name for this Optimizer, defaults to "Nadam" |
| learningRate | the learning rate, defaults to 0.001 |
public Nadam (Graph graph, String name, float learningRate, float betaOne, float betaTwo, float epsilon)
Creates a Nadam Optimizer
Parameters
| graph | the TensorFlow graph |
|---|---|
| name | the name for this Optimizer, defaults to "Nadam" |
| learningRate | the learning rate, defaults to 0.001 |
| betaOne | The exponential decay rate for the 1st moment estimates. Default is 0.9. |
| betaTwo | The exponential decay rate for the exponentially weighted infinity norm. Default is 0.999. |
| epsilon | A small constant for numerical stability. Default is 1e-8. |
Public Methods
public String getOptimizerName ()
Get the Name of the optimizer.
Returns
- The optimizer name.