| Package | Description |
|---|---|
| org.nd4j.linalg.learning.config | |
| org.nd4j.linalg.schedule |
| Modifier and Type | Method and Description |
|---|---|
void |
Sgd.setLrAndSchedule(double lr,
ISchedule lrSchedule) |
void |
RmsProp.setLrAndSchedule(double lr,
ISchedule lrSchedule) |
void |
NoOp.setLrAndSchedule(double lr,
ISchedule lrSchedule) |
void |
Nesterovs.setLrAndSchedule(double lr,
ISchedule lrSchedule) |
void |
Nadam.setLrAndSchedule(double lr,
ISchedule lrSchedule) |
void |
IUpdater.setLrAndSchedule(double lr,
ISchedule lrSchedule)
Set the learning rate and schedule.
|
void |
AMSGrad.setLrAndSchedule(double lr,
ISchedule lrSchedule) |
void |
AdaMax.setLrAndSchedule(double lr,
ISchedule lrSchedule) |
void |
Adam.setLrAndSchedule(double lr,
ISchedule lrSchedule) |
void |
AdaGrad.setLrAndSchedule(double lr,
ISchedule lrSchedule) |
void |
AdaDelta.setLrAndSchedule(double lr,
ISchedule lrSchedule) |
| Constructor and Description |
|---|
AdaGrad(ISchedule learningRateSchedule) |
AdaGrad(ISchedule learningRateSchedule,
double epsilon) |
Adam(ISchedule learningRateSchedule) |
AdaMax(ISchedule learningRateSchedule) |
AMSGrad(ISchedule learningRateSchedule) |
Nadam(ISchedule learningRateSchedule) |
Nesterovs(double learningRate,
ISchedule momentumSchedule) |
Nesterovs(ISchedule learningRateSchedule) |
Nesterovs(ISchedule learningRateSchedule,
double momentum) |
Nesterovs(ISchedule learningRateSchedule,
ISchedule momentumSchedule) |
RmsProp(ISchedule learningRateSchedule) |
Sgd(ISchedule learningRateSchedule) |
| Modifier and Type | Class and Description |
|---|---|
class |
ExponentialSchedule
An exponential schedule, with 2 parameters: initial value, and gamma.
value(i) = initialValue * gamma^i where i is the iteration or epoch (depending on the setting) |
class |
InverseSchedule
Inverse schedule, with 3 parameters: initial value, gamma and power.
value(i) = initialValue * (1 + gamma * iter)^(-power) where i is the iteration or epoch (depending on the setting) |
class |
MapSchedule
MapSchedule is a schedule based on specific values in a
Map<Integer,Double>.For example, if the map contains the following: (0,1.0), (10,0.5), (20, 0.2) then iteration/epoch 0 to 9 inclusive will have value 1.0, 10 to 19 will have 0.5, and 20+ will have value 0.2. Note that the map MUST have a key for position 0 - this is the initial value. |
class |
PolySchedule
Polynomial decay schedule, with 3 parameters: initial value, maxIter, power.
Note that the the value will be 0 after maxIter, otherwise is given by: value(i) = initialValue * (1 + i/maxIter)^(-power) where i is the iteration or epoch (depending on the setting) |
class |
SigmoidSchedule
Sigmoid decay schedule, with 3 parameters: initial value, gamma and stepSize.
value(i) = initialValue * 1.0 / (1 + exp(-gamma * (iter - stepSize))) where i is the iteration or epoch (depending on the setting) |
class |
StepSchedule
Step decay schedule, with 3 parameters: initial value, gamma and step.
value(i) = initialValue * gamma^( floor(iter/step) ) where i is the iteration or epoch (depending on the setting) |
| Modifier and Type | Method and Description |
|---|---|
ISchedule |
StepSchedule.clone() |
ISchedule |
SigmoidSchedule.clone() |
ISchedule |
MapSchedule.clone() |
ISchedule |
ISchedule.clone() |
ISchedule |
InverseSchedule.clone() |
ISchedule |
ExponentialSchedule.clone() |
Copyright © 2018. All rights reserved.