Package deepnetts.net.train.opt
Class AdaGradOptimizer
java.lang.Object
deepnetts.net.train.opt.AdaGradOptimizer
- All Implemented Interfaces:
Optimizer
,Serializable
Implementation of ADAGRAD
Optimizer
, which uses sum of squared previous gradients
to adjust a global learning rate for each weight.- Author:
- Zoran Sevarac
- See Also:
-
Field Summary
-
Constructor Summary
Constructors -
Method Summary
Modifier and TypeMethodDescriptionfloat
calculateDeltaBias
(float grad, int idx) float
calculateDeltaWeight
(float grad, int... idxs) void
setLearningRate
(float learningRate)
-
Constructor Details
-
AdaGradOptimizer
-
-
Method Details
-
calculateDeltaWeight
public float calculateDeltaWeight(float grad, int... idxs) - Specified by:
calculateDeltaWeight
in interfaceOptimizer
-
calculateDeltaBias
public float calculateDeltaBias(float grad, int idx) - Specified by:
calculateDeltaBias
in interfaceOptimizer
-
setLearningRate
public void setLearningRate(float learningRate) - Specified by:
setLearningRate
in interfaceOptimizer
-