Journal of Chaohu University ›› 2021, Vol. 23 ›› Issue (3): 51-54+60.doi: 10.12152/j.issn.1672-2868.2021.03.007
Previous Articles Next Articles
FEI Jing-tai,ZHA Xing-xing,WANG Dong-yin:School of Mathematics and Statistics, Chaohu University
Received:
Online:
Published:
Abstract: In this paper, we have conducted in-depth research on the convergence rate of the Stochastic Classical Momentum Algorithm (CM). By modifying the iterative formula of traditional stochastic gradient descent algorithm with momentum, we obtain the convergence rate of algorithm with non-strongly convex and non-smooth. When the momentum coefficient pt is a constant, the algorithm achieves a convergence rate of O.When the momentum coefficient pt is not a constant, we obtain the convergence rate by setting different learning rates. Finally, the rationality is demonstrated through numerical experiments.
Key words: machine learning, Stochastic Classical Momentum Algorithm, convergence rate, momentum coefficient, learning rates
CLC Number:
FEI Jing-tai, ZHA Xing-xing, WANG Dong-yin. Convergence of Stochastic Classical Momentum Algorithm with Non-strongly Convex and Non-smooth[J].Journal of Chaohu University, 2021, 23(3): 51-54+60.
0 / / Recommend
Add to citation manager EndNote|Reference Manager|ProCite|BibTeX|RefWorks
URL: http://xb.chu.edu.cn/EN/10.12152/j.issn.1672-2868.2021.03.007
http://xb.chu.edu.cn/EN/Y2021/V23/I3/51
Cited