딥러닝 optimizer 한판 정리 - An overview of gradient descent optimization algorithms 논문 리뷰
리뷰 논문 : https://arxiv.org/pdf/1609.04747.pdf 논문 내용 외에도, cs231n lecture 6,7 - Traning Neural Networks I,II 유튜브에 제공된 조경훈 교수님 딥러닝 강의 : https://www.youtube.com/watch?v=s8dzhdJ3fqg& 등을 다수 참고하였습니다. 1. AbstractGradient descent optimization algorithms, while increasingly popular, are often used as black-box optimizers, as practical explanations of their strengths and weaknesses are hard to come by. Thi..