A second-order-like optimizer with adaptive gradient scaling for deep learning
Published in Preprint, 2024
Author: Jérôme Bolte, Ryan Boustany, Edouard Pauwels, Andrei Purica
Download here
Publications
On the numerical reliability of nonsmooth autodiff: a MaxPool case study
Published in TMLR, 2024
Author: Ryan Boustany
Journal: TMLR
Paper: ArXiv
Download here
On the complexity of nonsmooth automatic differentiation
Published in ICLR, 2023
Authors: Jérôme Bolte, Ryan Boustany, Edouard Pauwels, Béatrice Pesquet-Popescu
Conference: ICLR 2023 - Top 25% Paper
Paper: ArXiv
Download here