Reference [ 29 ] experimented on different auto-encoders to demonstrate that NAG has better abilities in terms of reducing the gradient norms, and it also produces iterates which exhibit an increasing trend for the minimum eigenvalue of the Hessian of the loss function at the iterates.
← all excerpts
State-of-the-Art CNN Optimizer for Brain Tumor Segmentation in Magnetic Resonance Images.
1
—
—