torch_numopt.curvature.gauss_newton_block_approximation#
Block-diagonal Gauss-Newton approximation.
Similar to the full Gauss-Newton, but only the diagonal blocks of Jᵀ J are computed, one per parameter group. This saves memory and is often sufficient.
Classes
|
Block-diagonal Gauss-Newton Hessian approximation. |