MHC

Notes on Manifold-Constrained Hyper-Connections, which projects learnable residual routing matrices onto a manifold to preserve identity paths, stabilizing Hyper-Connections while keeping their depth and width mixing efficient.