SwiGLU

the SiLU-gated MLP common in modern decoder stacks.