Sliding-Window Attention

dense heads restricted to a fixed local context window.