Oct 26
Research
FLAT brings linear-attention training kernels to TPUs
Researchers have released FLAT, an open-source set of Pallas kernels for training Linear Attention, Mamba-2 and Gated Linear Attention on Google TPUs. The work includes forward and backward passes pl…