Attention at Constant Cost per Token via Symmetry-Aware Taylor Approximation

Attention at Constant Cost per Token via Symmetry-Aware Taylor Approximation (arxiv.org)

137 points

byfheinsen

9 hours ago |