Alkemet News
Speculative KV coding: losslessly compressing KV cache by up to ~4× (fergusfinn.com)

125 points

bykkm

3 days ago |

20 comments