Keywords
How Binary Jumps and Local Connections Can Make Attention Faster
About
A popular-science introduction to sparse attention, binary information propagation, book and code experiments, and the gap between theoretical savings and GPU speed.
The Journal
Ideas, experiments, and observations in progress.
Keywords
About
A popular-science introduction to sparse attention, binary information propagation, book and code experiments, and the gap between theoretical savings and GPU speed.