Co-Designing Sparse Attention for Efficient Long-Context Inference
AI · Technology · 2026-11-18 16:12
This article explores co-designing sparse attention algorithms to enhance the inference efficiency of large language models when processing long-context inputs.