StateFlow: Sequence Pipeline Parallelism for Long-Context Modeling with Linear Recurrence Paper • 2608.06838 • Published Aug 7
Frontier Language Models Struggle to Copy: Text Can Be Better Viewed in 2D Paper • 2607.16072 • Published Jul 17 • 1
Rethinking the Role of Efficient Attention in Hybrid Architectures Paper • 2606.15378 • Published Jun 13 • 21
MiniCPM-SALA: Hybridizing Sparse and Linear Attention for Efficient Long-Context Modeling Paper • 2602.11761 • Published Feb 12 • 8
Student-in-the-Loop Chain-of-Thought Distillation via Generation-Time Selection Paper • 2604.02819 • Published Apr 3 • 1
DECO: Sparse Mixture-of-Experts with Dense-Comparable Performance on End-Side Devices Paper • 2605.10933 • Published May 11 • 3
Attention Amnesia in Hybrid LLMs: When CoT Fine-Tuning Breaks Long-Range Recall, and How to Fix It Paper • 2606.11052 • Published Jun 9 • 17
Attention Amnesia in Hybrid LLMs: When CoT Fine-Tuning Breaks Long-Range Recall, and How to Fix It Paper • 2606.11052 • Published Jun 9 • 17
HypeNet Collection The models for the paper: Hybrid Linear Attention Done Right: Efficient Distillation and Effective Architectures for Extremely Long Contexts • 2 items • Updated Apr 28
HypeNet Collection The models for the paper: Hybrid Linear Attention Done Right: Efficient Distillation and Effective Architectures for Extremely Long Contexts • 2 items • Updated Apr 28
view article Article Welcome Gemma 4: Frontier multimodal intelligence on device +5 merve, pcuenq, sergiopaniego, burtenshaw, Steveeeeeeen, alvarobartt, SaylorTwift • Apr 2 • 929