AlbertS's picture

6 14

AlbertS

LoserCheems

·

AI & ML interests

None yet

Organizations

None yet

upvoted an article 3 months ago

Article

Trainable Dynamic Mask Sparse Attention: Bridging Efficiency and Effectiveness in Long-Context Language Models

By

and 2 others •

Aug 5

• 7

upvoted a paper 3 months ago

Trainable Dynamic Mask Sparse Attention

Paper • 2508.02124 • Published Aug 4 • 17

upvoted a collection 7 months ago

🐕Small-Doges

Doge family of small language models! • 18 items • Updated Apr 21 • 11

upvoted a collection 9 months ago

Doge

Doge family of small language models. • 12 items • Updated Mar 28 • 6

upvoted a paper 11 months ago

Wonderful Matrices: Combining for a More Efficient and Effective Foundation Model Architecture

Paper • 2412.11834 • Published Dec 16, 2024 • 8

upvoted a paper about 1 year ago

Cheems: Wonderful Matrices More Efficient and More Effective Architecture

Paper • 2407.16958 • Published Jul 24, 2024 • 4