Retentive Network: A Successor to Transformer for Large Language Models
Paper
•
2307.08621
•
Published
•
172
•
34
Sehyun Choi
syncdoth
AI & ML interests
ML, LLM, Multimodal LLM, Video AI, Controllable AI
Recent Activity
authored
a paper
2 months ago
Cross-Architecture Transfer Learning for Linear-Cost Inference
Transformers
authored
a paper
2 months ago
Benchmarking Commonsense Knowledge Base Population with an Effective
Evaluation Dataset
authored
a paper
2 months ago
AbsPyramid: Benchmarking the Abstraction Ability of Language Models with
a Unified Entailment Graph
Organizations
commented
2
papers
over 2 years ago
Are Lora weights loaded?
2
#4 opened over 2 years ago
by
syncdoth