Simple and Scalable Strategies to Continually Pre-train Large Language Models
Paper
•
2403.08763
•
Published
•
51
LLM
-
-
Jamba: A Hybrid Transformer-Mamba Language Model
Paper • 2403.19887 • Published • 111 -
Transformer-Lite: High-efficiency Deployment of Large Language Models on Mobile Phone GPUs
Paper • 2403.20041 • Published • 34 -
Advancing LLM Reasoning Generalists with Preference Trees
Paper • 2404.02078 • Published • 46 -
Mixture-of-Depths: Dynamically allocating compute in transformer-based language models
Paper • 2404.02258 • Published • 107 -
Understanding LLMs: A Comprehensive Overview from Training to Inference
Paper • 2401.02038 • Published • 65 -
Make Your LLM Fully Utilize the Context
Paper • 2404.16811 • Published • 55 -
SUTRA: Scalable Multilingual Language Model Architecture
Paper • 2405.06694 • Published • 38 -
Beyond Scaling Laws: Understanding Transformer Performance with Associative Memory
Paper • 2405.08707 • Published • 34 -
LoRA Learns Less and Forgets Less
Paper • 2405.09673 • Published • 90 -
Layer-Condensed KV Cache for Efficient Inference of Large Language Models
Paper • 2405.10637 • Published • 22 -
Llm Pricing
📊273Display a React app with TypeScript