Qwen2.5-Coder Technical Report
In this report, we introduce the Qwen2.5-Coder series, a significant upgrade
from its predecessor, CodeQwen1.5. This series includes two models:
Qwen2.5-Coder-1.5B and Qwen2.5-Coder-7B. As a code-specific model,
Qwen2.5-Coder is built upon the Qwen2.5 architecture and continues pretrained
on a vast corpus of over 5.5 trillion tokens. Through meticulous data cleaning,
scalable synthetic data generation, and balanced data mixing, Qwen2.5-Coder
demonstrates impressive code generation capabilities while retaining general
versatility. The model has been evaluated on a wide range of code-related
tasks, achieving state-of-the-art (SOTA) performance across more than 10
benchmarks, including code generation, completion, reasoning, and repair,
consistently outperforming larger models of the same model size. We believe
that the release of the Qwen2.5-Coder series will not only push the boundaries
of research in code intelligence but also, through its permissive licensing,
encourage broader adoption by developers in real-world applications.
66eb93a8772eb73ab0372cb9
Binyuan Hui
claimed_verified
2024-09-19T07:06:39.282Z
61e4c4ca1ab24785ac11ba69
https://cdn-avatars.huggingface.co/v1/production/uploads/61e4c4ca1ab24785ac11ba69/1Q1zhhyGSJ9RJG9MzwxVv.jpeg
Binyuan Hui
user
huybery
66eb93a8772eb73ab0372cba
Jian Yang
admin_assigned
2024-09-19T08:07:52.138Z
668642801af627989fda2b91
/avatars/c8a880944529124c796ba51b9815148a.svg
yangjian
user
yangjian076
66eb93a8772eb73ab0372cbb
Zeyu Cui
claimed_verified
2024-09-23T14:22:35.249Z
643fb14a18afbc4d1f3ebfb4
https://cdn-avatars.huggingface.co/v1/production/uploads/643fb14a18afbc4d1f3ebfb4/2qeL_qPSB9_MTzZf46ynJ.png
czy yente
user
cyente
66eb93a8772eb73ab0372cbc
Jiaxi Yang
admin_assigned
2024-09-19T08:08:39.224Z
6697a4b1a9e7257fc39d087a
/avatars/65c53ede2f33075528cb3cc91ea743d1.svg
Jiaxi Yang
user
AbbottYJX
66eb93a8772eb73ab0372cbd
Dayiheng Liu
admin_assigned
2024-09-19T07:39:17.113Z
6434d4989bd5a84b5dd0b0f5
https://cdn-avatars.huggingface.co/v1/production/uploads/6434d4989bd5a84b5dd0b0f5/0Elf9qbfG9Hkgypm9pTGm.jpeg
Dayiheng Liu
user
Losin94
66eb93a8772eb73ab0372cbe
Lei Zhang
claimed_verified
2024-09-19T07:06:37.472Z
64c38871f9cd765462fa1a17
https://cdn-avatars.huggingface.co/v1/production/uploads/64c38871f9cd765462fa1a17/yuIlVcqeDlQVKsUF8uEl3.jpeg
Lei Zhang
user
Lemoncoke
66eb93a8772eb73ab0372cbf
Tianyu Liu
66eb93a8772eb73ab0372cc0
Jiajun Zhang
admin_assigned
2024-09-19T08:09:12.743Z
63f108072f7c0152e86fa2ea
/avatars/992ec3f9642df1688c5b20b3f6c938dd.svg
Jiajun Zhang
user
jjzhang
66eb93a8772eb73ab0372cc1
Bowen Yu
66eb93a8772eb73ab0372cc2
Kai Dang
66eb93a8772eb73ab0372cc3
An Yang
claimed_verified
2024-09-23T16:29:42.378Z
62088594a5943c8a8fc94560
https://cdn-avatars.huggingface.co/v1/production/uploads/1644733028938-62088594a5943c8a8fc94560.png
An Yang
user
yangapku
66eb93a8772eb73ab0372cc4
Rui Men
claimed_verified
2024-09-23T16:29:45.616Z
6209bb200436d7d6f27cbeea
/avatars/0b8a72a8b66ef7b36780fe2ccc343f78.svg
Iurnem
user
Iurnem
66eb93a8772eb73ab0372cc5
Fei Huang
admin_assigned
2024-09-19T08:10:52.587Z
635b8b6a37c6a2c12e2cce00
/avatars/229fb72180529141515d1df797b33709.svg
Fei Huang
user
hzhwcmhf
66eb93a8772eb73ab0372cc6
Xingzhang Ren
admin_assigned
2024-09-19T08:11:16.807Z
645c82c4081be4b32049633a
/avatars/e5a08cf0ec5a04bd9d66111382ce0508.svg
xzhren
user
xingzhang
66eb93a8772eb73ab0372cc7
Xuancheng Ren
66eb93a8772eb73ab0372cc8
Jingren Zhou
admin_assigned
2024-09-19T07:39:33.037Z
602f88f5e8149a962412a667
/avatars/b78f0e583df8e5d5e3365934fe5f4900.svg
Zhou
user
Jingren
66eb93a8772eb73ab0372cc9
Junyang Lin
admin_assigned
2024-09-19T07:39:23.673Z
620760a26e3b7210c2ff1943
https://cdn-avatars.huggingface.co/v1/production/uploads/620760a26e3b7210c2ff1943/VC-rKqimF6yxGESNVlPoR.jpeg
Junyang Lin
user
JustinLin610
Qwen2.5-Coder Technical Report
In this report, we introduce the Qwen2.5-Coder series, a significant upgrade
from its predecessor, CodeQwen1.5. This series includes two models:
Qwen2.5-Coder-1.5B and Qwen2.5-Coder-7B. As a code-specific model,
Qwen2.5-Coder is built upon the Qwen2.5 architecture and continues pretrained
on a vast corpus of over 5.5 trillion tokens. Through meticulous data cleaning,
scalable synthetic data generation, and balanced data mixing, Qwen2.5-Coder
demonstrates impressive code generation capabilities while retaining general
versatility. The model has been evaluated on a wide range of code-related
tasks, achieving state-of-the-art (SOTA) performance across more than 10
benchmarks, including code generation, completion, reasoning, and repair,
consistently outperforming larger models of the same model size. We believe
that the release of the Qwen2.5-Coder series will not only push the boundaries
of research in code intelligence but also, through its permissive licensing,
encourage broader adoption by developers in real-world applications.
Qwen2.5-Coder series demonstrates state-of-the-art code generation, completion, reasoning, and repair capabilities using the Qwen2.5 architecture with over 5.5 trillion tokens of training data.
Qwen2.5-Coder Qwen2.5-Coder-1.5B Qwen2.5-Coder-7B Qwen2.5 architecture code generation code completion code reasoning code repair state-of-the-art SOTA