Qwen2.5-Coder Technical Report
- Qwen2.5-Coder Technical Report
- Qwen2.5-Coder Documentation
- Qwen2.5-Coder Blog
- Qwen2.5-Coder GitHub
- HuggingFace Qwen2.5-Coder-7B-Instruct
In this report, we introduce the Qwen2.5-Coder series, a significant upgrade from its predecessor, CodeQwen1.5. This series includes two models: Qwen2.5-Coder-1.5B and Qwen2.5-Coder-7B. As a code-specific model, Qwen2.5-Coder is built upon the Qwen2.5 architecture and continues pretrained on a vast corpus of over 5.5 trillion tokens. Through meticulous data cleaning, scalable synthetic data generation, and balanced data mixing, Qwen2.