cyente commited on
Commit
8ab93d6
1 Parent(s): d2b9ec5

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +1 -3
README.md CHANGED
@@ -23,8 +23,6 @@ Qwen2.5-Coder is the latest series of Code-Specific Qwen large language models (
23
 
24
  - Significantly improvements in **code generation**, **code reasoning** and **code fixing**. Base on the strong Qwen2.5, we scale up the training tokens into 5.5 trillion including source code, text-code grounding, Synthetic data, etc. Qwen2.5-Coder-32B has become the current state-of-the-art open-source codeLLM, with its coding abilities matching those of GPT-4o.
25
  - A more comprehensive foundation for real-world applications such as **Code Agents**. Not only enhancing coding capabilities but also maintaining its strengths in mathematics and general competencies.
26
- - **Long-context Support** up to 128K tokens.
27
-
28
 
29
  **This repo contains the 3B Qwen2.5-Coder model**, which has the following features:
30
  - Type: Causal Language Models
@@ -34,7 +32,7 @@ Qwen2.5-Coder is the latest series of Code-Specific Qwen large language models (
34
  - Number of Paramaters (Non-Embedding): 2.77B
35
  - Number of Layers: 36
36
  - Number of Attention Heads (GQA): 16 for Q and 2 for KV
37
- - Context Length: Full 131,072 tokens
38
  - Please refer to [this section](#processing-long-texts) for detailed instructions on how to deploy Qwen2.5 for handling long texts.
39
 
40
  **We do not recommend using base language models for conversations.** Instead, you can apply post-training, e.g., SFT, RLHF, continued pretraining, etc., or fill in the middle tasks on this model.
 
23
 
24
  - Significantly improvements in **code generation**, **code reasoning** and **code fixing**. Base on the strong Qwen2.5, we scale up the training tokens into 5.5 trillion including source code, text-code grounding, Synthetic data, etc. Qwen2.5-Coder-32B has become the current state-of-the-art open-source codeLLM, with its coding abilities matching those of GPT-4o.
25
  - A more comprehensive foundation for real-world applications such as **Code Agents**. Not only enhancing coding capabilities but also maintaining its strengths in mathematics and general competencies.
 
 
26
 
27
  **This repo contains the 3B Qwen2.5-Coder model**, which has the following features:
28
  - Type: Causal Language Models
 
32
  - Number of Paramaters (Non-Embedding): 2.77B
33
  - Number of Layers: 36
34
  - Number of Attention Heads (GQA): 16 for Q and 2 for KV
35
+ - Context Length: Full 32,768 tokens
36
  - Please refer to [this section](#processing-long-texts) for detailed instructions on how to deploy Qwen2.5 for handling long texts.
37
 
38
  **We do not recommend using base language models for conversations.** Instead, you can apply post-training, e.g., SFT, RLHF, continued pretraining, etc., or fill in the middle tasks on this model.