apepkuss79 commited on
Commit
345cd15
1 Parent(s): ce1aa20

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +42 -3
README.md CHANGED
@@ -1,3 +1,42 @@
1
- ---
2
- license: apache-2.0
3
- ---
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ base_model: Qwen/Qwen2.5-Coder-32B-Instruct
3
+ license: apache-2.0
4
+ license_link: https://huggingface.co/Qwen/Qwen2.5-Coder-32B-Instruct/blob/main/LICENSE
5
+ model_creator: Qwen
6
+ model_name: Qwen2.5-Coder-32B-Instruct
7
+ quantized_by: Second State Inc.
8
+ language:
9
+ - en
10
+ pipeline_tag: text-generation
11
+ library_name: transformers
12
+ tags:
13
+ - code
14
+ - codeqwen
15
+ - chat
16
+ - qwen
17
+ - qwen-coder
18
+ ---
19
+
20
+ # Qwen2.5-Coder-32B-Instruct-GGUF
21
+
22
+ ## Original Model
23
+
24
+ [Qwen/Qwen2.5-Coder-32B-Instruct](https://huggingface.co/Qwen/Qwen2.5-Coder-32B-Instruct)
25
+
26
+ ## Run with Gaianet
27
+
28
+ **Prompt template**
29
+
30
+ prompt template: `chatml`
31
+
32
+ **Context size**
33
+
34
+ chat_ctx_size: `128000`
35
+
36
+ **Run with GaiaNet**
37
+
38
+ - Quick start: https://docs.gaianet.ai/node-guide/quick-start
39
+
40
+ - Customize your node: https://docs.gaianet.ai/node-guide/customize
41
+
42
+ *Quantized with llama.cpp b4033*