lee5j commited on
Commit
bb6e0ab
ยท
verified ยท
1 Parent(s): fcf095e

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +13 -5
README.md CHANGED
@@ -2,11 +2,19 @@
2
  base_model:
3
  - CarrotAI/EXAONE-3.0-7.8B-Instruct-Llamafied-8k
4
  pipeline_tag: text-generation
5
- tags:
6
- - not-for-all-audiences
 
7
  ---
8
- LG AI EXAONE3 ์„ ๋ผ๋งˆํ™” + 8K ์ปจํ…์ŠคํŠธ ์ฆ๊ฐ€์‹œํ‚จ ๋ชจ๋ธ์„ 4bit awq ์–‘์žํ™” ์‹œํ‚จ ๋ชจ๋ธ์ž…๋‹ˆ๋‹ค.
9
 
10
- Lincense ๋Š” https://huggingface.co/LGAI-EXAONE/EXAONE-3.0-7.8B-Instruct/blob/main/LICENSE
11
 
12
- ์›๋ณธ๋ชจ๋ธ LGAI-EXAONE/EXAONE-3.0-7.8B-Instruct
 
 
 
 
 
 
 
 
2
  base_model:
3
  - CarrotAI/EXAONE-3.0-7.8B-Instruct-Llamafied-8k
4
  pipeline_tag: text-generation
5
+ language:
6
+ - en
7
+ - ko
8
  ---
9
+ LG AI EXAONE3 -> llamafy + 8K Context length -> 4bit awq quantized model
10
 
11
+ tested in vllm, just for use
12
 
13
+ '''
14
+ vllm serve lee5j/EXAONE3-IT8k-llamafy-awq --enforce-eager --gpu-memory-utilization 0.99
15
+ '''
16
+
17
+
18
+ Lincense : https://huggingface.co/LGAI-EXAONE/EXAONE-3.0-7.8B-Instruct/blob/main/LICENSE
19
+
20
+ origin model : LGAI-EXAONE/EXAONE-3.0-7.8B-Instruct