Update README.md
Browse files
README.md
CHANGED
|
@@ -1,18 +1,18 @@
|
|
| 1 |
-
---
|
| 2 |
-
license: llama3
|
| 3 |
-
language:
|
| 4 |
-
- en
|
| 5 |
-
- zh
|
| 6 |
-
tags:
|
| 7 |
-
- not-for-all-audiences
|
| 8 |
-
datasets:
|
| 9 |
-
- unalignment/toxic-dpo-v0.2
|
| 10 |
-
- shareAI/DPO-zh-en-emoji
|
| 11 |
-
- argilla/distilabel-math-preference-dpo
|
| 12 |
-
- antiven0m/physical-reasoning-dpo
|
| 13 |
-
- AlekseyKorshuk/evol-codealpaca-v1-dpo
|
| 14 |
-
- Intel/orca_dpo_pairs
|
| 15 |
-
---
|
| 16 |
|
| 17 |
# Llama3-70B-Orion-Chinese
|
| 18 |
|
|
@@ -24,6 +24,8 @@ datasets:
|
|
| 24 |
|
| 25 |
> 我保留了一部分emoji, 这样你才知道你用的是llama3
|
| 26 |
|
|
|
|
|
|
|
| 27 |
## 上下文扩展
|
| 28 |
|
| 29 |
根据[描述](https://github.com/CrazyBoyM/llama3-Chinese-chat#llama3%E4%B8%8A%E4%B8%8B%E6%96%87%E9%95%BF%E5%BA%A6%E7%AE%80%E5%8D%95%E6%97%A0%E6%8D%9F%E4%B8%89%E6%AD%A5%E6%89%A9%E5%BC%A0%E6%B3%9532k96k), 可以采用如下方式将llama3的上下文无痛扩展至32k:
|
|
|
|
| 1 |
+
---
|
| 2 |
+
license: llama3
|
| 3 |
+
language:
|
| 4 |
+
- en
|
| 5 |
+
- zh
|
| 6 |
+
tags:
|
| 7 |
+
- not-for-all-audiences
|
| 8 |
+
datasets:
|
| 9 |
+
- unalignment/toxic-dpo-v0.2
|
| 10 |
+
- shareAI/DPO-zh-en-emoji
|
| 11 |
+
- argilla/distilabel-math-preference-dpo
|
| 12 |
+
- antiven0m/physical-reasoning-dpo
|
| 13 |
+
- AlekseyKorshuk/evol-codealpaca-v1-dpo
|
| 14 |
+
- Intel/orca_dpo_pairs
|
| 15 |
+
---
|
| 16 |
|
| 17 |
# Llama3-70B-Orion-Chinese
|
| 18 |
|
|
|
|
| 24 |
|
| 25 |
> 我保留了一部分emoji, 这样你才知道你用的是llama3
|
| 26 |
|
| 27 |
+
**exl2 4bpw量化版**: [Orion-zhen/Llama3-70B-Orion-Chinese-4bpw-exl2](https://huggingface.co/Orion-zhen/Llama3-70B-Orion-Chinese-4bpw-exl2)
|
| 28 |
+
|
| 29 |
## 上下文扩展
|
| 30 |
|
| 31 |
根据[描述](https://github.com/CrazyBoyM/llama3-Chinese-chat#llama3%E4%B8%8A%E4%B8%8B%E6%96%87%E9%95%BF%E5%BA%A6%E7%AE%80%E5%8D%95%E6%97%A0%E6%8D%9F%E4%B8%89%E6%AD%A5%E6%89%A9%E5%BC%A0%E6%B3%9532k96k), 可以采用如下方式将llama3的上下文无痛扩展至32k:
|