Walmart-the-bag
commited on
Commit
•
32fd16e
1
Parent(s):
9454b84
Update README.md
Browse files
README.md
CHANGED
@@ -20,5 +20,31 @@ This is a merge of 6 models that were finetuned on llama3 8b. This has done pret
|
|
20 |
- **Uncertain Accuracy:** As a merged model, the model's responses may not always be accurate. Users should independently verify any outputs before relying on them.
|
21 |
- **Potential for Censorship:** The model's censorship filters are not comprehensive. There is a possibility of encountering censored code/content.
|
22 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
23 |
## License
|
24 |
i dont really care about this, but here: [Llama3](https://llama.meta.com/llama3/license/)
|
|
|
20 |
- **Uncertain Accuracy:** As a merged model, the model's responses may not always be accurate. Users should independently verify any outputs before relying on them.
|
21 |
- **Potential for Censorship:** The model's censorship filters are not comprehensive. There is a possibility of encountering censored code/content.
|
22 |
|
23 |
+
# Merge Config
|
24 |
+
This model was made possible by this merge yaml.
|
25 |
+
```yaml
|
26 |
+
models:
|
27 |
+
- model: rombodawg/Llama-3-8B-Instruct-Coder
|
28 |
+
parameters:
|
29 |
+
weight: 1.0
|
30 |
+
- model: ajibawa-2023/Code-Llama-3-8B
|
31 |
+
parameters:
|
32 |
+
weight: 0.3
|
33 |
+
- model: meta-llama/Meta-Llama-3-8B-Instruct
|
34 |
+
parameters:
|
35 |
+
weight: 0.5
|
36 |
+
- model: Orenguteng/Llama-3-8B-Lexi-Uncensored
|
37 |
+
parameters:
|
38 |
+
weight: 0.8
|
39 |
+
- model: TheSkullery/llama-3-cat-8b-instruct-v1
|
40 |
+
parameters:
|
41 |
+
weight: 0.9
|
42 |
+
- model: McGill-NLP/Llama-3-8B-Web
|
43 |
+
parameters:
|
44 |
+
weight: 0.2
|
45 |
+
|
46 |
+
merge_method: linear
|
47 |
+
dtype: bfloat16
|
48 |
+
```
|
49 |
## License
|
50 |
i dont really care about this, but here: [Llama3](https://llama.meta.com/llama3/license/)
|