Walmart-the-bag commited on
Commit
32fd16e
1 Parent(s): 9454b84

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +26 -0
README.md CHANGED
@@ -20,5 +20,31 @@ This is a merge of 6 models that were finetuned on llama3 8b. This has done pret
20
  - **Uncertain Accuracy:** As a merged model, the model's responses may not always be accurate. Users should independently verify any outputs before relying on them.
21
  - **Potential for Censorship:** The model's censorship filters are not comprehensive. There is a possibility of encountering censored code/content.
22
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
23
  ## License
24
  i dont really care about this, but here: [Llama3](https://llama.meta.com/llama3/license/)
 
20
  - **Uncertain Accuracy:** As a merged model, the model's responses may not always be accurate. Users should independently verify any outputs before relying on them.
21
  - **Potential for Censorship:** The model's censorship filters are not comprehensive. There is a possibility of encountering censored code/content.
22
 
23
+ # Merge Config
24
+ This model was made possible by this merge yaml.
25
+ ```yaml
26
+ models:
27
+ - model: rombodawg/Llama-3-8B-Instruct-Coder
28
+ parameters:
29
+ weight: 1.0
30
+ - model: ajibawa-2023/Code-Llama-3-8B
31
+ parameters:
32
+ weight: 0.3
33
+ - model: meta-llama/Meta-Llama-3-8B-Instruct
34
+ parameters:
35
+ weight: 0.5
36
+ - model: Orenguteng/Llama-3-8B-Lexi-Uncensored
37
+ parameters:
38
+ weight: 0.8
39
+ - model: TheSkullery/llama-3-cat-8b-instruct-v1
40
+ parameters:
41
+ weight: 0.9
42
+ - model: McGill-NLP/Llama-3-8B-Web
43
+ parameters:
44
+ weight: 0.2
45
+
46
+ merge_method: linear
47
+ dtype: bfloat16
48
+ ```
49
  ## License
50
  i dont really care about this, but here: [Llama3](https://llama.meta.com/llama3/license/)