rombodawg commited on
Commit
1cb035d
·
verified ·
1 Parent(s): 5256ee4

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +15 -42
README.md CHANGED
@@ -1,42 +1,15 @@
1
- ---
2
- base_model: []
3
- library_name: transformers
4
- tags:
5
- - mergekit
6
- - merge
7
-
8
- ---
9
- # Rombo-LLM-V2.7-llama-3.2-3b
10
-
11
- This is a merge of pre-trained language models created using [mergekit](https://github.com/cg123/mergekit).
12
-
13
- ## Merge Details
14
- ### Merge Method
15
-
16
- This model was merged using the [TIES](https://arxiv.org/abs/2306.01708) merge method using E:\Open_source_ai_chatbot\OOBA-13\text-generation-webui-main\models\unsloth_Llama-3.2-3B as a base.
17
-
18
- ### Models Merged
19
-
20
- The following models were included in the merge:
21
- * E:\Open_source_ai_chatbot\OOBA-13\text-generation-webui-main\models\unsloth_Llama-3.2-3B-Instruct
22
-
23
- ### Configuration
24
-
25
- The following YAML configuration was used to produce this model:
26
-
27
- ```yaml
28
- models:
29
- - model: E:\Open_source_ai_chatbot\OOBA-13\text-generation-webui-main\models\unsloth_Llama-3.2-3B-Instruct
30
- parameters:
31
- weight: 1
32
- density: 1
33
- merge_method: ties
34
- base_model: E:\Open_source_ai_chatbot\OOBA-13\text-generation-webui-main\models\unsloth_Llama-3.2-3B
35
- parameters:
36
- weight: 1
37
- density: 1
38
- normalize: true
39
- int8_mask: false
40
- dtype: bfloat16
41
-
42
- ```
 
1
+ ---
2
+ library_name: transformers
3
+ base_model:
4
+ - meta-llama/Llama-3.2-3B-Instruct
5
+ license: llama3.2
6
+ ---
7
+ # Rombo-LLM-V2.7-llama-3.2-3b
8
+
9
+ ![image/jpeg](https://cdn-uploads.huggingface.co/production/uploads/642cc1c253e76b4c2286c58e/oL_yvvRsWj2C4niGgkT2A.jpeg)
10
+
11
+ Rombo-LLM-V2.7-llama-3.2-3b is an combined pretrained and instruct tuned model based on (Llama-3.2-3B) and (Llama-3.2-3b-instruct) giving the benefits of both versions all in 1 model.
12
+
13
+ This model can be used to furter finetune, or right out of the box for inference.
14
+
15
+ Quants: (coming soon)