File size: 1,207 Bytes
1099f0d |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 |
---
license: apache-2.0
tags:
- merge
- mergekit
- lazymergekit
- /content/drive/MyDrive/llama3_anli1_rationale_ft_pretrained
- /content/drive/MyDrive/llama3_label_rationale_pretrained3
---
# Llama-3-8B-NLI-ties
Llama-3-8B-NLI-ties is a merge of the following models using [mergekit](https://github.com/cg123/mergekit):
* [/content/drive/MyDrive/llama3_anli1_rationale_ft_pretrained](https://huggingface.co//content/drive/MyDrive/llama3_anli1_rationale_ft_pretrained)
* [/content/drive/MyDrive/llama3_label_rationale_pretrained3](https://huggingface.co//content/drive/MyDrive/llama3_label_rationale_pretrained3)
## 🧩 Configuration
```yaml
models:
- model: /content/drive/MyDrive/llama3_anli1_rationale_ft_pretrained
parameters:
density: 1
weight: 0.5
- model: /content/drive/MyDrive/llama3_label_rationale_pretrained3
parameters:
density: 1
weight: 0.5
# - model: WizardLM/WizardMath-13B-V1.0
# parameters:
# density: 0.33
# weight:
# - filter: mlp
# value: 0.5
# - value: 0
merge_method: ties
base_model: /content/drive/MyDrive/Meta-Llama-3-8B-Instruct
parameters:
normalize: true
int8_mask: true
dtype: float16
``` |