Hugging Face's logo

pwei07
/
Llama-3-8B-NLI-ties

Merge
mergekit
lazymergekit
/content/drive/MyDrive/llama3_anli1_rationale_ft_pretrained
/content/drive/MyDrive/llama3_label_rationale_pretrained3
Model card Files Community
Llama-3-8B-NLI-ties / README.md
pwei07's picture
pwei07
Upload folder using huggingface_hub
1099f0d verified
preview code
|
raw
history blame contribute delete
1.21 kB
metadata
license: apache-2.0
tags:
  - merge
  - mergekit
  - lazymergekit
  - /content/drive/MyDrive/llama3_anli1_rationale_ft_pretrained
  - /content/drive/MyDrive/llama3_label_rationale_pretrained3

Llama-3-8B-NLI-ties

Llama-3-8B-NLI-ties is a merge of the following models using mergekit:

🧩 Configuration 

models:
  - model: /content/drive/MyDrive/llama3_anli1_rationale_ft_pretrained
    parameters:
      density: 1
      weight: 0.5
  - model: /content/drive/MyDrive/llama3_label_rationale_pretrained3
    parameters:
      density: 1
      weight: 0.5
  # - model: WizardLM/WizardMath-13B-V1.0
  #   parameters:
  #     density: 0.33
  #     weight:
  #       - filter: mlp
  #         value: 0.5
  #       - value: 0
merge_method: ties
base_model: /content/drive/MyDrive/Meta-Llama-3-8B-Instruct
parameters:
  normalize: true
  int8_mask: true
dtype: float16