llama2-codellama-taskarithmatic / mergekit_config.yml
rickp1011's picture
Upload folder using huggingface_hub
9a84f07 verified
models:
- model: meta-llama/Llama-2-7b-hf
- model: meta-llama/CodeLlama-7b-Python-hf
parameters:
density: 0.55
weight: 0.5
- model: meta-llama/CodeLlama-7b-Instruct-hf
parameters:
density: 0.65
weight: 0.5
base_model: meta-llama/Llama-2-7b-hf
merge_method: task_arithmetic
dtype: float16