--- language: - sv - da - 'no' - is - en license: apache-2.0 tags: - merge base_model: - timpal0l/Mistral-7B-v0.1-flashback-v2 - RJuro/munin-neuralbeagle-7b-GGUF pipeline_tag: text-generation --- ![](https://huggingface.co/timpal0l/flashbeagle-7b/resolve/main/model_img.png?download=true) This model is a [Slerp Merge](https://github.com/cg123/mergekit/blob/main/mergekit/merge_methods/slerp.py) of [timpal0l/Mistral-7B-v0.1-flashback-v2/](https://huggingface.co/timpal0l/Mistral-7B-v0.1-flashback-v2) and [RJuro/munin-neuralbeagle-7b](https://huggingface.co/RJuro/munin-neuralbeagle-7b). ## config.yaml ```yaml slices: - sources: - model: timpal0l/Mistral-7B-v0.1-flashback-v2 layer_range: [0, 32] - model: RJuro/munin-neuralbeagle-7b layer_range: [0, 32] merge_method: slerp base_model: timpal0l/Mistral-7B-v0.1-flashback-v2 parameters: t: - filter: self_attn value: [0, 0.5, 0.3, 0.7, 1] - filter: mlp value: [1, 0.5, 0.7, 0.3, 0] - value: 0.5 dtype: bfloat16 ```