Upload folder using huggingface_hub

README.md

@@ -3,38 +3,31 @@ tags:
 - merge
 - mergekit
 - lazymergekit
-- timpal0l/Mistral-7B-v0.1-flashback-v2
 - mlabonne/NeuralBeagle14-7B
 base_model:
-- timpal0l/Mistral-7B-v0.1-flashback-v2
 - mlabonne/NeuralBeagle14-7B
 ---
 
 # NeuralBeagle-Flashback
 
 NeuralBeagle-Flashback is a merge of the following models using [LazyMergekit](https://colab.research.google.com/drive/1obulZ1ROXHjYLn6PPZJwRR6GzgQogxxb?usp=sharing):
-* [timpal0l/Mistral-7B-v0.1-flashback-v2](https://huggingface.co/timpal0l/Mistral-7B-v0.1-flashback-v2)
 * [mlabonne/NeuralBeagle14-7B](https://huggingface.co/mlabonne/NeuralBeagle14-7B)
 
 ## 🧩 Configuration
 
 ```yaml
-slices:
- - sources:
- - model: timpal0l/Mistral-7B-v0.1-flashback-v2
- layer_range: [0, 32]
- - model: mlabonne/NeuralBeagle14-7B
- layer_range: [0, 32]
-merge_method: slerp
-base_model: timpal0l/Mistral-7B-v0.1-flashback-v2
-parameters:
- t:
- - filter: self_attn
- value: [0, 0.5, 0.3, 0.7, 1]
- - filter: mlp
- value: [1, 0.5, 0.7, 0.3, 0]
- - value: 0.5
-dtype: bfloat16
+ models:
+ - model: timpal0l/Mistral-7B-v0.1-flashback-v2
+ # No parameters necessary for base model
+ - model: mlabonne/NeuralBeagle14-7B
+ parameters:
+ density: 0.53
+ weight: 0.6
+ merge_method: dare_ties
+ base_model: timpal0l/Mistral-7B-v0.1-flashback-v2
+ parameters:
+ int8_mask: true
+ dtype: bfloat16
 ```
 
 ## 💻 Usage