README.md

--- 
library_name: transformers 
tags: 
- mergekit 
- merge 
base_model: [] 
model-index: 
- name: Ice0.7-29.09-RP 
 results: 
 - task: 
 type: text-generation 
 name: Text Generation 
 dataset: 
 name: IFEval (0-Shot) 
 type: HuggingFaceH4/ifeval 
 args: 
 num_few_shot: 0 
 metrics: 
 - type: inst_level_strict_acc and prompt_level_strict_acc 
 value: 51.76 
 name: strict accuracy 
 source: 
 url: https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard?query=icefog72/Ice0.7-29.09-RP 
 name: Open LLM Leaderboard 
 - task: 
 type: text-generation 
 name: Text Generation 
 dataset: 
 name: BBH (3-Shot) 
 type: BBH 
 args: 
 num_few_shot: 3 
 metrics: 
 - type: acc_norm 
 value: 30.73 
 name: normalized accuracy 
 source: 
 url: https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard?query=icefog72/Ice0.7-29.09-RP 
 name: Open LLM Leaderboard 
 - task: 
 type: text-generation 
 name: Text Generation 
 dataset: 
 name: MATH Lvl 5 (4-Shot) 
 type: hendrycks/competition_math 
 args: 
 num_few_shot: 4 
 metrics: 
 - type: exact_match 
 value: 6.19 
 name: exact match 
 source: 
 url: https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard?query=icefog72/Ice0.7-29.09-RP 
 name: Open LLM Leaderboard 
 - task: 
 type: text-generation 
 name: Text Generation 
 dataset: 
 name: GPQA (0-shot) 
 type: Idavidrein/gpqa 
 args: 
 num_few_shot: 0 
 metrics: 
 - type: acc_norm 
 value: 5.03 
 name: acc_norm 
 source: 
 url: https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard?query=icefog72/Ice0.7-29.09-RP 
 name: Open LLM Leaderboard 
 - task: 
 type: text-generation 
 name: Text Generation 
 dataset: 
 name: MuSR (0-shot) 
 type: TAUR-Lab/MuSR 
 args: 
 num_few_shot: 0 
 metrics: 
 - type: acc_norm 
 value: 11.51 
 name: acc_norm 
 source: 
 url: https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard?query=icefog72/Ice0.7-29.09-RP 
 name: Open LLM Leaderboard 
 - task: 
 type: text-generation 
 name: Text Generation 
 dataset: 
 name: MMLU-PRO (5-shot) 
 type: TIGER-Lab/MMLU-Pro 
 config: main 
 split: test 
 args: 
 num_few_shot: 5 
 metrics: 
 - type: acc 
 value: 23.63 
 name: accuracy 
 source: 
 url: https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard?query=icefog72/Ice0.7-29.09-RP 
 name: Open LLM Leaderboard 
--- 
# Ice0.7-29.09-RP 
 
This is a merge of pre-trained language models created using [mergekit](https://github.com/cg123/mergekit). 
 
## Merge Details 
### Merge Method 
 
This model was merged using the SLERP merge method. 
 
### Models Merged 
 
The following models were included in the merge: 
* F:\FModels\Ice0.5-28.09-RP 
* E:\FModels\Ice0.6-29.09-RP 
 
### Configuration 
 
The following YAML configuration was used to produce this model: 
 
```yaml 
slices: 
 - sources: 
 - model: E:\FModels\Ice0.6-29.09-RP 
 layer_range: [0, 32] 
 - model: F:\FModels\Ice0.5-28.09-RP 
 layer_range: [0, 32] 
 
merge_method: slerp 
base_model: F:\FModels\Ice0.5-28.09-RP 
parameters: 
 t: 
 - filter: self_attn 
 value: [0, 0.5, 0.3, 0.7, 1] 
 - filter: mlp 
 value: [1, 0.5, 0.7, 0.3, 0] 
 - value: 0.5 # fallback for rest of tensors 
dtype: bfloat16 
 
 
``` 

# [Open LLM Leaderboard Evaluation Results](https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard)
Detailed results can be found [here](https://huggingface.co/datasets/open-llm-leaderboard/details_icefog72__Ice0.7-29.09-RP)

| Metric |Value|
|-------------------|----:|
|Avg. |21.47|
|IFEval (0-Shot) |51.76|
|BBH (3-Shot) |30.73|
|MATH Lvl 5 (4-Shot)| 6.19|
|GPQA (0-shot) | 5.03|
|MuSR (0-shot) |11.51|
|MMLU-PRO (5-shot) |23.63|