README.md

---
license: cc-by-nc-4.0
library_name: transformers
tags:
- mergekit
- merge
- alpaca
- mistral
- not-for-all-audiences
- nsfw
model-index:
- name: Ice0.16-02.10-RP
 results:
 - task:
 type: text-generation
 name: Text Generation
 dataset:
 name: IFEval (0-Shot)
 type: HuggingFaceH4/ifeval
 args:
 num_few_shot: 0
 metrics:
 - type: inst_level_strict_acc and prompt_level_strict_acc
 value: 50.69
 name: strict accuracy
 source:
 url: https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard?query=icefog72/Ice0.16-02.10-RP
 name: Open LLM Leaderboard
 - task:
 type: text-generation
 name: Text Generation
 dataset:
 name: BBH (3-Shot)
 type: BBH
 args:
 num_few_shot: 3
 metrics:
 - type: acc_norm
 value: 29.58
 name: normalized accuracy
 source:
 url: https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard?query=icefog72/Ice0.16-02.10-RP
 name: Open LLM Leaderboard
 - task:
 type: text-generation
 name: Text Generation
 dataset:
 name: MATH Lvl 5 (4-Shot)
 type: hendrycks/competition_math
 args:
 num_few_shot: 4
 metrics:
 - type: exact_match
 value: 5.14
 name: exact match
 source:
 url: https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard?query=icefog72/Ice0.16-02.10-RP
 name: Open LLM Leaderboard
 - task:
 type: text-generation
 name: Text Generation
 dataset:
 name: GPQA (0-shot)
 type: Idavidrein/gpqa
 args:
 num_few_shot: 0
 metrics:
 - type: acc_norm
 value: 3.91
 name: acc_norm
 source:
 url: https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard?query=icefog72/Ice0.16-02.10-RP
 name: Open LLM Leaderboard
 - task:
 type: text-generation
 name: Text Generation
 dataset:
 name: MuSR (0-shot)
 type: TAUR-Lab/MuSR
 args:
 num_few_shot: 0
 metrics:
 - type: acc_norm
 value: 13.41
 name: acc_norm
 source:
 url: https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard?query=icefog72/Ice0.16-02.10-RP
 name: Open LLM Leaderboard
 - task:
 type: text-generation
 name: Text Generation
 dataset:
 name: MMLU-PRO (5-shot)
 type: TIGER-Lab/MMLU-Pro
 config: main
 split: test
 args:
 num_few_shot: 5
 metrics:
 - type: acc
 value: 22.97
 name: accuracy
 source:
 url: https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard?query=icefog72/Ice0.16-02.10-RP
 name: Open LLM Leaderboard
---
# Ice0.16-02.10-RP

This is a merge of pre-trained language models created using [mergekit](https://github.com/cg123/mergekit).

## Merge Details
### Merge Method

This model was merged using the SLERP merge method.

### Models Merged

The following models were included in the merge:
* G:\FModels\Ice0.15-02.10-RP
* D:\MyMerge\Result\Ice0.15-02.10-RP-02.10-DPO

### Configuration

The following YAML configuration was used to produce this model:

```yaml
slices:
 - sources:
 - model: G:\FModels\Ice0.15-02.10-RP
 layer_range: [0, 32]
 - model: D:\MyMerge\Result\Ice0.15-02.10-RP-02.10-DPO
 layer_range: [0, 32]

merge_method: slerp
base_model: D:\MyMerge\Result\Ice0.15-02.10-RP-02.10-DPO
parameters:
 t:
 - filter: self_attn
 value: [0, 0.5, 0.3, 0.7, 1]
 - filter: mlp
 value: [1, 0.5, 0.7, 0.3, 0]
 - value: 0.5 # fallback for rest of tensors
dtype: bfloat16


```

# [Open LLM Leaderboard Evaluation Results](https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard)
Detailed results can be found [here](https://huggingface.co/datasets/open-llm-leaderboard/details_icefog72__Ice0.16-02.10-RP)

| Metric |Value|
|-------------------|----:|
|Avg. |20.95|
|IFEval (0-Shot) |50.69|
|BBH (3-Shot) |29.58|
|MATH Lvl 5 (4-Shot)| 5.14|
|GPQA (0-shot) | 3.91|
|MuSR (0-shot) |13.41|
|MMLU-PRO (5-shot) |22.97|