---
base_model:
- ruslandev/llama-3-8b-samantha
- MathGenie/MathCoder2-Llama-3-8B
- nvidia/OpenMath2-Llama3.1-8B
- NeverSleep/Llama-3-Lumimaid-8B-v0.1-OAS
- TsinghuaC3I/Llama-3.1-8B-UltraMedical
- tohur/natsumura-storytelling-rp-1.0-llama-3.1-8b
- Skywork/Skywork-o1-Open-Llama-3.1-8B
- Undi95/Llama-3-LewdPlay-8B
- Locutusque/Hercules-6.1-Llama-3.1-8B
- RefuelAI/Llama-3-Refueled
- rombodawg/Llama-3-8B-Instruct-Coder
library_name: transformers
tags:
- mergekit
- merge

---
# merge

This is a merge of pre-trained language models created using [mergekit](https://github.com/cg123/mergekit).

## Merge Details
### Merge Method

This model was merged using the [Model Stock](https://arxiv.org/abs/2403.19522) merge method using [MathGenie/MathCoder2-Llama-3-8B](https://huggingface.co/MathGenie/MathCoder2-Llama-3-8B) as a base.

### Models Merged

The following models were included in the merge:
* [ruslandev/llama-3-8b-samantha](https://huggingface.co/ruslandev/llama-3-8b-samantha)
* [nvidia/OpenMath2-Llama3.1-8B](https://huggingface.co/nvidia/OpenMath2-Llama3.1-8B)
* [NeverSleep/Llama-3-Lumimaid-8B-v0.1-OAS](https://huggingface.co/NeverSleep/Llama-3-Lumimaid-8B-v0.1-OAS)
* [TsinghuaC3I/Llama-3.1-8B-UltraMedical](https://huggingface.co/TsinghuaC3I/Llama-3.1-8B-UltraMedical)
* [tohur/natsumura-storytelling-rp-1.0-llama-3.1-8b](https://huggingface.co/tohur/natsumura-storytelling-rp-1.0-llama-3.1-8b)
* [Skywork/Skywork-o1-Open-Llama-3.1-8B](https://huggingface.co/Skywork/Skywork-o1-Open-Llama-3.1-8B)
* [Undi95/Llama-3-LewdPlay-8B](https://huggingface.co/Undi95/Llama-3-LewdPlay-8B)
* [Locutusque/Hercules-6.1-Llama-3.1-8B](https://huggingface.co/Locutusque/Hercules-6.1-Llama-3.1-8B)
* [RefuelAI/Llama-3-Refueled](https://huggingface.co/RefuelAI/Llama-3-Refueled)
* [rombodawg/Llama-3-8B-Instruct-Coder](https://huggingface.co/rombodawg/Llama-3-8B-Instruct-Coder)

### Configuration

The following YAML configuration was used to produce this model:

```yaml

models:
  - model: nvidia/OpenMath2-Llama3.1-8B
  - model: Locutusque/Hercules-6.1-Llama-3.1-8B
  - model: RefuelAI/Llama-3-Refueled
  - model: Undi95/Llama-3-LewdPlay-8B
  - model: ruslandev/llama-3-8b-samantha
  - model: rombodawg/Llama-3-8B-Instruct-Coder
  - model: Skywork/Skywork-o1-Open-Llama-3.1-8B
  - model: NeverSleep/Llama-3-Lumimaid-8B-v0.1-OAS
  - model: TsinghuaC3I/Llama-3.1-8B-UltraMedical
  - model: tohur/natsumura-storytelling-rp-1.0-llama-3.1-8b
  
merge_method: model_stock
base_model: MathGenie/MathCoder2-Llama-3-8B
dtype: bfloat16

```