---
base_model:
- ruslandev/llama-3-8b-samantha
- MathGenie/MathCoder2-Llama-3-8B
- nvidia/OpenMath2-Llama3.1-8B
- NeverSleep/Llama-3-Lumimaid-8B-v0.1-OAS
- TsinghuaC3I/Llama-3.1-8B-UltraMedical
- tohur/natsumura-storytelling-rp-1.0-llama-3.1-8b
- Skywork/Skywork-o1-Open-Llama-3.1-8B
- Undi95/Llama-3-LewdPlay-8B
- Locutusque/Hercules-6.1-Llama-3.1-8B
- RefuelAI/Llama-3-Refueled
- rombodawg/Llama-3-8B-Instruct-Coder
library_name: transformers
tags:
- mergekit
- merge
license: llama3.1
---
# Llamaverse 8B

**A Unified Multidisciplinary Language Model**  
Llamaverse-3.1-8B-Instruct is a state-of-the-art language model built on the foundation of MathCoder2-Llama-3-8B, pretrained on MathCode-Pile. This dataset, which embeds mathematical reasoning steps in natural language and code, provides a rock-solid foundation for advanced logical reasoning. By merging MathCoder2 with 10 specialized models using the Model Stock merge method, Llamaverse-3.1-8B-Instruct becomes an unparalleled polymath, excelling in mathematics, biomedical diagnostics, storytelling, coding, and more.

This model was merged using the [Model Stock](https://arxiv.org/abs/2403.19522) merge method using [MathGenie/MathCoder2-Llama-3-8B](https://huggingface.co/MathGenie/MathCoder2-Llama-3-8B) as a base.

### Models Merged

The following models were included in the merge:
* [ruslandev/llama-3-8b-samantha](https://huggingface.co/ruslandev/llama-3-8b-samantha)
* [nvidia/OpenMath2-Llama3.1-8B](https://huggingface.co/nvidia/OpenMath2-Llama3.1-8B)
* [NeverSleep/Llama-3-Lumimaid-8B-v0.1-OAS](https://huggingface.co/NeverSleep/Llama-3-Lumimaid-8B-v0.1-OAS)
* [TsinghuaC3I/Llama-3.1-8B-UltraMedical](https://huggingface.co/TsinghuaC3I/Llama-3.1-8B-UltraMedical)
* [tohur/natsumura-storytelling-rp-1.0-llama-3.1-8b](https://huggingface.co/tohur/natsumura-storytelling-rp-1.0-llama-3.1-8b)
* [Skywork/Skywork-o1-Open-Llama-3.1-8B](https://huggingface.co/Skywork/Skywork-o1-Open-Llama-3.1-8B)
* [Undi95/Llama-3-LewdPlay-8B](https://huggingface.co/Undi95/Llama-3-LewdPlay-8B)
* [Locutusque/Hercules-6.1-Llama-3.1-8B](https://huggingface.co/Locutusque/Hercules-6.1-Llama-3.1-8B)
* [RefuelAI/Llama-3-Refueled](https://huggingface.co/RefuelAI/Llama-3-Refueled)
* [rombodawg/Llama-3-8B-Instruct-Coder](https://huggingface.co/rombodawg/Llama-3-8B-Instruct-Coder)

Model Stock Merge Ensures balanced integration of diverse expertise without dominance by any single model.

## **Multidisciplinary Expertise**  
Llamaverse-3.1-8B-Instruct integrates the strengths of **10 specialized models**, including:  
1. **ruslandev/llama-3-8b-samantha:** Empathetic and human-like interaction capabilities.  
2. **nvidia/OpenMath2-Llama3.1-8B:** Advanced mathematical problem-solving.  
3. **NeverSleep/Llama-3-Lumimaid-8B:** Creative storytelling and roleplay.  
4. **TsinghuaC3I/Llama-3.1-8B-UltraMedical:** Clinical-grade biomedical insights.  
5. **tohur/natsumura-storytelling-rp:** Immersive narrative generation.  
6. **Skywork/Skywork-o1-Open-Llama-3.1-8B:** Reflective reasoning and complex problem-solving.  
7. **Undi95/Llama-3-LewdPlay-8B:** Unconventional creativity and boundary-pushing dialogue.  
8. **Locutusque/Hercules-6.1-Llama-3.1-8B:** Expertise in physics, biology, chemistry, and engineering.  
9. **RefuelAI/Llama-3-Refueled:** Robust NLP capabilities for classification and entity extraction.  
10. **rombodawg/Llama-3-8B-Instruct-Coder:** Efficient coding and software development.  

## **Ethical Considerations**  
Llamaverse-3.1-8B-Instruct must be used responsibly. Users should:  
- Avoid deploying the model in high-stakes scenarios without human oversight.  
- Be mindful of potential biases and ethical concerns, particularly in sensitive applications.  
- Use the model’s creative and unconventional capabilities responsibly.


### Configuration

The following YAML configuration was used to produce this model:

```yaml

models:
  - model: nvidia/OpenMath2-Llama3.1-8B
  - model: Locutusque/Hercules-6.1-Llama-3.1-8B
  - model: RefuelAI/Llama-3-Refueled
  - model: Undi95/Llama-3-LewdPlay-8B
  - model: ruslandev/llama-3-8b-samantha
  - model: rombodawg/Llama-3-8B-Instruct-Coder
  - model: Skywork/Skywork-o1-Open-Llama-3.1-8B
  - model: NeverSleep/Llama-3-Lumimaid-8B-v0.1-OAS
  - model: TsinghuaC3I/Llama-3.1-8B-UltraMedical
  - model: tohur/natsumura-storytelling-rp-1.0-llama-3.1-8b
  
merge_method: model_stock
base_model: MathGenie/MathCoder2-Llama-3-8B
dtype: bfloat16

```

Built by merging models from MathGenie, ruslandev, nvidia, NeverSleep, TsinghuaC3I, tohur, Skywork, Undi95, Locutusque, RefuelAI, and rombodawg. Released under the Llama 3.1 Community License.