README.md

metadata

base_model:
  - ruslandev/llama-3-8b-samantha
  - MathGenie/MathCoder2-Llama-3-8B
  - nvidia/OpenMath2-Llama3.1-8B
  - NeverSleep/Llama-3-Lumimaid-8B-v0.1-OAS
  - TsinghuaC3I/Llama-3.1-8B-UltraMedical
  - tohur/natsumura-storytelling-rp-1.0-llama-3.1-8b
  - Skywork/Skywork-o1-Open-Llama-3.1-8B
  - Undi95/Llama-3-LewdPlay-8B
  - Locutusque/Hercules-6.1-Llama-3.1-8B
  - RefuelAI/Llama-3-Refueled
  - rombodawg/Llama-3-8B-Instruct-Coder
library_name: transformers
tags:
  - mergekit
  - merge
license: llama3.1

Llamaverse 8B

A Unified Multidisciplinary Language Model
Llamaverse-3.1-8B-Instruct is a state-of-the-art language model built on the foundation of MathCoder2-Llama-3-8B, pretrained on MathCode-Pile. This dataset, which embeds mathematical reasoning steps in natural language and code, provides a rock-solid foundation for advanced logical reasoning. By merging MathCoder2 with 10 specialized models using the Model Stock merge method, Llamaverse-3.1-8B-Instruct becomes an unparalleled polymath, excelling in mathematics, biomedical diagnostics, storytelling, coding, and more.

This model was merged using the Model Stock merge method using MathGenie/MathCoder2-Llama-3-8B as a base.

Models Merged

The following models were included in the merge:

• ruslandev/llama-3-8b-samantha
• nvidia/OpenMath2-Llama3.1-8B
• NeverSleep/Llama-3-Lumimaid-8B-v0.1-OAS
• TsinghuaC3I/Llama-3.1-8B-UltraMedical
• tohur/natsumura-storytelling-rp-1.0-llama-3.1-8b
• Skywork/Skywork-o1-Open-Llama-3.1-8B
• Undi95/Llama-3-LewdPlay-8B
• Locutusque/Hercules-6.1-Llama-3.1-8B
• RefuelAI/Llama-3-Refueled
• rombodawg/Llama-3-8B-Instruct-Coder

Model Stock Merge Ensures balanced integration of diverse expertise without dominance by any single model.

Multidisciplinary Expertise

Llamaverse-3.1-8B-Instruct integrates the strengths of 10 specialized models, including:

1. ruslandev/llama-3-8b-samantha: Empathetic and human-like interaction capabilities.
2. nvidia/OpenMath2-Llama3.1-8B: Advanced mathematical problem-solving.
3. NeverSleep/Llama-3-Lumimaid-8B: Creative storytelling and roleplay.
4. TsinghuaC3I/Llama-3.1-8B-UltraMedical: Clinical-grade biomedical insights.
5. tohur/natsumura-storytelling-rp: Immersive narrative generation.
6. Skywork/Skywork-o1-Open-Llama-3.1-8B: Reflective reasoning and complex problem-solving.
7. Undi95/Llama-3-LewdPlay-8B: Unconventional creativity and boundary-pushing dialogue.
8. Locutusque/Hercules-6.1-Llama-3.1-8B: Expertise in physics, biology, chemistry, and engineering.
9. RefuelAI/Llama-3-Refueled: Robust NLP capabilities for classification and entity extraction.
10. rombodawg/Llama-3-8B-Instruct-Coder: Efficient coding and software development.

Ethical Considerations

Llamaverse-3.1-8B-Instruct must be used responsibly. Users should:

• Avoid deploying the model in high-stakes scenarios without human oversight.
• Be mindful of potential biases and ethical concerns, particularly in sensitive applications.
• Use the model’s creative and unconventional capabilities responsibly.

Configuration

The following YAML configuration was used to produce this model:

models:
  - model: nvidia/OpenMath2-Llama3.1-8B
  - model: Locutusque/Hercules-6.1-Llama-3.1-8B
  - model: RefuelAI/Llama-3-Refueled
  - model: Undi95/Llama-3-LewdPlay-8B
  - model: ruslandev/llama-3-8b-samantha
  - model: rombodawg/Llama-3-8B-Instruct-Coder
  - model: Skywork/Skywork-o1-Open-Llama-3.1-8B
  - model: NeverSleep/Llama-3-Lumimaid-8B-v0.1-OAS
  - model: TsinghuaC3I/Llama-3.1-8B-UltraMedical
  - model: tohur/natsumura-storytelling-rp-1.0-llama-3.1-8b
  
merge_method: model_stock
base_model: MathGenie/MathCoder2-Llama-3-8B
dtype: bfloat16

Built by merging models from MathGenie, ruslandev, nvidia, NeverSleep, TsinghuaC3I, tohur, Skywork, Undi95, Locutusque, RefuelAI, and rombodawg. Released under the Llama 3.1 Community License.