Rose-2x7B-GGUF

Rose-2x7B-GGUF is GGUF version of Rose-2x7B which is a Mixure of Experts (MoE) made with the following models using Mergekit:

🧩 Configuration

base_model: uproai/ros-7b-v1
experts:
  - source_model: maywell/PiVoT-0.1-Starling-LM-RP
    positive_prompts:
    - "storywriting"
    - "write"
    - "scene"
    - "story"
    - "character"
  - source_model: WizardLM/WizardMath-7B-V1.1
    positive_prompts:
    - "reason"
    - "math"
    - "mathematics"
    - "solve"
    - "count"
tokenizer_source: union
Downloads last month
2
GGUF
Model size
12.9B params
Architecture
llama
Inference API
Unable to determine this model's library. Check the docs .

Model tree for uproai/Rose-2x7B-GGUF