Like my work? Support me on patreon for only $5 a month and get to vote on what model's i make next as well as get access to this org's private repo's

Subscribe bellow:

  • Patreon.com/Rombodawg

Rombo-LLM-V3.1-QWQ-32b

image/jpeg

Rombo-LLM-V3.1-QWQ-32b is a Continued Finetune model (Merge only) of (Qwen/QwQ-32B) and its base model (Qwen/Qwen2.5-32B). This merge is done to decrease catastrophic forgetting during finetuning, and increase overall performance of the model. The tokenizers are taken from the QwQ-32B for thinking capabilities.

You can find the Continous Finetuning Doc bellow for more details on the full method:

Quantized model: (coming soon)

-

Benchmarks: (coming soon)

Downloads last month
0
Safetensors
Model size
32.8B params
Tensor type
BF16
·
Inference Providers NEW
This model is not currently available via any of the supported Inference Providers.
The model cannot be deployed to the HF Inference API: The model has no library tag.

Model tree for Rombo-Org/Rombo-LLM-V3.1-QWQ-32b

Base model

Qwen/Qwen2.5-32B
Finetuned
Qwen/QwQ-32B
Finetuned
(4)
this model
Quantizations
5 models