A newer version of this model is available: chaphi/SAXON-0-I

image/png

SAXON-0

This is the base model for the SAXON model series, resulting from a merge of pre-trained language models created using mergekit. It is not yet finetuned on the SAXON dataset.

Merge Details

Merge Method

This model was merged using the TIES merge method using an uncensored version of DeepSeek-R1-Distill-Llama-8B as a base.

Models Merged

The following models were included in the merge:

Configuration

The following YAML configuration was used to produce this model:

models:
  - model: NousResearch/Hermes-3-Llama-3.1-8B
    parameters:
      density: 0.5
      weight: 0.5
  - model: allenai/Llama-3.1-Tulu-3-8B
    parameters:
      density: 0.5
      weight: 0.5

merge_method: ties
base_model: huihui-ai/DeepSeek-R1-Distill-Llama-8B-abliterated
parameters:
  normalize: false
  int8_mask: true
dtype: float16
Downloads last month
44
Safetensors
Model size
8.03B params
Tensor type
FP16
·
Inference Providers NEW
This model is not currently available via any of the supported Inference Providers.

Model tree for chaphi/SAXON-0