MrRobotoAI/MrRoboto-ProLongBASE-pt1-unaligned-8b

merge

This is a merge of pre-trained language models created using mergekit.

Merge Details

Merge Method

This model was merged using the Model Stock merge method using MrRobotoAI/MrRoboto-ProLong-8b-v4i as a base.

Models Merged

The following models were included in the merge:

• akjindal53244/Llama-3.1-Storm-8B
• MrRobotoAI/HEL-v0.8-8b-LONG-DARK
• nothingiisreal/L3-8B-Stheno-Horny-v3.3-32K + Blackroot/Llama-3-LongStory-LORA
• v000000/L3.1-Sthenorm-8B
• MrRobotoAI/8b-unaligned-BASE-v2a
• MrRobotoAI/Test-v0.9-8b
• MrRobotoAI/Thor-v1.4-8b-DARK-FICTION
• MrRobotoAI/8b-DARK-unaligned-base
• cgato/L3-TheSpice-8b-v0.8.3 + Blackroot/Llama-3-8B-Abomination-LORA
• MrRobotoAI/8b-CHATTY-unaligned-base
• DeepAutoAI/ldm_soup_Llama-3.1-8B-Inst
• OpenBuddy/openbuddy-llama3.1-8b-v22.2-131k
• MrRobotoAI/Loki-v2.8-8b-EROTICA

Configuration

The following YAML configuration was used to produce this model:

models:
  - model: MrRobotoAI/Loki-v2.8-8b-EROTICA
  - model: MrRobotoAI/Thor-v1.4-8b-DARK-FICTION
  - model: MrRobotoAI/HEL-v0.8-8b-LONG-DARK
  - model: MrRobotoAI/Test-v0.9-8b
  - model: MrRobotoAI/8b-DARK-unaligned-base
  - model: MrRobotoAI/8b-CHATTY-unaligned-base
  - model: MrRobotoAI/8b-unaligned-BASE-v2a
  - model: MrRobotoAI/MrRoboto-ProLong-8b-v4i
  - model: OpenBuddy/openbuddy-llama3.1-8b-v22.2-131k
  - model: akjindal53244/Llama-3.1-Storm-8B
  - model: v000000/L3.1-Sthenorm-8B
  - model: DeepAutoAI/ldm_soup_Llama-3.1-8B-Inst
  - model: cgato/L3-TheSpice-8b-v0.8.3+Blackroot/Llama-3-8B-Abomination-LORA
  - model: nothingiisreal/L3-8B-Stheno-Horny-v3.3-32K+Blackroot/Llama-3-LongStory-LORA
merge_method: model_stock
base_model: MrRobotoAI/MrRoboto-ProLong-8b-v4i
normalize: true
dtype: float16