MrRobotoAI/MrRoboto-ProLong-8b-v2n

merge

This is a merge of pre-trained language models created using mergekit.

Merge Details

Merge Method

This model was merged using the Model Stock merge method using MrRobotoAI/MrRoboto-ProLong-8b-v2l as a base.

Models Merged

The following models were included in the merge:

• DeepAutoAI/ldm_soup_Llama-3.1-8B-Inst
• mergekit-community/L3.1-Artemis-b2-8B
• cgato/L3-TheSpice-8b-v0.8.3 + Blackroot/Llama-3-8B-Abomination-LORA
• MrRobotoAI/MrRoboto-ProLong-8b-v2m
• v000000/L3.1-Sthenorm-8B
• akjindal53244/Llama-3.1-Storm-8B
• THUDM/LongWriter-llama3.1-8b
• Orenguteng/Llama-3.1-8B-Lexi-Uncensored-V2
• mergekit-community/L3.1-Vulca-Umboshima-8B
• OpenBuddy/openbuddy-llama3.1-8b-v22.2-131k

Configuration

The following YAML configuration was used to produce this model:

models:

  - model: OpenBuddy/openbuddy-llama3.1-8b-v22.2-131k
  - model: THUDM/LongWriter-llama3.1-8b
  - model: akjindal53244/Llama-3.1-Storm-8B
  - model: mergekit-community/L3.1-Vulca-Umboshima-8B
  - model: Orenguteng/Llama-3.1-8B-Lexi-Uncensored-V2
  - model: mergekit-community/L3.1-Artemis-b2-8B
  - model: v000000/L3.1-Sthenorm-8B
  - model: DeepAutoAI/ldm_soup_Llama-3.1-8B-Inst
  - model: cgato/L3-TheSpice-8b-v0.8.3+Blackroot/Llama-3-8B-Abomination-LORA
  - model: MrRobotoAI/MrRoboto-ProLong-8b-v2m
  
merge_method: model_stock
base_model: MrRobotoAI/MrRoboto-ProLong-8b-v2l
normalize: true
dtype: float16