MrRobotoAI/R1

merge

This is a merge of pre-trained language models created using mergekit.

Merge Details

Merge Method

This model was merged using the Linear merge method.

Models Merged

The following models were included in the merge:

• TroyDoesAI/Contextual-Llama3-8B-RAG
• josedellasala/Llama-3-8B-Instruct-E7000-Final-3Epochs-RAG
• QomSSLab/LLama3.1-Rhino-8B-RAG
• ICTNLP/Auto-RAG-Llama-3-8B-Instruct
• glaiveai/Llama-3-8B-RAG-v1
• Preethi-1995/Llama-3-8B-Instruct-SQUAD-RAG
• dipanjanS/RAG_Llama3.1-8B
• coolcat0/Llama-3.1-8B-Instruct-Simplicity-RAG
• icarus1026/Llama-3.1-8B-Instruct-RAG
• FreedomIntelligence/RAG-Instruct-Llama3-8B

Configuration

The following YAML configuration was used to produce this model:

models:
  - model: QomSSLab/LLama3.1-Rhino-8B-RAG
  - model: Preethi-1995/Llama-3-8B-Instruct-SQUAD-RAG
  - model: josedellasala/Llama-3-8B-Instruct-E7000-Final-3Epochs-RAG
  - model: coolcat0/Llama-3.1-8B-Instruct-Simplicity-RAG
  - model: icarus1026/Llama-3.1-8B-Instruct-RAG
  - model: dipanjanS/RAG_Llama3.1-8B
  - model: glaiveai/Llama-3-8B-RAG-v1
  - model: TroyDoesAI/Contextual-Llama3-8B-RAG
  - model: ICTNLP/Auto-RAG-Llama-3-8B-Instruct
  - model: FreedomIntelligence/RAG-Instruct-Llama3-8B
parameters:
    weight: 1.0
merge_method: linear
dtype: float16