LLM Model Merging

YouTube Tutorial

GitHub

You can find the GitHub from here; https://github.com/uygarkurt/Model-Merge

In this specific case, I typed llama-3 into the open LLM leaderboard, took the best 3 models, merged them and created a better ranking model wihtout any training.

As the main libraries we will be using mergekit.


Downloads last month
12,667
Safetensors
Model size
8.03B params
Tensor type
FP16
Β·
Inference Providers NEW
This model is not currently available via any of the supported third-party Inference Providers, and the model is not deployed on the HF Inference API.

Model tree for uygarkurt/llama-3-merged-linear

Finetunes
3 models
Merges
2 models
Quantizations
2 models

Spaces using uygarkurt/llama-3-merged-linear 7