Marcoro14-7B-slerp / README.md

nwhamed

Upload folder using huggingface_hub

5399583 verified 10 months ago

preview code

raw

history blame

512 Bytes

metadata

license: apache-2.0
tags:
  - merge
  - mergekit
  - lazymergekit
  - roberta-base

bert-roberta-merged

bert-roberta-merged is a merge of the following models using mergekit:

roberta-base

🧩 Configuration

models:
  - model: bert-base-uncased
  - model: roberta-base
    parameters:
      density: 0.5
      weight: 0.5
merge_method: ties
base_model: bert-base-uncased
parameters:
  normalize: true
dtype: float16