Frankie-370M / README.md
balnazzar's picture
Upload folder using huggingface_hub
c7e5648 verified
|
raw
history blame contribute delete
No virus
718 Bytes
metadata
license: apache-2.0
tags:
  - merge
  - mergekit
  - lazymergekit
  - Felladrin/TinyMistral-248M-SFT-v4
  - Felladrin/TinyMistral-248M-SFT-v4

Frankie-tiny

Frankie-tiny is a (franken)merge of the following models using mergekit:

🧩 Configuration

slices:
  - sources:
    - model: Felladrin/TinyMistral-248M-SFT-v4
      layer_range: [0, 12]
  - sources:
    - model: Felladrin/TinyMistral-248M-SFT-v4
      layer_range: [2, 10]
merge_method: passthrough
dtype: float16