Hugging Face's logo

iRASC
/
BioLlama-Ko-8B

Text Generation
Transformers
Safetensors
llama
mergekit
Merge
conversational
text-generation-inference
Inference Endpoints
Model card Files Community
taewan2002 commited on
Commit
0e2dd85
•
1 Parent(s): 2fa7343

Upload folder using huggingface_hub

Browse files
Files changed (8) hide show
  1. README.md +8 -8
  2. mergekit_config.yml +3 -3
  3. model-00001-of-00006.safetensors +1 -1
  4. model-00002-of-00006.safetensors +1 -1
  5. model-00003-of-00006.safetensors +1 -1
  6. model-00004-of-00006.safetensors +1 -1
  7. model-00005-of-00006.safetensors +1 -1
  8. model-00006-of-00006.safetensors +1 -1
README.md CHANGED
@@ -1,14 +1,14 @@
1
  ---
2
  base_model:
3
- - aaditya/Llama3-OpenBioLLM-8B
4
  - beomi/Llama-3-Open-Ko-8B
 
5
  library_name: transformers
6
  tags:
7
  - mergekit
8
  - merge
9
- license: apache-2.0
10
  ---
11
- # BioLlama-Ko-8B
12
 
13
  This is a merge of pre-trained language models created using [mergekit](https://github.com/cg123/mergekit).
14
 
@@ -20,7 +20,7 @@ This model was merged using the [DARE](https://arxiv.org/abs/2311.03099) [TIES](
20
  ### Models Merged
21
 
22
  The following models were included in the merge:
23
- * [aaditya/Llama3-OpenBioLLM-8B](https://huggingface.co/aaditya/Llama3-OpenBioLLM-8B)
24
 
25
  ### Configuration
26
 
@@ -29,13 +29,13 @@ The following YAML configuration was used to produce this model:
29
  ```yaml
30
  models:
31
  - model: beomi/Llama-3-Open-Ko-8B
32
- - model: aaditya/Llama3-OpenBioLLM-8B
33
  parameters:
34
- density: 0.5
35
- weight: 0.5
36
  merge_method: dare_ties
37
  base_model: beomi/Llama-3-Open-Ko-8B
38
  parameters:
39
  int8_mask: true
40
  dtype: bfloat16
41
- ```
 
1
  ---
2
  base_model:
 
3
  - beomi/Llama-3-Open-Ko-8B
4
+ - ProbeMedicalYonseiMAILab/medllama3-v20
5
  library_name: transformers
6
  tags:
7
  - mergekit
8
  - merge
9
+
10
  ---
11
+ # BioLlama-Ko-8B-temp
12
 
13
  This is a merge of pre-trained language models created using [mergekit](https://github.com/cg123/mergekit).
14
 
 
20
  ### Models Merged
21
 
22
  The following models were included in the merge:
23
+ * [ProbeMedicalYonseiMAILab/medllama3-v20](https://huggingface.co/ProbeMedicalYonseiMAILab/medllama3-v20)
24
 
25
  ### Configuration
26
 
 
29
  ```yaml
30
  models:
31
  - model: beomi/Llama-3-Open-Ko-8B
32
+ - model: ProbeMedicalYonseiMAILab/medllama3-v20
33
  parameters:
34
+ density: 0.8
35
+ weight: 0.45
36
  merge_method: dare_ties
37
  base_model: beomi/Llama-3-Open-Ko-8B
38
  parameters:
39
  int8_mask: true
40
  dtype: bfloat16
41
+ ```
mergekit_config.yml CHANGED
@@ -1,9 +1,9 @@
1
  models:
2
  - model: beomi/Llama-3-Open-Ko-8B
3
- - model: aaditya/Llama3-OpenBioLLM-8B
4
  parameters:
5
- density: 0.5
6
- weight: 0.5
7
  merge_method: dare_ties
8
  base_model: beomi/Llama-3-Open-Ko-8B
9
  parameters:
 
1
  models:
2
  - model: beomi/Llama-3-Open-Ko-8B
3
+ - model: ProbeMedicalYonseiMAILab/medllama3-v20
4
  parameters:
5
+ density: 0.8
6
+ weight: 0.45
7
  merge_method: dare_ties
8
  base_model: beomi/Llama-3-Open-Ko-8B
9
  parameters:
model-00001-of-00006.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:635ad877c72f64355b5133ba8ff8f5b52a66190b4854bcd202d14be51dd6e029
3
  size 2973804928
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:ee694bebd7dba64f0a1a3fd3483572dde890ddfaad51987466a141eda88f6be4
3
  size 2973804928
model-00002-of-00006.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:e6e37fbab1491f88b7707205e489a8934e93a91ab4136cf2534a018ea0c03750
3
  size 2978069224
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:f4d49609f16426a9da659d8be8e10b89abb88d584ac227d03e6d067a208673cb
3
  size 2978069224
model-00003-of-00006.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:3e1170e9d13bbb9ef80a9885ed8b930380bb878b675f1403c4bf62a48817f9f5
3
  size 2927737664
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:e00a19baf0680d9d19be72ffcb56060c43753215a19c758ee00fa74d50dd3efe
3
  size 2927737664
model-00004-of-00006.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:7766c6182908f67d81944d6cb129a0d23abc17ed9e6e38dff1c761d397266604
3
  size 2936134720
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:623b082658c30086979d5e7e786009a1966b5547aab391d7a437509aad2e3f8c
3
  size 2936134720
model-00005-of-00006.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:292fe1410773d0b9ec4154fae6b6419dc9367aee62dba98ae771dea95c2f65b2
3
  size 2936134688
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:74ada68e5e0a02df70e99682bc658885af10bc05cb7e20a9309636c23ecef659
3
  size 2936134688
model-00006-of-00006.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:d72aa288a3e2e70eaf6f23ce1964a6e3c7b1900fa9d2aff4e68fe2808a898b5e
3
  size 1308675104
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:aa5abdf1b6b3aaf6ad20ab7bdb01e9a2ed721346fe389251fb1da64615808406
3
  size 1308675104