Update README.md
Browse files
README.md
CHANGED
@@ -1,22 +1,23 @@
|
|
1 |
-
---
|
2 |
-
tags:
|
3 |
-
- merge
|
4 |
-
- mergekit
|
5 |
-
- lazymergekit
|
6 |
-
- aaditya/Llama3-OpenBioLLM-8B
|
7 |
-
base_model:
|
8 |
-
- aaditya/Llama3-OpenBioLLM-8B
|
9 |
-
license: llama3
|
10 |
-
language:
|
11 |
-
- en
|
12 |
-
---
|
13 |
|
14 |
# Llama-3-Galen-8B-32k-v1
|
15 |
|
16 |
<img src="https://cdn-uploads.huggingface.co/production/uploads/60c8619d95d852a24572b025/R73wGdZE3GWeF9QZPvruG.jpeg" width="600" />
|
17 |
|
18 |
-
Llama-3-Galen-8B-32k-v1 is a merge of the following models using [LazyMergekit](https://colab.research.google.com/drive/1obulZ1ROXHjYLn6PPZJwRR6GzgQogxxb?usp=sharing):
|
19 |
* [aaditya/Llama3-OpenBioLLM-8B](https://huggingface.co/aaditya/Llama3-OpenBioLLM-8B)
|
|
|
20 |
|
21 |
> **This model is capable of handling a context size of 32K right out of the box, enabled with Dynamic RoPE scaling.**
|
22 |
|
|
|
1 |
+
---
|
2 |
+
tags:
|
3 |
+
- merge
|
4 |
+
- mergekit
|
5 |
+
- lazymergekit
|
6 |
+
- aaditya/Llama3-OpenBioLLM-8B
|
7 |
+
base_model:
|
8 |
+
- aaditya/Llama3-OpenBioLLM-8B
|
9 |
+
license: llama3
|
10 |
+
language:
|
11 |
+
- en
|
12 |
+
---
|
13 |
|
14 |
# Llama-3-Galen-8B-32k-v1
|
15 |
|
16 |
<img src="https://cdn-uploads.huggingface.co/production/uploads/60c8619d95d852a24572b025/R73wGdZE3GWeF9QZPvruG.jpeg" width="600" />
|
17 |
|
18 |
+
Llama-3-Galen-8B-32k-v1 is a RoPE scaled, DARE TIES merge of the following models using [LazyMergekit](https://colab.research.google.com/drive/1obulZ1ROXHjYLn6PPZJwRR6GzgQogxxb?usp=sharing):
|
19 |
* [aaditya/Llama3-OpenBioLLM-8B](https://huggingface.co/aaditya/Llama3-OpenBioLLM-8B)
|
20 |
+
* [johnsnowlabs/JSL-MedLlama-3-8B-v2.0](https://huggingface.co/johnsnowlabs/JSL-MedLlama-3-8B-v2.0)
|
21 |
|
22 |
> **This model is capable of handling a context size of 32K right out of the box, enabled with Dynamic RoPE scaling.**
|
23 |
|