Update README.md
Browse files
README.md
CHANGED
@@ -2,4 +2,19 @@
|
|
2 |
license: apache-2.0
|
3 |
---
|
4 |
|
5 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
2 |
license: apache-2.0
|
3 |
---
|
4 |
|
5 |
+
# **GeM2-Llamion-14B**
|
6 |
+
|
7 |
+
We have released **Llamion** as **GeM 2.0**, the second series of generative models developed by VAIV Company to address the our principal business needs.
|
8 |
+
|
9 |
+
**Llamion** (Llamafied Orion) is derived from transforming the [Orion model](https://huggingface.co/OrionStarAI/Orion-14B-Base)
|
10 |
+
into [the standard LLaMA architecture](https://github.com/huggingface/transformers/blob/main/src/transformers/models/llama/modeling_llama.py)
|
11 |
+
through parameter mapping and offline distillation. More details will be available in our upcoming paper, which will be accessible on this page.
|
12 |
+
|
13 |
+
<!-- Note that this model has NOT been contaminated to artificially inflate its scores for the Open LLM Leaderboards,
|
14 |
+
unlike some recent models which have been intentionally tainted. -->
|
15 |
+
|
16 |
+
![vaiv_png](./vaiv.png)
|
17 |
+
|
18 |
+
### Contributors
|
19 |
+
|
20 |
+
- VAIV Company AI Lab ([vaiv.kr](https://www.vaiv.kr/))
|