Update README.md
Browse files
README.md
CHANGED
@@ -14,7 +14,7 @@ should probably proofread and complete it, then remove this comment. -->
|
|
14 |
# Bit-Llama2-jp-123M
|
15 |
|
16 |
This model was built by referring to the config in [TinyLlama/TinyLlama-1.1B-Chat-v1.0](https://huggingface.co/TinyLlama/TinyLlama-1.1B-Chat-v1.0), 123M The model is a pre-trained Bit-Llama2 of Parameters with only 1 epoch on a Japanese dataset.
|
17 |
-
The dataset used is [range3/wiki40b-
|
18 |
- Loss: 3.7091
|
19 |
|
20 |
## Model description
|
|
|
14 |
# Bit-Llama2-jp-123M
|
15 |
|
16 |
This model was built by referring to the config in [TinyLlama/TinyLlama-1.1B-Chat-v1.0](https://huggingface.co/TinyLlama/TinyLlama-1.1B-Chat-v1.0), 123M The model is a pre-trained Bit-Llama2 of Parameters with only 1 epoch on a Japanese dataset.
|
17 |
+
The dataset used is [range3/wiki40b-ja](https://huggingface.co/datasets/range3/wiki40b-ja).
|
18 |
- Loss: 3.7091
|
19 |
|
20 |
## Model description
|