Update README.md
Browse files
README.md
CHANGED
|
@@ -9,6 +9,9 @@ base_model:
|
|
| 9 |
This model is finetuned on the model llama3.1-8b-instruct using the dataset [BAAI/IndustryInstruction_Transportation](https://huggingface.co/datasets/BAAI/IndustryInstruction_Transportation) dataset, the dataset details can jump to the repo: [BAAI/IndustryInstruction](https://huggingface.co/datasets/BAAI/IndustryInstruction)
|
| 10 |
|
| 11 |
## training params
|
|
|
|
|
|
|
|
|
|
| 12 |
```
|
| 13 |
learning_rate=1e-5
|
| 14 |
lr_scheduler_type=cosine
|
|
|
|
| 9 |
This model is finetuned on the model llama3.1-8b-instruct using the dataset [BAAI/IndustryInstruction_Transportation](https://huggingface.co/datasets/BAAI/IndustryInstruction_Transportation) dataset, the dataset details can jump to the repo: [BAAI/IndustryInstruction](https://huggingface.co/datasets/BAAI/IndustryInstruction)
|
| 10 |
|
| 11 |
## training params
|
| 12 |
+
|
| 13 |
+
The training framework is llama-factory, template=llama3
|
| 14 |
+
|
| 15 |
```
|
| 16 |
learning_rate=1e-5
|
| 17 |
lr_scheduler_type=cosine
|