forbiddensoul90
commited on
Update README.md
Browse files
README.md
CHANGED
@@ -13,12 +13,11 @@ language:
|
|
13 |
---
|
14 |
# Lux-Llama
|
15 |
|
16 |
-
This repository contains a fine-tuned version of the Llama-3.1-8B-Instruct model, specifically adapted for Luxembourgish. The fine-tuning was performed using LoRA (Low-Rank Adaptation) on a dataset crafted to
|
17 |
|
18 |
## Model Overview
|
19 |
- **Base Model:** Llama-3.1-8B-Instruct
|
20 |
- **Fine-Tuning Method:** LoRA (Low-Rank Adaptation)
|
21 |
-
- **Dataset:** Luxembourgish Chain-of-Thought (CoT) dataset
|
22 |
- **Compute Platform:** Meluxina by LuxProvide
|
23 |
- **Fine-Tuning Framework:** [Unsloth](https://github.com/unsloth/unsloth)
|
24 |
- **Status:** Early release. The model and dataset are still being improved, and feedback is welcome.
|
|
|
13 |
---
|
14 |
# Lux-Llama
|
15 |
|
16 |
+
This repository contains a fine-tuned version of the Llama-3.1-8B-Instruct model, specifically adapted for Luxembourgish. The fine-tuning was performed using LoRA (Low-Rank Adaptation) on a dataset crafted to reason in Luxembourgish. The fine-tuning process utilized the computational resources provided by [Meluxina](https://www.luxprovide.lu/meluxina), a high-performance computing (HPC) platform operated by LuxProvide.
|
17 |
|
18 |
## Model Overview
|
19 |
- **Base Model:** Llama-3.1-8B-Instruct
|
20 |
- **Fine-Tuning Method:** LoRA (Low-Rank Adaptation)
|
|
|
21 |
- **Compute Platform:** Meluxina by LuxProvide
|
22 |
- **Fine-Tuning Framework:** [Unsloth](https://github.com/unsloth/unsloth)
|
23 |
- **Status:** Early release. The model and dataset are still being improved, and feedback is welcome.
|