ShirinYamani
commited on
Commit
•
751fa5c
1
Parent(s):
7565302
Update README.md
Browse files
README.md
CHANGED
@@ -1,12 +1,17 @@
|
|
1 |
---
|
2 |
base_model: huggyllama/llama-7b
|
3 |
library_name: peft
|
4 |
-
license:
|
5 |
tags:
|
6 |
-
-
|
|
|
|
|
7 |
model-index:
|
8 |
- name: llama-3-8-fine-tuned-dora
|
9 |
results: []
|
|
|
|
|
|
|
10 |
---
|
11 |
|
12 |
<!-- This model card has been generated automatically according to the information the Trainer had access to. You
|
@@ -14,7 +19,8 @@ should probably proofread and complete it, then remove this comment. -->
|
|
14 |
|
15 |
# llama-3-8-fine-tuned-dora
|
16 |
|
17 |
-
This model is a fine-tuned version of [huggyllama/llama-7b](https://huggingface.co/huggyllama/llama-7b) on
|
|
|
18 |
|
19 |
## Model description
|
20 |
|
|
|
1 |
---
|
2 |
base_model: huggyllama/llama-7b
|
3 |
library_name: peft
|
4 |
+
license: mit
|
5 |
tags:
|
6 |
+
- peft
|
7 |
+
- lora
|
8 |
+
- dora
|
9 |
model-index:
|
10 |
- name: llama-3-8-fine-tuned-dora
|
11 |
results: []
|
12 |
+
datasets:
|
13 |
+
- timdettmers/openassistant-guanaco
|
14 |
+
pipeline_tag: text-generation
|
15 |
---
|
16 |
|
17 |
<!-- This model card has been generated automatically according to the information the Trainer had access to. You
|
|
|
19 |
|
20 |
# llama-3-8-fine-tuned-dora
|
21 |
|
22 |
+
This model is a fine-tuned version of [huggyllama/llama-7b](https://huggingface.co/huggyllama/llama-7b) on on [openassistant-guanaco](https://huggingface.co/datasets/timdettmers/openassistant-guanaco) dataset.
|
23 |
+
For LoraConfig we set the `use_dora=True` for the Dora decomposition and comparison with Lora.
|
24 |
|
25 |
## Model description
|
26 |
|