ShirinYamani commited on
Commit
751fa5c
1 Parent(s): 7565302

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +9 -3
README.md CHANGED
@@ -1,12 +1,17 @@
1
  ---
2
  base_model: huggyllama/llama-7b
3
  library_name: peft
4
- license: other
5
  tags:
6
- - generated_from_trainer
 
 
7
  model-index:
8
  - name: llama-3-8-fine-tuned-dora
9
  results: []
 
 
 
10
  ---
11
 
12
  <!-- This model card has been generated automatically according to the information the Trainer had access to. You
@@ -14,7 +19,8 @@ should probably proofread and complete it, then remove this comment. -->
14
 
15
  # llama-3-8-fine-tuned-dora
16
 
17
- This model is a fine-tuned version of [huggyllama/llama-7b](https://huggingface.co/huggyllama/llama-7b) on an unknown dataset.
 
18
 
19
  ## Model description
20
 
 
1
  ---
2
  base_model: huggyllama/llama-7b
3
  library_name: peft
4
+ license: mit
5
  tags:
6
+ - peft
7
+ - lora
8
+ - dora
9
  model-index:
10
  - name: llama-3-8-fine-tuned-dora
11
  results: []
12
+ datasets:
13
+ - timdettmers/openassistant-guanaco
14
+ pipeline_tag: text-generation
15
  ---
16
 
17
  <!-- This model card has been generated automatically according to the information the Trainer had access to. You
 
19
 
20
  # llama-3-8-fine-tuned-dora
21
 
22
+ This model is a fine-tuned version of [huggyllama/llama-7b](https://huggingface.co/huggyllama/llama-7b) on on [openassistant-guanaco](https://huggingface.co/datasets/timdettmers/openassistant-guanaco) dataset.
23
+ For LoraConfig we set the `use_dora=True` for the Dora decomposition and comparison with Lora.
24
 
25
  ## Model description
26