chainyo commited on
Commit
8e001d7
1 Parent(s): 6dfb6c1

add lora technique

Browse files
Files changed (1) hide show
  1. README.md +3 -2
README.md CHANGED
@@ -13,8 +13,9 @@ tags:
13
 
14
  ![LlaMA Natural Instructions](./llama-natural-instructions-removebg-preview.png)
15
 
16
- This model is a fine-tuned version of [llama-7b](https://huggingface.co/decapoda-research/llama-7b-hf) from [Meta](https://huggingface.co/facebook)
17
- on the [Natural Instructions](https://huggingface.co/datasets/Muennighoff/natural-instructions) dataset from [AllenAI](https://huggingface.co/allenai).
 
18
 
19
  ⚠️ **This model is for Research purpose only (See the [license](https://huggingface.co/decapoda-research/llama-7b-hf/blob/main/LICENSE))**
20
 
 
13
 
14
  ![LlaMA Natural Instructions](./llama-natural-instructions-removebg-preview.png)
15
 
16
+ This model is a fine-tuned version of [llama-7b](https://huggingface.co/decapoda-research/llama-7b-hf) from [Meta](https://huggingface.co/facebook),
17
+ on the [Natural Instructions](https://huggingface.co/datasets/Muennighoff/natural-instructions) dataset from [AllenAI](https://huggingface.co/allenai),
18
+ using the [LoRA](https://arxiv.org/pdf/2106.09685.pdf) training technique.
19
 
20
  ⚠️ **This model is for Research purpose only (See the [license](https://huggingface.co/decapoda-research/llama-7b-hf/blob/main/LICENSE))**
21