Doctor-Shotgun commited on
Commit
a8f9d6f
·
1 Parent(s): 8d086aa

Create README.md

Browse files
Files changed (1) hide show
  1. README.md +30 -0
README.md ADDED
@@ -0,0 +1,30 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ inference: false
3
+ language:
4
+ - en
5
+ pipeline_tag: text-generation
6
+ tags:
7
+ - llama
8
+ - llama-2
9
+ license: mit
10
+ ---
11
+
12
+ # llama-2-supercot-lora
13
+
14
+ Standard 8bit lora trained using [axolotl](https://github.com/OpenAccess-AI-Collective/axolotl) on the [supercot](https://huggingface.co/datasets/kaiokendev/SuperCOT-dataset) dataset using Alpaca instruct format at 4096 context:
15
+
16
+ ```
17
+ Below is an instruction that describes a task, paired with an input that provides further context. Write a response that appropriately completes the request.
18
+
19
+ ### Instruction:
20
+ <instruction>
21
+
22
+ ### Input:
23
+ <any additional context. Remove this if it's not neccesary>
24
+
25
+ ### Response:
26
+ <make sure to leave a single new-line here for optimal results>
27
+ ```
28
+
29
+ ## Bias, Risks, and Limitations
30
+ The model will show biases similar to those exhibited by the base model. It is not intended for supplying factual information or advice in any form.