Transformers
English
Inference Endpoints
shreyans92dhankhar commited on
Commit
fe0c426
1 Parent(s): 50eba8a

Updated Prompts

Browse files
Files changed (1) hide show
  1. README.md +12 -12
README.md CHANGED
@@ -38,18 +38,18 @@ Instruction tuned FlanT5-XXL on Legal Clauses data generated via ChatGPT. The mo
38
  <summary> Click to expand </summary>
39
 
40
  ```python
41
- # pip install accelerate peft bitsandbytes
42
- import torch
43
- from transformers import AutoModelForSeq2SeqLM, AutoTokenizer
44
- from peft import PeftModel,PeftConfig
45
- peft_model_id = 'NebulaSense/ContractAssist'
46
-
47
- peft_config = PeftConfig.from_pretrained(peft_model_id)
48
-
49
- model = AutoModelForSeq2SeqLM.from_pretrained(peft_config.base_model_name_or_path, device_map="auto",load_in_8bit=True)
50
- tokenizer = AutoTokenizer.from_pretrained(peft_config.base_model_name_or_path)
51
- model = PeftModel.from_pretrained(model, peft_model_id)
52
- model.eval()
53
  ```
54
 
55
  </details>
 
38
  <summary> Click to expand </summary>
39
 
40
  ```python
41
+ {
42
+ "prompt_input": (
43
+ "Below is an instruction that describes a task, paired with an input that provides further context. "
44
+ "Write a response that appropriately completes the request.\n\n"
45
+ "### Instruction:\n{instruction}\n\n### Input:\n{input}\n\n### Response:\n"
46
+ ),
47
+ "prompt_no_input": (
48
+ "Below is an instruction that describes a task. "
49
+ "Write a response that appropriately completes the request.\n\n"
50
+ "### Instruction:\n{instruction}\n\n### Response:\n"
51
+ ),
52
+ }
53
  ```
54
 
55
  </details>