AIGym commited on
Commit
69c8e61
1 Parent(s): 94077b0

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +1 -27
README.md CHANGED
@@ -6,33 +6,7 @@ This model was fine tuned to allow it to follow direction and is a steeping ston
6
 
7
  # How to use
8
  You will need the transformers>=4.31
9
- ```python
10
- from transformers import AutoTokenizer
11
- import transformers
12
- import torch
13
- model = "AIGym/TinyLlama-1.1B-2.5T-chat"
14
- tokenizer = AutoTokenizer.from_pretrained(model)
15
- pipeline = transformers.pipeline(
16
- "text-generation",
17
- model=model,
18
- torch_dtype=torch.float16,
19
- device_map="auto",
20
- )
21
- prompt = "What are the values in open source projects?"
22
- formatted_prompt = (
23
- f"### Human: {prompt}### Assistant:"
24
- )
25
- sequences = pipeline(
26
- formatted_prompt,
27
- do_sample=True,
28
- top_k=50,
29
- top_p = 0.7,
30
- num_return_sequences=1,
31
- repetition_penalty=1.1,
32
- max_new_tokens=500,
33
- )
34
- for seq in sequences:
35
- print(f"Result: {seq['generated_text']}")
36
  ```
37
 
38
  # Referrals
 
6
 
7
  # How to use
8
  You will need the transformers>=4.31
9
+ Use your normal llama prompt templete
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
10
  ```
11
 
12
  # Referrals