nroggendorff
commited on
Commit
•
4761589
1
Parent(s):
ec46cbd
Update README.md
Browse files
README.md
CHANGED
@@ -16,7 +16,7 @@ model-index:
|
|
16 |
|
17 |
# Mayonnaise LLM
|
18 |
|
19 |
-
Mayo is a language model fine-tuned on the [Mayo dataset](https://huggingface.co/datasets/nroggendorff/mayo) using Supervised Fine-Tuning (SFT) and Teacher Reinforced Learning (TRL) techniques. It is based on the [
|
20 |
|
21 |
## Features
|
22 |
|
@@ -56,7 +56,7 @@ model_id = "nroggendorff/mayo"
|
|
56 |
tokenizer = AutoTokenizer.from_pretrained(model_id)
|
57 |
model = AutoModelForCausalLM.from_pretrained(model_id, quantization_config=bnb_config)
|
58 |
|
59 |
-
prompt = "
|
60 |
inputs = tokenizer(prompt, return_tensors="pt")
|
61 |
|
62 |
outputs = model.generate(**inputs, max_new_tokens=32)
|
|
|
16 |
|
17 |
# Mayonnaise LLM
|
18 |
|
19 |
+
Mayo is a language model fine-tuned on the [Mayo dataset](https://huggingface.co/datasets/nroggendorff/mayo) using Supervised Fine-Tuning (SFT) and Teacher Reinforced Learning (TRL) techniques. It is based on the [Mistral 7b model](https://huggingface.co/mistralai/Mistral-7B-Instruct-v0.3)
|
20 |
|
21 |
## Features
|
22 |
|
|
|
56 |
tokenizer = AutoTokenizer.from_pretrained(model_id)
|
57 |
model = AutoModelForCausalLM.from_pretrained(model_id, quantization_config=bnb_config)
|
58 |
|
59 |
+
prompt = "[INST] What color is the sky? [/INST]"
|
60 |
inputs = tokenizer(prompt, return_tensors="pt")
|
61 |
|
62 |
outputs = model.generate(**inputs, max_new_tokens=32)
|