nroggendorff commited on
Commit
4761589
1 Parent(s): ec46cbd

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +2 -2
README.md CHANGED
@@ -16,7 +16,7 @@ model-index:
16
 
17
  # Mayonnaise LLM
18
 
19
- Mayo is a language model fine-tuned on the [Mayo dataset](https://huggingface.co/datasets/nroggendorff/mayo) using Supervised Fine-Tuning (SFT) and Teacher Reinforced Learning (TRL) techniques. It is based on the [TinyLlama/TinyLlama-1.1B-Chat-v1.0 model](https://huggingface.co/TinyLlama/TinyLlama-1.1B-Chat-v1.0).
20
 
21
  ## Features
22
 
@@ -56,7 +56,7 @@ model_id = "nroggendorff/mayo"
56
  tokenizer = AutoTokenizer.from_pretrained(model_id)
57
  model = AutoModelForCausalLM.from_pretrained(model_id, quantization_config=bnb_config)
58
 
59
- prompt = "<|user|>\nWhat color is the sky?</s>\n"
60
  inputs = tokenizer(prompt, return_tensors="pt")
61
 
62
  outputs = model.generate(**inputs, max_new_tokens=32)
 
16
 
17
  # Mayonnaise LLM
18
 
19
+ Mayo is a language model fine-tuned on the [Mayo dataset](https://huggingface.co/datasets/nroggendorff/mayo) using Supervised Fine-Tuning (SFT) and Teacher Reinforced Learning (TRL) techniques. It is based on the [Mistral 7b model](https://huggingface.co/mistralai/Mistral-7B-Instruct-v0.3)
20
 
21
  ## Features
22
 
 
56
  tokenizer = AutoTokenizer.from_pretrained(model_id)
57
  model = AutoModelForCausalLM.from_pretrained(model_id, quantization_config=bnb_config)
58
 
59
+ prompt = "[INST] What color is the sky? [/INST]"
60
  inputs = tokenizer(prompt, return_tensors="pt")
61
 
62
  outputs = model.generate(**inputs, max_new_tokens=32)