Update README.md

README.md

@@ -19,12 +19,18 @@ Finetuned depacoda-research/llamma-13b-hf on conversations
 The depacoda-research/llamma-13b-hf model was finetuned on conversations and question answering prompts
 
 **Developed by:** [More Information Needed]
+
 **Shared by:** [More Information Needed]
+
 **Model type:** Causal LM
+
 **Language(s) (NLP):** English, multilingual
+
 **License:** Research
+
 **Finetuned from model:** depacoda-research/llamma-13b-hf
 
+
 ## Model Sources [optional]
 
 **Repository:** [More Information Needed]
@@ -67,6 +73,39 @@ model = LlamaForCausalLM.from_pretrained(MODEL_NAME, load_in_8bit=True, device_m
 model = PeftModel.from_pretrained(model, "Sandiago21/public-ai-model")
 ```
 
+### Example of Usage
+```
+from transformers import GenerationConfig
+
+PROMPT = """Below is an instruction that describes a task, paired with an input that provides further context. Write a response that appropriately completes the request.\n\n### Instruction:\nWhich is the capital city of Greece and with which countries does Greece border?\n\n### Input:\nQuestion answering\n\n### Response:\n"""
+DEVICE = "cuda"
+
+inputs = tokenizer(
+ PROMPT,
+ return_tensors="pt",
+)
+
+input_ids = inputs["input_ids"].to(DEVICE)
+
+generation_config = GenerationConfig(
+ temperature=0.1,
+ top_p=0.95,
+ repetition_penalty=1.2,
+)
+
+print("Generating Response ... ")
+generation_output = model.generate(
+ input_ids=input_ids,
+ generation_config=generation_config,
+ return_dict_in_generate=True,
+ output_scores=True,
+ max_new_tokens=256,
+)
+
+for s in generation_output.sequences:
+ print(tokenizer.decode(s))
+```
+
 ## Training Details