bertin-project
/

bertin-gpt-j-6B-alpaca

Text Generation

Inference Endpoints

Model card Files Files and versions Community

versae commited on Mar 29, 2023

Commit

1b215f5

·

1 Parent(s): cb69a58

Update README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -21,7 +21,7 @@ from transformers import AutoModelForCausalLM, AutoTokenizer, GenerationConfig,
 base_model = "bertin-project/bertin-gpt-j-6B-alpaca"
 tokenizer = AutoTokenizer.from_pretrained(base_model)
-model = AutoModelForCausalLM.from_pretrained(base_model)
 ```
 For generation, we can either use `pipeline()` or the model's `.generate()` method. Remember that the prompt needs a **Spanish** template:

 base_model = "bertin-project/bertin-gpt-j-6B-alpaca"
 tokenizer = AutoTokenizer.from_pretrained(base_model)
+model = AutoModelForCausalLM.from_pretrained(base_model).cuda()
 ```
 For generation, we can either use `pipeline()` or the model's `.generate()` method. Remember that the prompt needs a **Spanish** template: