UNIST-Eunchan
/

FLAN-T5-NLP-Paper-to-Question-Generation

Text2Text Generation

Generated from Trainer

NLPPaper_to_Question_Generation

Long Document Summarization

text-generation-inference

Inference Endpoints

Model card Files Files and versions Metrics Training metrics Community

UNIST-Eunchan commited on Nov 27, 2023

Commit

74d932d

•

1 Parent(s): 5245992

Update README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -345,7 +345,7 @@ model = BetterTransformer.transform(model)
 ```python
 # use to(device)
-num_generate_sequence = 16 (about 20 sec with Colab T4 GPU)
 summaries = model.generate(input_ids =inputs["input_ids"].to(device), max_new_tokens=100, do_sample = True, top_p = 0.95, num_return_sequences = num_generate_sequence)
 ```

 ```python
 # use to(device)
+num_generate_sequence = 16 # (about 20 sec with Colab T4 GPU)
 summaries = model.generate(input_ids =inputs["input_ids"].to(device), max_new_tokens=100, do_sample = True, top_p = 0.95, num_return_sequences = num_generate_sequence)
 ```