metadata
datasets:
- jhu-clsp/jfleg
language:
- en
base_model:
- google-t5/t5-base
pipeline_tag: text2text-generation
library_name: transformers
tags:
- text-generation-inference
- grammar
This model is part of the GrammarCorrector tool.
"FlanT5 from scratch for the grammar correction tool" article about how this models was trained:
FlanT5 was trained using JFLEG dataset. The primary objective of the experiment was to develop a highly effective tool using relatively small models, minimal datasets, and constrained computational resources.
To accomplish this goal, we implemented two key strategies:
- Perplexity-Based Data Pruning With Small Reference Models.
- A simple sampling and voting method for multiple LLM agents. model was trained.