added results on grammatical error correction

README.md

@@ -154,6 +154,37 @@ We use the binary formulation of this task (positive vs. negative).
 </details>
 
 
+### Grammatical error correction
+
+[ASK-RAW](https://huggingface.co/datasets/ltg/ask-gec) is dataset for Norwegian grammatical error correction (GEC) created by [Matias Jentoft (2023)](https://www.duo.uio.no/handle/10852/103885).
+
+<details>
+<summary>Method (click to expand)</summary>
+ 
+* Evaluation setting: zero-shot and few-shot settings via natural language generation using the greedy decoding strategy.
+* Prompt: ```"Her er eksempler på perfekt korrigering av grammatiske feil:\n\nTekst: {source_text}\nKorreksjon:{target_text}"```
+* Few-shot results show the average scores across 5 repetitions
+* Evaluation script: https://github.com/ltgoslo/norallm/blob/main/initial_evaluation/gec.py
+* Performance metrics: the evaluation metric uses [ERRANT](https://github.com/chrisjbryant/errant/tree/main), which identifies edit-spans and then calculates the F_{0.5} scores between the gold edits and predicted edits. 
+ 
+</details>
+
+<details open>
+<summary>Results on [the ASK corpus](https://huggingface.co/datasets/ltg/ask-gec) (ERRANT F_{0.5})</summary>
+
+|Model|0-shot (F0.5)|1-shot (F0.5)|32-shot (F0.5)|
+|---|---|---|---|
+|NorMistral-7b-warm|**40.8**|41.8|48.5|
+|NorMistral-7b-scratch|22.1|28.8|42.1|
+|NorBLOOM-7b|8.7|24.5|32.0|
+|NB-GPT-J|9.1|28.2|30.6|
+|GPT-Sw3-6.7B|30.5|42.9|**50.6**|
+|GPT-Sw3-6.7B-v2|40.6|**43.4**|49.8|
+|Falcon-7B|10.8|12.4|15.5|
+|Mistral-7B-v0.1|26.0|27.4|30.6|
+
+</details>
+
 
 ### Machine translation