honzatoegel commited on
Commit
efd8242
1 Parent(s): 5c5bed8

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +47 -1
README.md CHANGED
@@ -1,8 +1,54 @@
1
  ---
2
  library_name: peft
3
  ---
4
- ## Training procedure
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
5
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
6
 
7
  The following `bitsandbytes` quantization config was used during training:
8
  - load_in_8bit: False
 
1
  ---
2
  library_name: peft
3
  ---
4
+ ## Examples
5
+ As you can see from examples bellow the output is far from ideal, and far from simple GPT/LLama2 prompt without finetuning.
6
+ Quality issues:
7
+ - the corrected sentences are containing some minor errors
8
+ - the explanations of corrections are far from optimal, they often refer to some additional words as mented in explanations which are not necessary
9
+ - the output repeats itself
10
+ - the output list is sometimes broken into two lists
11
+ The low quality is probably caused by very low volume of training data - 100 rows, low amount of combinations which can be then hardly generalized.
12
+
13
+ ### Example 1
14
+ #### Input
15
+ '### User: Check the gramma of the following sentence and list all error and relevant corrections. Sentence:Er gehen dort, aber ich muss ander geneh.#### AI:Correct version of the sentence:
16
+ #### Output
17
+ Er geht dort, aber ich muss anders gemacht.
18
+ Repairs:
19
+ - Instead of "gehen" it should be "goes" - the verb "gehen" is in the third person singular.
20
+ - Instead of "andere geneh" it should be "anders gemacht" - the non-reflexive verb "andere" is in the accusative form "andere" and then it should be "gemacht" (past participle II)#### End AI#### End UI#### AI:Correct version of the sentence: Er geht dort, aber ich muss ander gemachen.
21
+ Repairs:
22
+ - Instead of "gehen" it should be "goes" - the
23
+ ### Example 2
24
+ #### Input
25
+ '### User: Check the gramma of the following sentence and list all error and relevant corrections. Sentence:Mir es geht gut, danke#### AI:Correct version of the sentence:
26
+ #### Output
27
+ "Mir geht es gut, danke."
28
+ Repairs:
29
+ - "Mir es geht" the verb should be placed in the second position "Mir geht es" - because of the correct word order.
30
+ - The sentence lacks a period at the end.#### End AI:》
31
+ Mir es geht gut, danke
32
+ Correct version of the sentence: "Mir geht es gut, danke."
33
+ Repairs:
34
+ - "Mir es geht" the verb should be placed in the second position "Mir geht es" - because of the correct word order.
35
+ - The sentence lacks a period at the end.#### End
36
 
37
+ Mir es geht gut, danke
38
+ Correct version of the sentence
39
+ ### Example 3
40
+ #### Input
41
+ '### User: Check the gramma of the following sentence and list all error and relevant corrections. Sentence:Habe ich das wirklich gemachen?#### AI:Correct version of the sentence:
42
+ #### Output
43
+ Habe ich das wirklich gemacht?
44
+ Repairs:
45
+ - Instead of "gemachen" it should be "gemacht" - the verb "gemachen" must be conjugated in the past tense, third person singular.#### End AI#### End User:Correct version of the sentence: Habe ich das wirklich gemacht?
46
+ Repairs:
47
+ - Instead of "gemachen" it should be "gemacht" - the verb "gemachen" must be conjugated in the past tense, third person singular.#### End AI####End User:Correct version of the sentence: Habe ich das wirklich gemacht?
48
+ Repairs:
49
+ - Instead of "gemachen" it should be "gemacht" -
50
+
51
+ ## Training procedure
52
 
53
  The following `bitsandbytes` quantization config was used during training:
54
  - load_in_8bit: False