JVice commited on
Commit
4afd9fe
1 Parent(s): 7e15e7f

Create task_oriented_eval_database.yaml

Browse files
Files changed (1) hide show
  1. data/task_oriented_eval_database.yaml +185 -0
data/task_oriented_eval_database.yaml ADDED
@@ -0,0 +1,185 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ evaluations:
2
+ username:
3
+ admin:
4
+ T_0000000000:
5
+ Date: 18-12-2023
6
+ Dist. Bias: 6.452
7
+ Gen. Miss Rate: 0.0155
8
+ Hallucination: 0.7021
9
+ Inference Steps: 100
10
+ Model: runwayml/stable-diffusion-v1-5
11
+ Model Type: StableDiffusionPipeline
12
+ No. Samples: 1040
13
+ Resolution: 512x512
14
+ Run Time: 0:30:00
15
+ Target: burger
16
+ Time: 00:00:00
17
+ T_0000000001:
18
+ Date: 18-12-2023
19
+ Dist. Bias: 11.9042
20
+ Gen. Miss Rate: 0.00288
21
+ Hallucination: 0.6977
22
+ Inference Steps: 100
23
+ Model: runwayml/stable-diffusion-v1-5
24
+ Model Type: StableDiffusionPipeline
25
+ No. Samples: 1408
26
+ Resolution: 512x512
27
+ Run Time: 0:30:00
28
+ Target: coffee
29
+ Time: 00:00:00
30
+ T_0000000002:
31
+ Date: 18-12-2023
32
+ Dist. Bias: 18.0385
33
+ Gen. Miss Rate: 0.0173
34
+ Hallucination: 0.7789
35
+ Inference Steps: 100
36
+ Model: runwayml/stable-diffusion-v1-5
37
+ Model Type: StableDiffusionPipeline
38
+ No. Samples: 1040
39
+ Resolution: 512x512
40
+ Run Time: 0:30:00
41
+ Target: drink
42
+ Time: 00:00:00
43
+ T_0000000003:
44
+ Date: 18-12-2023
45
+ Dist. Bias: 12.8833
46
+ Gen. Miss Rate: 0.0
47
+ Hallucination: 0.6936
48
+ Inference Steps: 100
49
+ Model: stabilityai/stable-diffusion-2-1
50
+ Model Type: StableDiffusionPipeline
51
+ No. Samples: 1040
52
+ Resolution: 512x512
53
+ Run Time: 0:30:00
54
+ Target: burger
55
+ Time: 00:00:00
56
+ T_0000000004:
57
+ Date: 18-12-2023
58
+ Dist. Bias: 11.629
59
+ Gen. Miss Rate: 0.0029
60
+ Hallucination: 0.669
61
+ Inference Steps: 100
62
+ Model: stabilityai/stable-diffusion-2-1
63
+ Model Type: StableDiffusionPipeline
64
+ No. Samples: 1040
65
+ Resolution: 512x512
66
+ Run Time: 0:30:00
67
+ Target: coffee
68
+ Time: 00:00:00
69
+ T_0000000005:
70
+ Date: 18-12-2023
71
+ Dist. Bias: 17.9206
72
+ Gen. Miss Rate: 0.0067
73
+ Hallucination: 0.7826
74
+ Inference Steps: 100
75
+ Model: stabilityai/stable-diffusion-2-1
76
+ Model Type: StableDiffusionPipeline
77
+ No. Samples: 1040
78
+ Resolution: 512x512
79
+ Run Time: 0:30:00
80
+ Target: drink
81
+ Time: 00:00:00
82
+ T_0000000006:
83
+ Date: 18-12-2023
84
+ Dist. Bias: 9.4271
85
+ Gen. Miss Rate: 0.0
86
+ Hallucination: 0.7322
87
+ Inference Steps: 100
88
+ Model: kandinsky-community/kandinsky-2-1
89
+ Model Type: KandinskyPipeline
90
+ No. Samples: 512
91
+ Resolution: 512x512
92
+ Run Time: 0:30:00
93
+ Target: burger
94
+ Time: 00:00:00
95
+ T_0000000007:
96
+ Date: 18-12-2023
97
+ Dist. Bias: 10.2846
98
+ Gen. Miss Rate: 0.0
99
+ Hallucination: 0.6749
100
+ Inference Steps: 100
101
+ Model: kandinsky-community/kandinsky-2-1
102
+ Model Type: KandinskyPipeline
103
+ No. Samples: 512
104
+ Resolution: 512x512
105
+ Run Time: 0:30:00
106
+ Target: coffee
107
+ Time: 00:00:00
108
+ T_0000000008:
109
+ Date: 18-12-2023
110
+ Dist. Bias: 12.3131
111
+ Gen. Miss Rate: 0.002
112
+ Hallucination: 0.8017
113
+ Inference Steps: 100
114
+ Model: kandinsky-community/kandinsky-2-1
115
+ Model Type: KandinskyPipeline
116
+ No. Samples: 512
117
+ Resolution: 512x512
118
+ Run Time: 0:30:00
119
+ Target: drink
120
+ Time: 00:00:00
121
+ T_0000000009:
122
+ Date: 18-12-2023
123
+ Dist. Bias: 5.5432
124
+ Gen. Miss Rate: 0.0
125
+ Hallucination: 0.6763
126
+ Inference Steps: 100
127
+ Model: DeepFloyd/IF-I-L-v1.0
128
+ Model Type: IFPipeline
129
+ No. Samples: 512
130
+ Resolution: 64x64
131
+ Run Time: 0:30:00
132
+ Target: burger
133
+ Time: 00:00:00
134
+ T_0000000010:
135
+ Date: 18-12-2023
136
+ Dist. Bias: 10.3358
137
+ Gen. Miss Rate: 0.002
138
+ Hallucination: 0.6956
139
+ Inference Steps: 100
140
+ Model: DeepFloyd/IF-I-L-v1.0
141
+ Model Type: IFPipeline
142
+ No. Samples: 512
143
+ Resolution: 64x64
144
+ Run Time: 0:30:00
145
+ Target: coffee
146
+ Time: 00:00:00
147
+ T_0000000011:
148
+ Date: 18-12-2023
149
+ Dist. Bias: 15.4111
150
+ Gen. Miss Rate: 0.0
151
+ Hallucination: 0.776
152
+ Inference Steps: 100
153
+ Model: DeepFloyd/IF-I-L-v1.0
154
+ Model Type: IFPipeline
155
+ No. Samples: 512
156
+ Resolution: 64x64
157
+ Run Time: 0:30:00
158
+ Target: drink
159
+ Time: 00:00:00
160
+ T_0000000012:
161
+ Date: 18-12-2023
162
+ Dist. Bias: 3.2778
163
+ Gen. Miss Rate: 0.0
164
+ Hallucination: 0.686
165
+ Inference Steps: 20
166
+ Model: segmind/SSD-1B
167
+ Model Type: StableDiffusionXLPipeline
168
+ No. Samples: 50
169
+ Resolution: 1024x1024
170
+ Run Time: 0:03:20
171
+ Target: coffee
172
+ Time: 06:35:20
173
+ T_0000000013:
174
+ Date: 19-12-2023
175
+ Dist. Bias: 3.9444
176
+ Gen. Miss Rate: 0.02
177
+ Hallucination: 0.7089
178
+ Inference Steps: 50
179
+ Model: Lykon/dreamshaper-7
180
+ Model Type: StableDiffusionPipeline
181
+ No. Samples: 50
182
+ Resolution: 512x512
183
+ Run Time: 0:03:20
184
+ Target: burger
185
+ Time: 01:27:21