File size: 8,153 Bytes
6dca6cf
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
e1446eb
 
 
 
 
 
 
 
 
 
 
 
022a66f
 
 
2b9ffaf
022a66f
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
3f35e87
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
154
155
156
157
158
159
---
library_name: transformers
tags: []
---

# Model Card for Model ID

<!-- Provide a quick summary of what the model is/does. -->



## Model Details

### Model Description

<!-- Provide a longer summary of what this model is. -->

This is the model card of a πŸ€— transformers model that has been pushed on the Hub. This model card has been automatically generated.

- **Developed by:** [More Information Needed]
- **Funded by [optional]:** [More Information Needed]
- **Shared by [optional]:** [More Information Needed]
- **Model type:** [More Information Needed]
- **Language(s) (NLP):** [More Information Needed]
- **License:** [More Information Needed]
- **Finetuned from model [optional]:** [More Information Needed]


hf-causal-experimental (pretrained=T3Q-LLM/T3Q-LLM-TE-NLI-Lora16-NEF-v1.0,use_accelerate=true,trust_remote_code=true), limit: None, provide_description: False, num_fewshot: 0, batch_size: 8
|      Task      |Version| Metric |Value |   |Stderr|
|----------------|------:|--------|-----:|---|-----:|
|kobest_boolq    |      0|acc     |0.9551|Β±  |0.0055|
|                |       |macro_f1|0.9551|Β±  |0.0055|
|kobest_copa     |      0|acc     |0.7760|Β±  |0.0132|
|                |       |macro_f1|0.7758|Β±  |0.0132|
|kobest_hellaswag|      0|acc     |0.5160|Β±  |0.0224|
|                |       |acc_norm|0.5420|Β±  |0.0223|
|                |       |macro_f1|0.5134|Β±  |0.0224|
|kobest_sentineg |      0|acc     |0.8791|Β±  |0.0164|
|                |       |macro_f1|0.8786|Β±  |0.0165|




================================================================================


Query: 였늘 날씨 μ–΄λ•Œμš”?

Top 9 most similar sentences in corpus:

[1] μ˜€λŠ˜μ€ 날씨가 μ°Έ μ’‹μ•„μ„œ μ™ΈμΆœν•˜κΈ°μ— μ•„μ£Ό 쒋은 λ‚ μ΄μ—μš”. (Score: 0.6658)
[2] λ‚˜λŠ” λ―Έλž˜μ— λŒ€ν•œ 두렀움을 가지지 μ•Šκ³  미래λ₯Ό κΈ°λŒ€ν•˜λ©° μ‚΄κ³  μžˆμŠ΅λ‹ˆλ‹€. (Score: 0.6114)
[3] 책을 μ½λŠ” 것은 λ§ˆμŒμ„ νŽΈμ•ˆν•˜κ²Œ ν•΄μ£Όκ³  지식을 λ„“ν˜€μ€λ‹ˆλ‹€. (Score: 0.5735)
[4] μš”λ¦¬λ₯Ό ν•˜λ©° μ‹œκ°„μ„ λ³΄λ‚΄λŠ” 것은 λ‚˜μ—κ²Œ 큰 즐거움을 μ€λ‹ˆλ‹€. (Score: 0.5500)
[5] μƒˆλ‘œμš΄ μ–Έμ–΄λ₯Ό λ°°μš°λŠ” 것은 λ§ˆμŒμ„ 더 λ„“κ²Œ λ§Œλ“€μ–΄ μ€λ‹ˆλ‹€. (Score: 0.5454)
[6] λ‚˜λŠ” μ–΄μ œλ³΄λ‹€ 였늘 더 λ‚˜μ€ 내일을 λ§Œλ“€κΈ° μœ„ν•΄ λ…Έλ ₯ν•˜κ³  μžˆμŠ΅λ‹ˆλ‹€. (Score: 0.5425)
[7] Today, the weather is so nice that it's perfect for going out. (Score: 0.5206)
[8] Spending time cooking brings me great joy. (Score: 0.4776)
[9] Reading books relaxes the mind and broadens one's knowledge. (Score: 0.4726)
[10] μŒμ•…μ„ λ“€μœΌλ©° μ‚°μ±…ν•˜λŠ” 것은 슀트레슀λ₯Ό ν•΄μ†Œν•˜λŠ” 데에 νš¨κ³Όμ μž…λ‹ˆλ‹€. (Score: 0.4723)


================================================================================


Query: What's the weather like today?

Top 9 most similar sentences in corpus:

[1] Today, the weather is so nice that it's perfect for going out. (Score: 0.6031)
[2] μ˜€λŠ˜μ€ 날씨가 μ°Έ μ’‹μ•„μ„œ μ™ΈμΆœν•˜κΈ°μ— μ•„μ£Ό 쒋은 λ‚ μ΄μ—μš”. (Score: 0.4892)
[3] λ‚˜λŠ” λ―Έλž˜μ— λŒ€ν•œ 두렀움을 가지지 μ•Šκ³  미래λ₯Ό κΈ°λŒ€ν•˜λ©° μ‚΄κ³  μžˆμŠ΅λ‹ˆλ‹€. (Score: 0.4804)
[4] Spending time cooking brings me great joy. (Score: 0.4652)
[5] Reading books relaxes the mind and broadens one's knowledge. (Score: 0.4611)
[6] λ‚˜λŠ” μ–΄μ œλ³΄λ‹€ 였늘 더 λ‚˜μ€ 내일을 λ§Œλ“€κΈ° μœ„ν•΄ λ…Έλ ₯ν•˜κ³  μžˆμŠ΅λ‹ˆλ‹€. (Score: 0.4485)
[7] 책을 μ½λŠ” 것은 λ§ˆμŒμ„ νŽΈμ•ˆν•˜κ²Œ ν•΄μ£Όκ³  지식을 λ„“ν˜€μ€λ‹ˆλ‹€. (Score: 0.4267)
[8] μš”λ¦¬λ₯Ό ν•˜λ©° μ‹œκ°„μ„ λ³΄λ‚΄λŠ” 것은 λ‚˜μ—κ²Œ 큰 즐거움을 μ€λ‹ˆλ‹€. (Score: 0.4248)
[9] μƒˆλ‘œμš΄ μ–Έμ–΄λ₯Ό λ°°μš°λŠ” 것은 λ§ˆμŒμ„ 더 λ„“κ²Œ λ§Œλ“€μ–΄ μ€λ‹ˆλ‹€. (Score: 0.4170)
[10] Listening to music while walking is effective in relieving stress. (Score: 0.4101)


================================================================================


Query: μ–΄λ–€ 책을 μ½λŠ” 것이 μ’‹μ„κΉŒμš”?

Top 9 most similar sentences in corpus:

[1] 책을 μ½λŠ” 것은 λ§ˆμŒμ„ νŽΈμ•ˆν•˜κ²Œ ν•΄μ£Όκ³  지식을 λ„“ν˜€μ€λ‹ˆλ‹€. (Score: 0.6988)
[2] λ‚˜λŠ” λ―Έλž˜μ— λŒ€ν•œ 두렀움을 가지지 μ•Šκ³  미래λ₯Ό κΈ°λŒ€ν•˜λ©° μ‚΄κ³  μžˆμŠ΅λ‹ˆλ‹€. (Score: 0.6811)
[3] μƒˆλ‘œμš΄ μ–Έμ–΄λ₯Ό λ°°μš°λŠ” 것은 λ§ˆμŒμ„ 더 λ„“κ²Œ λ§Œλ“€μ–΄ μ€λ‹ˆλ‹€. (Score: 0.6438)
[4] λ‚˜λŠ” μ–΄μ œλ³΄λ‹€ 였늘 더 λ‚˜μ€ 내일을 λ§Œλ“€κΈ° μœ„ν•΄ λ…Έλ ₯ν•˜κ³  μžˆμŠ΅λ‹ˆλ‹€. (Score: 0.6196)
[5] μš”λ¦¬λ₯Ό ν•˜λ©° μ‹œκ°„μ„ λ³΄λ‚΄λŠ” 것은 λ‚˜μ—κ²Œ 큰 즐거움을 μ€λ‹ˆλ‹€. (Score: 0.5932)
[6] Reading books relaxes the mind and broadens one's knowledge. (Score: 0.5892)
[7] μ˜€λŠ˜μ€ 날씨가 μ°Έ μ’‹μ•„μ„œ μ™ΈμΆœν•˜κΈ°μ— μ•„μ£Ό 쒋은 λ‚ μ΄μ—μš”. (Score: 0.5634)
[8] Spending time cooking brings me great joy. (Score: 0.5327)
[9] Today, the weather is so nice that it's perfect for going out. (Score: 0.4939)
[10] Learning a new language opens up one's mind. (Score: 0.4934)


================================================================================


Query: What books do you recommend reading?

Top 9 most similar sentences in corpus:

[1] Reading books relaxes the mind and broadens one's knowledge. (Score: 0.6845)
[2] Today, the weather is so nice that it's perfect for going out. (Score: 0.6050)
[3] Spending time cooking brings me great joy. (Score: 0.6014)
[4] Learning a new language opens up one's mind. (Score: 0.5614)
[5] Listening to music while walking is effective in relieving stress. (Score: 0.5565)
[6] 책을 μ½λŠ” 것은 λ§ˆμŒμ„ νŽΈμ•ˆν•˜κ²Œ ν•΄μ£Όκ³  지식을 λ„“ν˜€μ€λ‹ˆλ‹€. (Score: 0.5320)
[7] λ‚˜λŠ” λ―Έλž˜μ— λŒ€ν•œ 두렀움을 가지지 μ•Šκ³  미래λ₯Ό κΈ°λŒ€ν•˜λ©° μ‚΄κ³  μžˆμŠ΅λ‹ˆλ‹€. (Score: 0.5170)
[8] μƒˆλ‘œμš΄ μ–Έμ–΄λ₯Ό λ°°μš°λŠ” 것은 λ§ˆμŒμ„ 더 λ„“κ²Œ λ§Œλ“€μ–΄ μ€λ‹ˆλ‹€. (Score: 0.5029)
[9] λ‚˜λŠ” μ–΄μ œλ³΄λ‹€ 였늘 더 λ‚˜μ€ 내일을 λ§Œλ“€κΈ° μœ„ν•΄ λ…Έλ ₯ν•˜κ³  μžˆμŠ΅λ‹ˆλ‹€. (Score: 0.4747)
[10] μš”λ¦¬λ₯Ό ν•˜λ©° μ‹œκ°„μ„ λ³΄λ‚΄λŠ” 것은 λ‚˜μ—κ²Œ 큰 즐거움을 μ€λ‹ˆλ‹€. (Score: 0.4638)


================================================================================


Query: μ €λŠ” μš”λ¦¬λ₯Ό μ’‹μ•„ν•©λ‹ˆλ‹€.

Top 9 most similar sentences in corpus:

[1] μš”λ¦¬λ₯Ό ν•˜λ©° μ‹œκ°„μ„ λ³΄λ‚΄λŠ” 것은 λ‚˜μ—κ²Œ 큰 즐거움을 μ€λ‹ˆλ‹€. (Score: 0.9216)
[2] 책을 μ½λŠ” 것은 λ§ˆμŒμ„ νŽΈμ•ˆν•˜κ²Œ ν•΄μ£Όκ³  지식을 λ„“ν˜€μ€λ‹ˆλ‹€. (Score: 0.7398)
[3] λ‚˜λŠ” λ―Έλž˜μ— λŒ€ν•œ 두렀움을 가지지 μ•Šκ³  미래λ₯Ό κΈ°λŒ€ν•˜λ©° μ‚΄κ³  μžˆμŠ΅λ‹ˆλ‹€. (Score: 0.7346)
[4] Spending time cooking brings me great joy. (Score: 0.7076)
[5] μ˜€λŠ˜μ€ 날씨가 μ°Έ μ’‹μ•„μ„œ μ™ΈμΆœν•˜κΈ°μ— μ•„μ£Ό 쒋은 λ‚ μ΄μ—μš”. (Score: 0.6971)
[6] μƒˆλ‘œμš΄ μ–Έμ–΄λ₯Ό λ°°μš°λŠ” 것은 λ§ˆμŒμ„ 더 λ„“κ²Œ λ§Œλ“€μ–΄ μ€λ‹ˆλ‹€. (Score: 0.6932)
[7] λ‚˜λŠ” μ–΄μ œλ³΄λ‹€ 였늘 더 λ‚˜μ€ 내일을 λ§Œλ“€κΈ° μœ„ν•΄ λ…Έλ ₯ν•˜κ³  μžˆμŠ΅λ‹ˆλ‹€. (Score: 0.6546)
[8] μŒμ•…μ„ λ“€μœΌλ©° μ‚°μ±…ν•˜λŠ” 것은 슀트레슀λ₯Ό ν•΄μ†Œν•˜λŠ” 데에 νš¨κ³Όμ μž…λ‹ˆλ‹€. (Score: 0.5602)
[9] Reading books relaxes the mind and broadens one's knowledge. (Score: 0.5369)
[10] Today, the weather is so nice that it's perfect for going out. (Score: 0.5046)


================================================================================


Query: I love cooking.

Top 9 most similar sentences in corpus:

[1] Spending time cooking brings me great joy. (Score: 0.8812)
[2] μš”λ¦¬λ₯Ό ν•˜λ©° μ‹œκ°„μ„ λ³΄λ‚΄λŠ” 것은 λ‚˜μ—κ²Œ 큰 즐거움을 μ€λ‹ˆλ‹€. (Score: 0.7354)
[3] Reading books relaxes the mind and broadens one's knowledge. (Score: 0.6897)
[4] Today, the weather is so nice that it's perfect for going out. (Score: 0.6842)
[5] λ‚˜λŠ” λ―Έλž˜μ— λŒ€ν•œ 두렀움을 가지지 μ•Šκ³  미래λ₯Ό κΈ°λŒ€ν•˜λ©° μ‚΄κ³  μžˆμŠ΅λ‹ˆλ‹€. (Score: 0.6302)
[6] Learning a new language opens up one's mind. (Score: 0.6216)
[7] 책을 μ½λŠ” 것은 λ§ˆμŒμ„ νŽΈμ•ˆν•˜κ²Œ ν•΄μ£Όκ³  지식을 λ„“ν˜€μ€λ‹ˆλ‹€. (Score: 0.6095)
[8] μƒˆλ‘œμš΄ μ–Έμ–΄λ₯Ό λ°°μš°λŠ” 것은 λ§ˆμŒμ„ 더 λ„“κ²Œ λ§Œλ“€μ–΄ μ€λ‹ˆλ‹€. (Score: 0.5962)
[9] Listening to music while walking is effective in relieving stress. (Score: 0.5909)
[10] λ‚˜λŠ” μ–΄μ œλ³΄λ‹€ 였늘 더 λ‚˜μ€ 내일을 λ§Œλ“€κΈ° μœ„ν•΄ λ…Έλ ₯ν•˜κ³  μžˆμŠ΅λ‹ˆλ‹€. (Score: 0.5662)