|
--- |
|
library_name: transformers |
|
tags: [] |
|
--- |
|
|
|
# Model Card for Model ID |
|
|
|
<!-- Provide a quick summary of what the model is/does. --> |
|
|
|
|
|
|
|
## Model Details |
|
|
|
### Model Description |
|
|
|
<!-- Provide a longer summary of what this model is. --> |
|
|
|
This is the model card of a π€ transformers model that has been pushed on the Hub. This model card has been automatically generated. |
|
|
|
- **Developed by:** [More Information Needed] |
|
- **Funded by [optional]:** [More Information Needed] |
|
- **Shared by [optional]:** [More Information Needed] |
|
- **Model type:** [More Information Needed] |
|
- **Language(s) (NLP):** [More Information Needed] |
|
- **License:** [More Information Needed] |
|
- **Finetuned from model [optional]:** [More Information Needed] |
|
|
|
|
|
hf-causal-experimental (pretrained=T3Q-LLM/T3Q-LLM-TE-NLI-Lora16-NEF-v1.0,use_accelerate=true,trust_remote_code=true), limit: None, provide_description: False, num_fewshot: 0, batch_size: 8 |
|
| Task |Version| Metric |Value | |Stderr| |
|
|----------------|------:|--------|-----:|---|-----:| |
|
|kobest_boolq | 0|acc |0.9551|Β± |0.0055| |
|
| | |macro_f1|0.9551|Β± |0.0055| |
|
|kobest_copa | 0|acc |0.7760|Β± |0.0132| |
|
| | |macro_f1|0.7758|Β± |0.0132| |
|
|kobest_hellaswag| 0|acc |0.5160|Β± |0.0224| |
|
| | |acc_norm|0.5420|Β± |0.0223| |
|
| | |macro_f1|0.5134|Β± |0.0224| |
|
|kobest_sentineg | 0|acc |0.8791|Β± |0.0164| |
|
| | |macro_f1|0.8786|Β± |0.0165| |
|
|
|
|
|
|
|
|
|
================================================================================ |
|
|
|
|
|
Query: μ€λ λ μ¨ μ΄λμ? |
|
|
|
Top 9 most similar sentences in corpus: |
|
|
|
[1] μ€λμ λ μ¨κ° μ°Έ μ’μμ μΈμΆνκΈ°μ μμ£Ό μ’μ λ μ΄μμ. (Score: 0.6658) |
|
[2] λλ λ―Έλμ λν λλ €μμ κ°μ§μ§ μκ³ λ―Έλλ₯Ό κΈ°λνλ©° μ΄κ³ μμ΅λλ€. (Score: 0.6114) |
|
[3] μ±
μ μ½λ κ²μ λ§μμ νΈμνκ² ν΄μ£Όκ³ μ§μμ λνμ€λλ€. (Score: 0.5735) |
|
[4] μ리λ₯Ό νλ©° μκ°μ 보λ΄λ κ²μ λμκ² ν° μ¦κ±°μμ μ€λλ€. (Score: 0.5500) |
|
[5] μλ‘μ΄ μΈμ΄λ₯Ό λ°°μ°λ κ²μ λ§μμ λ λκ² λ§λ€μ΄ μ€λλ€. (Score: 0.5454) |
|
[6] λλ μ΄μ λ³΄λ€ μ€λ λ λμ λ΄μΌμ λ§λ€κΈ° μν΄ λ
Έλ ₯νκ³ μμ΅λλ€. (Score: 0.5425) |
|
[7] Today, the weather is so nice that it's perfect for going out. (Score: 0.5206) |
|
[8] Spending time cooking brings me great joy. (Score: 0.4776) |
|
[9] Reading books relaxes the mind and broadens one's knowledge. (Score: 0.4726) |
|
[10] μμ
μ λ€μΌλ©° μ°μ±
νλ κ²μ μ€νΈλ μ€λ₯Ό ν΄μνλ λ°μ ν¨κ³Όμ μ
λλ€. (Score: 0.4723) |
|
|
|
|
|
================================================================================ |
|
|
|
|
|
Query: What's the weather like today? |
|
|
|
Top 9 most similar sentences in corpus: |
|
|
|
[1] Today, the weather is so nice that it's perfect for going out. (Score: 0.6031) |
|
[2] μ€λμ λ μ¨κ° μ°Έ μ’μμ μΈμΆνκΈ°μ μμ£Ό μ’μ λ μ΄μμ. (Score: 0.4892) |
|
[3] λλ λ―Έλμ λν λλ €μμ κ°μ§μ§ μκ³ λ―Έλλ₯Ό κΈ°λνλ©° μ΄κ³ μμ΅λλ€. (Score: 0.4804) |
|
[4] Spending time cooking brings me great joy. (Score: 0.4652) |
|
[5] Reading books relaxes the mind and broadens one's knowledge. (Score: 0.4611) |
|
[6] λλ μ΄μ λ³΄λ€ μ€λ λ λμ λ΄μΌμ λ§λ€κΈ° μν΄ λ
Έλ ₯νκ³ μμ΅λλ€. (Score: 0.4485) |
|
[7] μ±
μ μ½λ κ²μ λ§μμ νΈμνκ² ν΄μ£Όκ³ μ§μμ λνμ€λλ€. (Score: 0.4267) |
|
[8] μ리λ₯Ό νλ©° μκ°μ 보λ΄λ κ²μ λμκ² ν° μ¦κ±°μμ μ€λλ€. (Score: 0.4248) |
|
[9] μλ‘μ΄ μΈμ΄λ₯Ό λ°°μ°λ κ²μ λ§μμ λ λκ² λ§λ€μ΄ μ€λλ€. (Score: 0.4170) |
|
[10] Listening to music while walking is effective in relieving stress. (Score: 0.4101) |
|
|
|
|
|
================================================================================ |
|
|
|
|
|
Query: μ΄λ€ μ±
μ μ½λ κ²μ΄ μ’μκΉμ? |
|
|
|
Top 9 most similar sentences in corpus: |
|
|
|
[1] μ±
μ μ½λ κ²μ λ§μμ νΈμνκ² ν΄μ£Όκ³ μ§μμ λνμ€λλ€. (Score: 0.6988) |
|
[2] λλ λ―Έλμ λν λλ €μμ κ°μ§μ§ μκ³ λ―Έλλ₯Ό κΈ°λνλ©° μ΄κ³ μμ΅λλ€. (Score: 0.6811) |
|
[3] μλ‘μ΄ μΈμ΄λ₯Ό λ°°μ°λ κ²μ λ§μμ λ λκ² λ§λ€μ΄ μ€λλ€. (Score: 0.6438) |
|
[4] λλ μ΄μ λ³΄λ€ μ€λ λ λμ λ΄μΌμ λ§λ€κΈ° μν΄ λ
Έλ ₯νκ³ μμ΅λλ€. (Score: 0.6196) |
|
[5] μ리λ₯Ό νλ©° μκ°μ 보λ΄λ κ²μ λμκ² ν° μ¦κ±°μμ μ€λλ€. (Score: 0.5932) |
|
[6] Reading books relaxes the mind and broadens one's knowledge. (Score: 0.5892) |
|
[7] μ€λμ λ μ¨κ° μ°Έ μ’μμ μΈμΆνκΈ°μ μμ£Ό μ’μ λ μ΄μμ. (Score: 0.5634) |
|
[8] Spending time cooking brings me great joy. (Score: 0.5327) |
|
[9] Today, the weather is so nice that it's perfect for going out. (Score: 0.4939) |
|
[10] Learning a new language opens up one's mind. (Score: 0.4934) |
|
|
|
|
|
================================================================================ |
|
|
|
|
|
Query: What books do you recommend reading? |
|
|
|
Top 9 most similar sentences in corpus: |
|
|
|
[1] Reading books relaxes the mind and broadens one's knowledge. (Score: 0.6845) |
|
[2] Today, the weather is so nice that it's perfect for going out. (Score: 0.6050) |
|
[3] Spending time cooking brings me great joy. (Score: 0.6014) |
|
[4] Learning a new language opens up one's mind. (Score: 0.5614) |
|
[5] Listening to music while walking is effective in relieving stress. (Score: 0.5565) |
|
[6] μ±
μ μ½λ κ²μ λ§μμ νΈμνκ² ν΄μ£Όκ³ μ§μμ λνμ€λλ€. (Score: 0.5320) |
|
[7] λλ λ―Έλμ λν λλ €μμ κ°μ§μ§ μκ³ λ―Έλλ₯Ό κΈ°λνλ©° μ΄κ³ μμ΅λλ€. (Score: 0.5170) |
|
[8] μλ‘μ΄ μΈμ΄λ₯Ό λ°°μ°λ κ²μ λ§μμ λ λκ² λ§λ€μ΄ μ€λλ€. (Score: 0.5029) |
|
[9] λλ μ΄μ λ³΄λ€ μ€λ λ λμ λ΄μΌμ λ§λ€κΈ° μν΄ λ
Έλ ₯νκ³ μμ΅λλ€. (Score: 0.4747) |
|
[10] μ리λ₯Ό νλ©° μκ°μ 보λ΄λ κ²μ λμκ² ν° μ¦κ±°μμ μ€λλ€. (Score: 0.4638) |
|
|
|
|
|
================================================================================ |
|
|
|
|
|
Query: μ λ μ리λ₯Ό μ’μν©λλ€. |
|
|
|
Top 9 most similar sentences in corpus: |
|
|
|
[1] μ리λ₯Ό νλ©° μκ°μ 보λ΄λ κ²μ λμκ² ν° μ¦κ±°μμ μ€λλ€. (Score: 0.9216) |
|
[2] μ±
μ μ½λ κ²μ λ§μμ νΈμνκ² ν΄μ£Όκ³ μ§μμ λνμ€λλ€. (Score: 0.7398) |
|
[3] λλ λ―Έλμ λν λλ €μμ κ°μ§μ§ μκ³ λ―Έλλ₯Ό κΈ°λνλ©° μ΄κ³ μμ΅λλ€. (Score: 0.7346) |
|
[4] Spending time cooking brings me great joy. (Score: 0.7076) |
|
[5] μ€λμ λ μ¨κ° μ°Έ μ’μμ μΈμΆνκΈ°μ μμ£Ό μ’μ λ μ΄μμ. (Score: 0.6971) |
|
[6] μλ‘μ΄ μΈμ΄λ₯Ό λ°°μ°λ κ²μ λ§μμ λ λκ² λ§λ€μ΄ μ€λλ€. (Score: 0.6932) |
|
[7] λλ μ΄μ λ³΄λ€ μ€λ λ λμ λ΄μΌμ λ§λ€κΈ° μν΄ λ
Έλ ₯νκ³ μμ΅λλ€. (Score: 0.6546) |
|
[8] μμ
μ λ€μΌλ©° μ°μ±
νλ κ²μ μ€νΈλ μ€λ₯Ό ν΄μνλ λ°μ ν¨κ³Όμ μ
λλ€. (Score: 0.5602) |
|
[9] Reading books relaxes the mind and broadens one's knowledge. (Score: 0.5369) |
|
[10] Today, the weather is so nice that it's perfect for going out. (Score: 0.5046) |
|
|
|
|
|
================================================================================ |
|
|
|
|
|
Query: I love cooking. |
|
|
|
Top 9 most similar sentences in corpus: |
|
|
|
[1] Spending time cooking brings me great joy. (Score: 0.8812) |
|
[2] μ리λ₯Ό νλ©° μκ°μ 보λ΄λ κ²μ λμκ² ν° μ¦κ±°μμ μ€λλ€. (Score: 0.7354) |
|
[3] Reading books relaxes the mind and broadens one's knowledge. (Score: 0.6897) |
|
[4] Today, the weather is so nice that it's perfect for going out. (Score: 0.6842) |
|
[5] λλ λ―Έλμ λν λλ €μμ κ°μ§μ§ μκ³ λ―Έλλ₯Ό κΈ°λνλ©° μ΄κ³ μμ΅λλ€. (Score: 0.6302) |
|
[6] Learning a new language opens up one's mind. (Score: 0.6216) |
|
[7] μ±
μ μ½λ κ²μ λ§μμ νΈμνκ² ν΄μ£Όκ³ μ§μμ λνμ€λλ€. (Score: 0.6095) |
|
[8] μλ‘μ΄ μΈμ΄λ₯Ό λ°°μ°λ κ²μ λ§μμ λ λκ² λ§λ€μ΄ μ€λλ€. (Score: 0.5962) |
|
[9] Listening to music while walking is effective in relieving stress. (Score: 0.5909) |
|
[10] λλ μ΄μ λ³΄λ€ μ€λ λ λμ λ΄μΌμ λ§λ€κΈ° μν΄ λ
Έλ ₯νκ³ μμ΅λλ€. (Score: 0.5662) |
|
|
|
|
|
|