T3Q-LLM's picture
Update README.md
3f35e87 verified
---
library_name: transformers
tags: []
---
# Model Card for Model ID
<!-- Provide a quick summary of what the model is/does. -->
## Model Details
### Model Description
<!-- Provide a longer summary of what this model is. -->
This is the model card of a πŸ€— transformers model that has been pushed on the Hub. This model card has been automatically generated.
- **Developed by:** [More Information Needed]
- **Funded by [optional]:** [More Information Needed]
- **Shared by [optional]:** [More Information Needed]
- **Model type:** [More Information Needed]
- **Language(s) (NLP):** [More Information Needed]
- **License:** [More Information Needed]
- **Finetuned from model [optional]:** [More Information Needed]
hf-causal-experimental (pretrained=T3Q-LLM/T3Q-LLM-TE-NLI-Lora16-NEF-v1.0,use_accelerate=true,trust_remote_code=true), limit: None, provide_description: False, num_fewshot: 0, batch_size: 8
| Task |Version| Metric |Value | |Stderr|
|----------------|------:|--------|-----:|---|-----:|
|kobest_boolq | 0|acc |0.9551|Β± |0.0055|
| | |macro_f1|0.9551|Β± |0.0055|
|kobest_copa | 0|acc |0.7760|Β± |0.0132|
| | |macro_f1|0.7758|Β± |0.0132|
|kobest_hellaswag| 0|acc |0.5160|Β± |0.0224|
| | |acc_norm|0.5420|Β± |0.0223|
| | |macro_f1|0.5134|Β± |0.0224|
|kobest_sentineg | 0|acc |0.8791|Β± |0.0164|
| | |macro_f1|0.8786|Β± |0.0165|
================================================================================
Query: 였늘 날씨 μ–΄λ•Œμš”?
Top 9 most similar sentences in corpus:
[1] μ˜€λŠ˜μ€ 날씨가 μ°Έ μ’‹μ•„μ„œ μ™ΈμΆœν•˜κΈ°μ— μ•„μ£Ό 쒋은 λ‚ μ΄μ—μš”. (Score: 0.6658)
[2] λ‚˜λŠ” λ―Έλž˜μ— λŒ€ν•œ 두렀움을 가지지 μ•Šκ³  미래λ₯Ό κΈ°λŒ€ν•˜λ©° μ‚΄κ³  μžˆμŠ΅λ‹ˆλ‹€. (Score: 0.6114)
[3] 책을 μ½λŠ” 것은 λ§ˆμŒμ„ νŽΈμ•ˆν•˜κ²Œ ν•΄μ£Όκ³  지식을 λ„“ν˜€μ€λ‹ˆλ‹€. (Score: 0.5735)
[4] μš”λ¦¬λ₯Ό ν•˜λ©° μ‹œκ°„μ„ λ³΄λ‚΄λŠ” 것은 λ‚˜μ—κ²Œ 큰 즐거움을 μ€λ‹ˆλ‹€. (Score: 0.5500)
[5] μƒˆλ‘œμš΄ μ–Έμ–΄λ₯Ό λ°°μš°λŠ” 것은 λ§ˆμŒμ„ 더 λ„“κ²Œ λ§Œλ“€μ–΄ μ€λ‹ˆλ‹€. (Score: 0.5454)
[6] λ‚˜λŠ” μ–΄μ œλ³΄λ‹€ 였늘 더 λ‚˜μ€ 내일을 λ§Œλ“€κΈ° μœ„ν•΄ λ…Έλ ₯ν•˜κ³  μžˆμŠ΅λ‹ˆλ‹€. (Score: 0.5425)
[7] Today, the weather is so nice that it's perfect for going out. (Score: 0.5206)
[8] Spending time cooking brings me great joy. (Score: 0.4776)
[9] Reading books relaxes the mind and broadens one's knowledge. (Score: 0.4726)
[10] μŒμ•…μ„ λ“€μœΌλ©° μ‚°μ±…ν•˜λŠ” 것은 슀트레슀λ₯Ό ν•΄μ†Œν•˜λŠ” 데에 νš¨κ³Όμ μž…λ‹ˆλ‹€. (Score: 0.4723)
================================================================================
Query: What's the weather like today?
Top 9 most similar sentences in corpus:
[1] Today, the weather is so nice that it's perfect for going out. (Score: 0.6031)
[2] μ˜€λŠ˜μ€ 날씨가 μ°Έ μ’‹μ•„μ„œ μ™ΈμΆœν•˜κΈ°μ— μ•„μ£Ό 쒋은 λ‚ μ΄μ—μš”. (Score: 0.4892)
[3] λ‚˜λŠ” λ―Έλž˜μ— λŒ€ν•œ 두렀움을 가지지 μ•Šκ³  미래λ₯Ό κΈ°λŒ€ν•˜λ©° μ‚΄κ³  μžˆμŠ΅λ‹ˆλ‹€. (Score: 0.4804)
[4] Spending time cooking brings me great joy. (Score: 0.4652)
[5] Reading books relaxes the mind and broadens one's knowledge. (Score: 0.4611)
[6] λ‚˜λŠ” μ–΄μ œλ³΄λ‹€ 였늘 더 λ‚˜μ€ 내일을 λ§Œλ“€κΈ° μœ„ν•΄ λ…Έλ ₯ν•˜κ³  μžˆμŠ΅λ‹ˆλ‹€. (Score: 0.4485)
[7] 책을 μ½λŠ” 것은 λ§ˆμŒμ„ νŽΈμ•ˆν•˜κ²Œ ν•΄μ£Όκ³  지식을 λ„“ν˜€μ€λ‹ˆλ‹€. (Score: 0.4267)
[8] μš”λ¦¬λ₯Ό ν•˜λ©° μ‹œκ°„μ„ λ³΄λ‚΄λŠ” 것은 λ‚˜μ—κ²Œ 큰 즐거움을 μ€λ‹ˆλ‹€. (Score: 0.4248)
[9] μƒˆλ‘œμš΄ μ–Έμ–΄λ₯Ό λ°°μš°λŠ” 것은 λ§ˆμŒμ„ 더 λ„“κ²Œ λ§Œλ“€μ–΄ μ€λ‹ˆλ‹€. (Score: 0.4170)
[10] Listening to music while walking is effective in relieving stress. (Score: 0.4101)
================================================================================
Query: μ–΄λ–€ 책을 μ½λŠ” 것이 μ’‹μ„κΉŒμš”?
Top 9 most similar sentences in corpus:
[1] 책을 μ½λŠ” 것은 λ§ˆμŒμ„ νŽΈμ•ˆν•˜κ²Œ ν•΄μ£Όκ³  지식을 λ„“ν˜€μ€λ‹ˆλ‹€. (Score: 0.6988)
[2] λ‚˜λŠ” λ―Έλž˜μ— λŒ€ν•œ 두렀움을 가지지 μ•Šκ³  미래λ₯Ό κΈ°λŒ€ν•˜λ©° μ‚΄κ³  μžˆμŠ΅λ‹ˆλ‹€. (Score: 0.6811)
[3] μƒˆλ‘œμš΄ μ–Έμ–΄λ₯Ό λ°°μš°λŠ” 것은 λ§ˆμŒμ„ 더 λ„“κ²Œ λ§Œλ“€μ–΄ μ€λ‹ˆλ‹€. (Score: 0.6438)
[4] λ‚˜λŠ” μ–΄μ œλ³΄λ‹€ 였늘 더 λ‚˜μ€ 내일을 λ§Œλ“€κΈ° μœ„ν•΄ λ…Έλ ₯ν•˜κ³  μžˆμŠ΅λ‹ˆλ‹€. (Score: 0.6196)
[5] μš”λ¦¬λ₯Ό ν•˜λ©° μ‹œκ°„μ„ λ³΄λ‚΄λŠ” 것은 λ‚˜μ—κ²Œ 큰 즐거움을 μ€λ‹ˆλ‹€. (Score: 0.5932)
[6] Reading books relaxes the mind and broadens one's knowledge. (Score: 0.5892)
[7] μ˜€λŠ˜μ€ 날씨가 μ°Έ μ’‹μ•„μ„œ μ™ΈμΆœν•˜κΈ°μ— μ•„μ£Ό 쒋은 λ‚ μ΄μ—μš”. (Score: 0.5634)
[8] Spending time cooking brings me great joy. (Score: 0.5327)
[9] Today, the weather is so nice that it's perfect for going out. (Score: 0.4939)
[10] Learning a new language opens up one's mind. (Score: 0.4934)
================================================================================
Query: What books do you recommend reading?
Top 9 most similar sentences in corpus:
[1] Reading books relaxes the mind and broadens one's knowledge. (Score: 0.6845)
[2] Today, the weather is so nice that it's perfect for going out. (Score: 0.6050)
[3] Spending time cooking brings me great joy. (Score: 0.6014)
[4] Learning a new language opens up one's mind. (Score: 0.5614)
[5] Listening to music while walking is effective in relieving stress. (Score: 0.5565)
[6] 책을 μ½λŠ” 것은 λ§ˆμŒμ„ νŽΈμ•ˆν•˜κ²Œ ν•΄μ£Όκ³  지식을 λ„“ν˜€μ€λ‹ˆλ‹€. (Score: 0.5320)
[7] λ‚˜λŠ” λ―Έλž˜μ— λŒ€ν•œ 두렀움을 가지지 μ•Šκ³  미래λ₯Ό κΈ°λŒ€ν•˜λ©° μ‚΄κ³  μžˆμŠ΅λ‹ˆλ‹€. (Score: 0.5170)
[8] μƒˆλ‘œμš΄ μ–Έμ–΄λ₯Ό λ°°μš°λŠ” 것은 λ§ˆμŒμ„ 더 λ„“κ²Œ λ§Œλ“€μ–΄ μ€λ‹ˆλ‹€. (Score: 0.5029)
[9] λ‚˜λŠ” μ–΄μ œλ³΄λ‹€ 였늘 더 λ‚˜μ€ 내일을 λ§Œλ“€κΈ° μœ„ν•΄ λ…Έλ ₯ν•˜κ³  μžˆμŠ΅λ‹ˆλ‹€. (Score: 0.4747)
[10] μš”λ¦¬λ₯Ό ν•˜λ©° μ‹œκ°„μ„ λ³΄λ‚΄λŠ” 것은 λ‚˜μ—κ²Œ 큰 즐거움을 μ€λ‹ˆλ‹€. (Score: 0.4638)
================================================================================
Query: μ €λŠ” μš”λ¦¬λ₯Ό μ’‹μ•„ν•©λ‹ˆλ‹€.
Top 9 most similar sentences in corpus:
[1] μš”λ¦¬λ₯Ό ν•˜λ©° μ‹œκ°„μ„ λ³΄λ‚΄λŠ” 것은 λ‚˜μ—κ²Œ 큰 즐거움을 μ€λ‹ˆλ‹€. (Score: 0.9216)
[2] 책을 μ½λŠ” 것은 λ§ˆμŒμ„ νŽΈμ•ˆν•˜κ²Œ ν•΄μ£Όκ³  지식을 λ„“ν˜€μ€λ‹ˆλ‹€. (Score: 0.7398)
[3] λ‚˜λŠ” λ―Έλž˜μ— λŒ€ν•œ 두렀움을 가지지 μ•Šκ³  미래λ₯Ό κΈ°λŒ€ν•˜λ©° μ‚΄κ³  μžˆμŠ΅λ‹ˆλ‹€. (Score: 0.7346)
[4] Spending time cooking brings me great joy. (Score: 0.7076)
[5] μ˜€λŠ˜μ€ 날씨가 μ°Έ μ’‹μ•„μ„œ μ™ΈμΆœν•˜κΈ°μ— μ•„μ£Ό 쒋은 λ‚ μ΄μ—μš”. (Score: 0.6971)
[6] μƒˆλ‘œμš΄ μ–Έμ–΄λ₯Ό λ°°μš°λŠ” 것은 λ§ˆμŒμ„ 더 λ„“κ²Œ λ§Œλ“€μ–΄ μ€λ‹ˆλ‹€. (Score: 0.6932)
[7] λ‚˜λŠ” μ–΄μ œλ³΄λ‹€ 였늘 더 λ‚˜μ€ 내일을 λ§Œλ“€κΈ° μœ„ν•΄ λ…Έλ ₯ν•˜κ³  μžˆμŠ΅λ‹ˆλ‹€. (Score: 0.6546)
[8] μŒμ•…μ„ λ“€μœΌλ©° μ‚°μ±…ν•˜λŠ” 것은 슀트레슀λ₯Ό ν•΄μ†Œν•˜λŠ” 데에 νš¨κ³Όμ μž…λ‹ˆλ‹€. (Score: 0.5602)
[9] Reading books relaxes the mind and broadens one's knowledge. (Score: 0.5369)
[10] Today, the weather is so nice that it's perfect for going out. (Score: 0.5046)
================================================================================
Query: I love cooking.
Top 9 most similar sentences in corpus:
[1] Spending time cooking brings me great joy. (Score: 0.8812)
[2] μš”λ¦¬λ₯Ό ν•˜λ©° μ‹œκ°„μ„ λ³΄λ‚΄λŠ” 것은 λ‚˜μ—κ²Œ 큰 즐거움을 μ€λ‹ˆλ‹€. (Score: 0.7354)
[3] Reading books relaxes the mind and broadens one's knowledge. (Score: 0.6897)
[4] Today, the weather is so nice that it's perfect for going out. (Score: 0.6842)
[5] λ‚˜λŠ” λ―Έλž˜μ— λŒ€ν•œ 두렀움을 가지지 μ•Šκ³  미래λ₯Ό κΈ°λŒ€ν•˜λ©° μ‚΄κ³  μžˆμŠ΅λ‹ˆλ‹€. (Score: 0.6302)
[6] Learning a new language opens up one's mind. (Score: 0.6216)
[7] 책을 μ½λŠ” 것은 λ§ˆμŒμ„ νŽΈμ•ˆν•˜κ²Œ ν•΄μ£Όκ³  지식을 λ„“ν˜€μ€λ‹ˆλ‹€. (Score: 0.6095)
[8] μƒˆλ‘œμš΄ μ–Έμ–΄λ₯Ό λ°°μš°λŠ” 것은 λ§ˆμŒμ„ 더 λ„“κ²Œ λ§Œλ“€μ–΄ μ€λ‹ˆλ‹€. (Score: 0.5962)
[9] Listening to music while walking is effective in relieving stress. (Score: 0.5909)
[10] λ‚˜λŠ” μ–΄μ œλ³΄λ‹€ 였늘 더 λ‚˜μ€ 내일을 λ§Œλ“€κΈ° μœ„ν•΄ λ…Έλ ₯ν•˜κ³  μžˆμŠ΅λ‹ˆλ‹€. (Score: 0.5662)