T3Q-LLM's picture
Update README.md
3f35e87 verified
metadata
library_name: transformers
tags: []

Model Card for Model ID

Model Details

Model Description

This is the model card of a πŸ€— transformers model that has been pushed on the Hub. This model card has been automatically generated.

  • Developed by: [More Information Needed]
  • Funded by [optional]: [More Information Needed]
  • Shared by [optional]: [More Information Needed]
  • Model type: [More Information Needed]
  • Language(s) (NLP): [More Information Needed]
  • License: [More Information Needed]
  • Finetuned from model [optional]: [More Information Needed]

hf-causal-experimental (pretrained=T3Q-LLM/T3Q-LLM-TE-NLI-Lora16-NEF-v1.0,use_accelerate=true,trust_remote_code=true), limit: None, provide_description: False, num_fewshot: 0, batch_size: 8

Task Version Metric Value Stderr
kobest_boolq 0 acc 0.9551 Β± 0.0055
macro_f1 0.9551 Β± 0.0055
kobest_copa 0 acc 0.7760 Β± 0.0132
macro_f1 0.7758 Β± 0.0132
kobest_hellaswag 0 acc 0.5160 Β± 0.0224
acc_norm 0.5420 Β± 0.0223
macro_f1 0.5134 Β± 0.0224
kobest_sentineg 0 acc 0.8791 Β± 0.0164
macro_f1 0.8786 Β± 0.0165

================================================================================

Query: 였늘 날씨 μ–΄λ•Œμš”?

Top 9 most similar sentences in corpus:

[1] μ˜€λŠ˜μ€ 날씨가 μ°Έ μ’‹μ•„μ„œ μ™ΈμΆœν•˜κΈ°μ— μ•„μ£Ό 쒋은 λ‚ μ΄μ—μš”. (Score: 0.6658) [2] λ‚˜λŠ” λ―Έλž˜μ— λŒ€ν•œ 두렀움을 가지지 μ•Šκ³  미래λ₯Ό κΈ°λŒ€ν•˜λ©° μ‚΄κ³  μžˆμŠ΅λ‹ˆλ‹€. (Score: 0.6114) [3] 책을 μ½λŠ” 것은 λ§ˆμŒμ„ νŽΈμ•ˆν•˜κ²Œ ν•΄μ£Όκ³  지식을 λ„“ν˜€μ€λ‹ˆλ‹€. (Score: 0.5735) [4] μš”λ¦¬λ₯Ό ν•˜λ©° μ‹œκ°„μ„ λ³΄λ‚΄λŠ” 것은 λ‚˜μ—κ²Œ 큰 즐거움을 μ€λ‹ˆλ‹€. (Score: 0.5500) [5] μƒˆλ‘œμš΄ μ–Έμ–΄λ₯Ό λ°°μš°λŠ” 것은 λ§ˆμŒμ„ 더 λ„“κ²Œ λ§Œλ“€μ–΄ μ€λ‹ˆλ‹€. (Score: 0.5454) [6] λ‚˜λŠ” μ–΄μ œλ³΄λ‹€ 였늘 더 λ‚˜μ€ 내일을 λ§Œλ“€κΈ° μœ„ν•΄ λ…Έλ ₯ν•˜κ³  μžˆμŠ΅λ‹ˆλ‹€. (Score: 0.5425) [7] Today, the weather is so nice that it's perfect for going out. (Score: 0.5206) [8] Spending time cooking brings me great joy. (Score: 0.4776) [9] Reading books relaxes the mind and broadens one's knowledge. (Score: 0.4726) [10] μŒμ•…μ„ λ“€μœΌλ©° μ‚°μ±…ν•˜λŠ” 것은 슀트레슀λ₯Ό ν•΄μ†Œν•˜λŠ” 데에 νš¨κ³Όμ μž…λ‹ˆλ‹€. (Score: 0.4723)

================================================================================

Query: What's the weather like today?

Top 9 most similar sentences in corpus:

[1] Today, the weather is so nice that it's perfect for going out. (Score: 0.6031) [2] μ˜€λŠ˜μ€ 날씨가 μ°Έ μ’‹μ•„μ„œ μ™ΈμΆœν•˜κΈ°μ— μ•„μ£Ό 쒋은 λ‚ μ΄μ—μš”. (Score: 0.4892) [3] λ‚˜λŠ” λ―Έλž˜μ— λŒ€ν•œ 두렀움을 가지지 μ•Šκ³  미래λ₯Ό κΈ°λŒ€ν•˜λ©° μ‚΄κ³  μžˆμŠ΅λ‹ˆλ‹€. (Score: 0.4804) [4] Spending time cooking brings me great joy. (Score: 0.4652) [5] Reading books relaxes the mind and broadens one's knowledge. (Score: 0.4611) [6] λ‚˜λŠ” μ–΄μ œλ³΄λ‹€ 였늘 더 λ‚˜μ€ 내일을 λ§Œλ“€κΈ° μœ„ν•΄ λ…Έλ ₯ν•˜κ³  μžˆμŠ΅λ‹ˆλ‹€. (Score: 0.4485) [7] 책을 μ½λŠ” 것은 λ§ˆμŒμ„ νŽΈμ•ˆν•˜κ²Œ ν•΄μ£Όκ³  지식을 λ„“ν˜€μ€λ‹ˆλ‹€. (Score: 0.4267) [8] μš”λ¦¬λ₯Ό ν•˜λ©° μ‹œκ°„μ„ λ³΄λ‚΄λŠ” 것은 λ‚˜μ—κ²Œ 큰 즐거움을 μ€λ‹ˆλ‹€. (Score: 0.4248) [9] μƒˆλ‘œμš΄ μ–Έμ–΄λ₯Ό λ°°μš°λŠ” 것은 λ§ˆμŒμ„ 더 λ„“κ²Œ λ§Œλ“€μ–΄ μ€λ‹ˆλ‹€. (Score: 0.4170) [10] Listening to music while walking is effective in relieving stress. (Score: 0.4101)

================================================================================

Query: μ–΄λ–€ 책을 μ½λŠ” 것이 μ’‹μ„κΉŒμš”?

Top 9 most similar sentences in corpus:

[1] 책을 μ½λŠ” 것은 λ§ˆμŒμ„ νŽΈμ•ˆν•˜κ²Œ ν•΄μ£Όκ³  지식을 λ„“ν˜€μ€λ‹ˆλ‹€. (Score: 0.6988) [2] λ‚˜λŠ” λ―Έλž˜μ— λŒ€ν•œ 두렀움을 가지지 μ•Šκ³  미래λ₯Ό κΈ°λŒ€ν•˜λ©° μ‚΄κ³  μžˆμŠ΅λ‹ˆλ‹€. (Score: 0.6811) [3] μƒˆλ‘œμš΄ μ–Έμ–΄λ₯Ό λ°°μš°λŠ” 것은 λ§ˆμŒμ„ 더 λ„“κ²Œ λ§Œλ“€μ–΄ μ€λ‹ˆλ‹€. (Score: 0.6438) [4] λ‚˜λŠ” μ–΄μ œλ³΄λ‹€ 였늘 더 λ‚˜μ€ 내일을 λ§Œλ“€κΈ° μœ„ν•΄ λ…Έλ ₯ν•˜κ³  μžˆμŠ΅λ‹ˆλ‹€. (Score: 0.6196) [5] μš”λ¦¬λ₯Ό ν•˜λ©° μ‹œκ°„μ„ λ³΄λ‚΄λŠ” 것은 λ‚˜μ—κ²Œ 큰 즐거움을 μ€λ‹ˆλ‹€. (Score: 0.5932) [6] Reading books relaxes the mind and broadens one's knowledge. (Score: 0.5892) [7] μ˜€λŠ˜μ€ 날씨가 μ°Έ μ’‹μ•„μ„œ μ™ΈμΆœν•˜κΈ°μ— μ•„μ£Ό 쒋은 λ‚ μ΄μ—μš”. (Score: 0.5634) [8] Spending time cooking brings me great joy. (Score: 0.5327) [9] Today, the weather is so nice that it's perfect for going out. (Score: 0.4939) [10] Learning a new language opens up one's mind. (Score: 0.4934)

================================================================================

Query: What books do you recommend reading?

Top 9 most similar sentences in corpus:

[1] Reading books relaxes the mind and broadens one's knowledge. (Score: 0.6845) [2] Today, the weather is so nice that it's perfect for going out. (Score: 0.6050) [3] Spending time cooking brings me great joy. (Score: 0.6014) [4] Learning a new language opens up one's mind. (Score: 0.5614) [5] Listening to music while walking is effective in relieving stress. (Score: 0.5565) [6] 책을 μ½λŠ” 것은 λ§ˆμŒμ„ νŽΈμ•ˆν•˜κ²Œ ν•΄μ£Όκ³  지식을 λ„“ν˜€μ€λ‹ˆλ‹€. (Score: 0.5320) [7] λ‚˜λŠ” λ―Έλž˜μ— λŒ€ν•œ 두렀움을 가지지 μ•Šκ³  미래λ₯Ό κΈ°λŒ€ν•˜λ©° μ‚΄κ³  μžˆμŠ΅λ‹ˆλ‹€. (Score: 0.5170) [8] μƒˆλ‘œμš΄ μ–Έμ–΄λ₯Ό λ°°μš°λŠ” 것은 λ§ˆμŒμ„ 더 λ„“κ²Œ λ§Œλ“€μ–΄ μ€λ‹ˆλ‹€. (Score: 0.5029) [9] λ‚˜λŠ” μ–΄μ œλ³΄λ‹€ 였늘 더 λ‚˜μ€ 내일을 λ§Œλ“€κΈ° μœ„ν•΄ λ…Έλ ₯ν•˜κ³  μžˆμŠ΅λ‹ˆλ‹€. (Score: 0.4747) [10] μš”λ¦¬λ₯Ό ν•˜λ©° μ‹œκ°„μ„ λ³΄λ‚΄λŠ” 것은 λ‚˜μ—κ²Œ 큰 즐거움을 μ€λ‹ˆλ‹€. (Score: 0.4638)

================================================================================

Query: μ €λŠ” μš”λ¦¬λ₯Ό μ’‹μ•„ν•©λ‹ˆλ‹€.

Top 9 most similar sentences in corpus:

[1] μš”λ¦¬λ₯Ό ν•˜λ©° μ‹œκ°„μ„ λ³΄λ‚΄λŠ” 것은 λ‚˜μ—κ²Œ 큰 즐거움을 μ€λ‹ˆλ‹€. (Score: 0.9216) [2] 책을 μ½λŠ” 것은 λ§ˆμŒμ„ νŽΈμ•ˆν•˜κ²Œ ν•΄μ£Όκ³  지식을 λ„“ν˜€μ€λ‹ˆλ‹€. (Score: 0.7398) [3] λ‚˜λŠ” λ―Έλž˜μ— λŒ€ν•œ 두렀움을 가지지 μ•Šκ³  미래λ₯Ό κΈ°λŒ€ν•˜λ©° μ‚΄κ³  μžˆμŠ΅λ‹ˆλ‹€. (Score: 0.7346) [4] Spending time cooking brings me great joy. (Score: 0.7076) [5] μ˜€λŠ˜μ€ 날씨가 μ°Έ μ’‹μ•„μ„œ μ™ΈμΆœν•˜κΈ°μ— μ•„μ£Ό 쒋은 λ‚ μ΄μ—μš”. (Score: 0.6971) [6] μƒˆλ‘œμš΄ μ–Έμ–΄λ₯Ό λ°°μš°λŠ” 것은 λ§ˆμŒμ„ 더 λ„“κ²Œ λ§Œλ“€μ–΄ μ€λ‹ˆλ‹€. (Score: 0.6932) [7] λ‚˜λŠ” μ–΄μ œλ³΄λ‹€ 였늘 더 λ‚˜μ€ 내일을 λ§Œλ“€κΈ° μœ„ν•΄ λ…Έλ ₯ν•˜κ³  μžˆμŠ΅λ‹ˆλ‹€. (Score: 0.6546) [8] μŒμ•…μ„ λ“€μœΌλ©° μ‚°μ±…ν•˜λŠ” 것은 슀트레슀λ₯Ό ν•΄μ†Œν•˜λŠ” 데에 νš¨κ³Όμ μž…λ‹ˆλ‹€. (Score: 0.5602) [9] Reading books relaxes the mind and broadens one's knowledge. (Score: 0.5369) [10] Today, the weather is so nice that it's perfect for going out. (Score: 0.5046)

================================================================================

Query: I love cooking.

Top 9 most similar sentences in corpus:

[1] Spending time cooking brings me great joy. (Score: 0.8812) [2] μš”λ¦¬λ₯Ό ν•˜λ©° μ‹œκ°„μ„ λ³΄λ‚΄λŠ” 것은 λ‚˜μ—κ²Œ 큰 즐거움을 μ€λ‹ˆλ‹€. (Score: 0.7354) [3] Reading books relaxes the mind and broadens one's knowledge. (Score: 0.6897) [4] Today, the weather is so nice that it's perfect for going out. (Score: 0.6842) [5] λ‚˜λŠ” λ―Έλž˜μ— λŒ€ν•œ 두렀움을 가지지 μ•Šκ³  미래λ₯Ό κΈ°λŒ€ν•˜λ©° μ‚΄κ³  μžˆμŠ΅λ‹ˆλ‹€. (Score: 0.6302) [6] Learning a new language opens up one's mind. (Score: 0.6216) [7] 책을 μ½λŠ” 것은 λ§ˆμŒμ„ νŽΈμ•ˆν•˜κ²Œ ν•΄μ£Όκ³  지식을 λ„“ν˜€μ€λ‹ˆλ‹€. (Score: 0.6095) [8] μƒˆλ‘œμš΄ μ–Έμ–΄λ₯Ό λ°°μš°λŠ” 것은 λ§ˆμŒμ„ 더 λ„“κ²Œ λ§Œλ“€μ–΄ μ€λ‹ˆλ‹€. (Score: 0.5962) [9] Listening to music while walking is effective in relieving stress. (Score: 0.5909) [10] λ‚˜λŠ” μ–΄μ œλ³΄λ‹€ 였늘 더 λ‚˜μ€ 내일을 λ§Œλ“€κΈ° μœ„ν•΄ λ…Έλ ₯ν•˜κ³  μžˆμŠ΅λ‹ˆλ‹€. (Score: 0.5662)