Hugging Face's logo

uzabase
/
LLM2Vec-Llama-2-7b-hf-mntp-unsup-simcse

PEFT
Safetensors
English
Model card Files Community
h-iida commited on
Commit
ff05d22
·
verified ·
1 Parent(s): 5073817

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +6 -1
README.md CHANGED
@@ -38,12 +38,17 @@ For the MNTP Adapter, please refer to [this link](https://huggingface.co/uzabase
38
 
39
  | | Classification | Clustering | PairClassification | Reranking | BitextMining | Retrieval | Sts | AVG |
40
  | --- | ---| ---| ---| ---| ---| ---| ---| ---| ---| ---| ---| ---| ---| ---|
41
- | |Llama2-Llm2vec-eng (This repo) | 0.527 | 0.258 | 0.501 | 0.217 | 0.275 | 0.296 | 0.765 | 0.408 |
42
  | Llama2-Llm2vec-jpn | 0.570 | 0.365 | 0.510 | 0.349 | 0.470 | 0.417 | 0.795 | 0.498 |
43
  | Swallow-Llm2vec-jpn | 0.621 | 0.391 | 0.510 | 0.475 | 0.475 | 0.491 | 0.832 | 0.523 |
44
 
45
  ## MTEB(English)
46
 
 
 
 
 
 
47
 
48
  # Training Details
49
 
 
38
 
39
  | | Classification | Clustering | PairClassification | Reranking | BitextMining | Retrieval | Sts | AVG |
40
  | --- | ---| ---| ---| ---| ---| ---| ---| ---| ---| ---| ---| ---| ---| ---|
41
+ | **Llama2-Llm2vec-eng (This repo)** | 0.527 | 0.258 | 0.501 | 0.217 | 0.275 | 0.296 | 0.765 | 0.408 |
42
  | Llama2-Llm2vec-jpn | 0.570 | 0.365 | 0.510 | 0.349 | 0.470 | 0.417 | 0.795 | 0.498 |
43
  | Swallow-Llm2vec-jpn | 0.621 | 0.391 | 0.510 | 0.475 | 0.475 | 0.491 | 0.832 | 0.523 |
44
 
45
  ## MTEB(English)
46
 
47
+ | | Classification | Clustering | Pair_Classification| Reranking | Retrieval | STS | 平均 |
48
+ | --- | ---: | ---: | ---: | ---: | ---: | ---: | ---: |
49
+ | **Llama2-Llm2vec-eng (this repo)** | 0.709 | 0.386 | 0.780 | 0.588 | 0.329| 0.723 | 0.586 |
50
+ | Llama2-Llm2vec-jpn | 0.722 | 0.428 | 0.785 | 0.594 | 0.371 | 0.717 | 0.603 |
51
+ | Swallow-Llm2vec-jpn | 0.695 | 0.385 | 0.751 | 0.576 | 0.318 | 0.710 | 0.572 |
52
 
53
  # Training Details
54