Hugging Face's logo

bclavie
/
JaColBERT

Sentence Similarity
Safetensors
Japanese
RAGatouille
bert
ColBERT
Model card Files Community
bclavie commited on
Commit
7aaea57
·
1 Parent(s): 16c52ee

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +1 -1
README.md CHANGED
@@ -69,7 +69,7 @@ Worth noting: JaColBERT is evaluated out-of-domain on all three datasets, wherea
69
  | | JSQuAD | | | | MIRACL | | | | MrTyDi | | | | Average | | |
70
  | ------------------------------------------------------------------------ | ----------------------- | -------------------- | ------ | ----------------------- | ----------------------- | -------------------- | ------ | ----------------------- | ----------------------- | -------------------- | ------ | ----------------------- | ----------------------- | -------------------- | ------ |
71
  | | R@1 | R@5 | R@10 | | R@3 | R@5 | R@10 | | R@3 | R@5 | R@10 | | R@\{1\|3\} | R@5 | R@10 |
72
- | JaColBERT | **0.906*** | **0.968*** | 0.978* | | 0.464* | 0.546* | 0.645* | | 0.744* | 0.781* | 0.821* | | 0.705* | 0.765* | 0.813* |
73
  | m-e5-large (in-domain) | 0.865 | 0.966 | 0.977 | | **0.522** | **0.600** | **0.697** | | **0.813** | **0.856** | **0.893** | | **0.730** | **0.807** | **0.856** |
74
  | m-e5-base (in-domain) | *0.838* | *0.955* | 0.973 | | 0.482 | 0.553 | 0.632 | | 0.777 | 0.815 | 0.857 | | 0.699 | 0.775 | 0.820 |
75
  | m-e5-small (in-domain) | *0.840* | *0.954* | 0.973 | | 0.464 | 0.540 | 0.640 | | 0.767 | 0.794 | 0.844 | | 0.690 | 0.763 | 0.819 |
 
69
  | | JSQuAD | | | | MIRACL | | | | MrTyDi | | | | Average | | |
70
  | ------------------------------------------------------------------------ | ----------------------- | -------------------- | ------ | ----------------------- | ----------------------- | -------------------- | ------ | ----------------------- | ----------------------- | -------------------- | ------ | ----------------------- | ----------------------- | -------------------- | ------ |
71
  | | R@1 | R@5 | R@10 | | R@3 | R@5 | R@10 | | R@3 | R@5 | R@10 | | R@\{1\|3\} | R@5 | R@10 |
72
+ | JaColBERT | **0.906*** | **0.968*** | **0.978*** | | 0.464* | 0.546* | 0.645* | | 0.744* | 0.781* | 0.821* | | 0.705* | 0.765* | 0.813* |
73
  | m-e5-large (in-domain) | 0.865 | 0.966 | 0.977 | | **0.522** | **0.600** | **0.697** | | **0.813** | **0.856** | **0.893** | | **0.730** | **0.807** | **0.856** |
74
  | m-e5-base (in-domain) | *0.838* | *0.955* | 0.973 | | 0.482 | 0.553 | 0.632 | | 0.777 | 0.815 | 0.857 | | 0.699 | 0.775 | 0.820 |
75
  | m-e5-small (in-domain) | *0.840* | *0.954* | 0.973 | | 0.464 | 0.540 | 0.640 | | 0.767 | 0.794 | 0.844 | | 0.690 | 0.763 | 0.819 |