Update README.md
Browse files
README.md
CHANGED
@@ -70,19 +70,19 @@ SentenceTransformer(
|
|
70 |
### STS (Semantic Textual Similarity)
|
71 |
- GermanSTSBenchmark
|
72 |
|
73 |
-
| TASK | UAE | [GRAG-UAE](https://huggingface.co/avemio/GRAG-UAE-LARGE-V1-TRIPLES-HESSIAN-AI/) | Merged-UAE | GRAG vs. UAE | Merged vs. UAE |
|
74 |
|-------------------------------------|-------|----------|------------|--------------|----------------|
|
75 |
-
| AmazonCounterfactualClassification | 0.5650 | 0.5449 | 0.5401 | -2.01% | -2.48% |
|
76 |
| AmazonReviewsClassification | 0.2738 | 0.2745 | **0.2782** | 0.08% | 0.44% |
|
77 |
-
| FalseFriendsGermanEnglish | 0.4808 | 0.4777 | 0.4703 | -0.32% | -1.05% |
|
78 |
| GermanQuAD-Retrieval | 0.7811 | 0.8353 | **0.8628** | 5.42% | 8.18% |
|
79 |
| GermanSTSBenchmark | 0.6421 | 0.6568 | **0.6754** | 1.47% | 3.33% |
|
80 |
-
| MassiveIntentClassification | 0.5139 | 0.4884 | 0.4714 | -2.55% | -4.25% |
|
81 |
| MassiveScenarioClassification | 0.6062 | 0.5837 | **0.6111** | -2.25% | 0.49% |
|
82 |
| GermanDPR | 0.6750 | 0.7210 | **0.7507** | 4.60% | 7.57% |
|
83 |
| MTOPDomainClassification | 0.7625 | 0.7450 | **0.7686** | -1.75% | 0.61% |
|
84 |
-
| MTOPIntentClassification | 0.4994 | 0.4516 | 0.4413 | -4.77% | -5.80% |
|
85 |
-
| PawsXPairClassification | 0.5452 | 0.5077 | 0.5162 | -3.76% | -2.90% |
|
86 |
|
87 |
|
88 |
## Usage
|
|
|
70 |
### STS (Semantic Textual Similarity)
|
71 |
- GermanSTSBenchmark
|
72 |
|
73 |
+
| TASK | [UAE](https://huggingface.co/WhereIsAI/UAE-Large-V1/) | [GRAG-UAE](https://huggingface.co/avemio/GRAG-UAE-LARGE-V1-TRIPLES-HESSIAN-AI/) | Merged-UAE | GRAG vs. UAE | Merged vs. UAE |
|
74 |
|-------------------------------------|-------|----------|------------|--------------|----------------|
|
75 |
+
| AmazonCounterfactualClassification | **0.5650** | 0.5449 | 0.5401 | -2.01% | -2.48% |
|
76 |
| AmazonReviewsClassification | 0.2738 | 0.2745 | **0.2782** | 0.08% | 0.44% |
|
77 |
+
| FalseFriendsGermanEnglish | **0.4808** | 0.4777 | 0.4703 | -0.32% | -1.05% |
|
78 |
| GermanQuAD-Retrieval | 0.7811 | 0.8353 | **0.8628** | 5.42% | 8.18% |
|
79 |
| GermanSTSBenchmark | 0.6421 | 0.6568 | **0.6754** | 1.47% | 3.33% |
|
80 |
+
| MassiveIntentClassification | **0.5139** | 0.4884 | 0.4714 | -2.55% | -4.25% |
|
81 |
| MassiveScenarioClassification | 0.6062 | 0.5837 | **0.6111** | -2.25% | 0.49% |
|
82 |
| GermanDPR | 0.6750 | 0.7210 | **0.7507** | 4.60% | 7.57% |
|
83 |
| MTOPDomainClassification | 0.7625 | 0.7450 | **0.7686** | -1.75% | 0.61% |
|
84 |
+
| MTOPIntentClassification | **0.4994** | 0.4516 | 0.4413 | -4.77% | -5.80% |
|
85 |
+
| PawsXPairClassification | **0.5452** | 0.5077 | 0.5162 | -3.76% | -2.90% |
|
86 |
|
87 |
|
88 |
## Usage
|