avemio-digital commited on
Commit
197d7a1
·
verified ·
1 Parent(s): f39176c

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +6 -6
README.md CHANGED
@@ -70,19 +70,19 @@ SentenceTransformer(
70
  ### STS (Semantic Textual Similarity)
71
  - GermanSTSBenchmark
72
 
73
- | TASK | UAE | [GRAG-UAE](https://huggingface.co/avemio/GRAG-UAE-LARGE-V1-TRIPLES-HESSIAN-AI/) | Merged-UAE | GRAG vs. UAE | Merged vs. UAE |
74
  |-------------------------------------|-------|----------|------------|--------------|----------------|
75
- | AmazonCounterfactualClassification | 0.5650 | 0.5449 | 0.5401 | -2.01% | -2.48% |
76
  | AmazonReviewsClassification | 0.2738 | 0.2745 | **0.2782** | 0.08% | 0.44% |
77
- | FalseFriendsGermanEnglish | 0.4808 | 0.4777 | 0.4703 | -0.32% | -1.05% |
78
  | GermanQuAD-Retrieval | 0.7811 | 0.8353 | **0.8628** | 5.42% | 8.18% |
79
  | GermanSTSBenchmark | 0.6421 | 0.6568 | **0.6754** | 1.47% | 3.33% |
80
- | MassiveIntentClassification | 0.5139 | 0.4884 | 0.4714 | -2.55% | -4.25% |
81
  | MassiveScenarioClassification | 0.6062 | 0.5837 | **0.6111** | -2.25% | 0.49% |
82
  | GermanDPR | 0.6750 | 0.7210 | **0.7507** | 4.60% | 7.57% |
83
  | MTOPDomainClassification | 0.7625 | 0.7450 | **0.7686** | -1.75% | 0.61% |
84
- | MTOPIntentClassification | 0.4994 | 0.4516 | 0.4413 | -4.77% | -5.80% |
85
- | PawsXPairClassification | 0.5452 | 0.5077 | 0.5162 | -3.76% | -2.90% |
86
 
87
 
88
  ## Usage
 
70
  ### STS (Semantic Textual Similarity)
71
  - GermanSTSBenchmark
72
 
73
+ | TASK | [UAE](https://huggingface.co/WhereIsAI/UAE-Large-V1/) | [GRAG-UAE](https://huggingface.co/avemio/GRAG-UAE-LARGE-V1-TRIPLES-HESSIAN-AI/) | Merged-UAE | GRAG vs. UAE | Merged vs. UAE |
74
  |-------------------------------------|-------|----------|------------|--------------|----------------|
75
+ | AmazonCounterfactualClassification | **0.5650** | 0.5449 | 0.5401 | -2.01% | -2.48% |
76
  | AmazonReviewsClassification | 0.2738 | 0.2745 | **0.2782** | 0.08% | 0.44% |
77
+ | FalseFriendsGermanEnglish | **0.4808** | 0.4777 | 0.4703 | -0.32% | -1.05% |
78
  | GermanQuAD-Retrieval | 0.7811 | 0.8353 | **0.8628** | 5.42% | 8.18% |
79
  | GermanSTSBenchmark | 0.6421 | 0.6568 | **0.6754** | 1.47% | 3.33% |
80
+ | MassiveIntentClassification | **0.5139** | 0.4884 | 0.4714 | -2.55% | -4.25% |
81
  | MassiveScenarioClassification | 0.6062 | 0.5837 | **0.6111** | -2.25% | 0.49% |
82
  | GermanDPR | 0.6750 | 0.7210 | **0.7507** | 4.60% | 7.57% |
83
  | MTOPDomainClassification | 0.7625 | 0.7450 | **0.7686** | -1.75% | 0.61% |
84
+ | MTOPIntentClassification | **0.4994** | 0.4516 | 0.4413 | -4.77% | -5.80% |
85
+ | PawsXPairClassification | **0.5452** | 0.5077 | 0.5162 | -3.76% | -2.90% |
86
 
87
 
88
  ## Usage