liang.zhao
commited on
Commit
•
4271b8c
1
Parent(s):
4e469e4
update model and config
Browse files
README.md
CHANGED
@@ -37,7 +37,7 @@ As of September 2024, Skywork-Critic-Llama3.1-70B **ranks first** on RewardBench
|
|
37 |
| Model | Chat | Chat Hard | Safety | Reasoning | Overall Score |
|
38 |
| ------------------------------- | :---: | :-------: | :----: | :-------: | :---: |
|
39 |
| **Skywork-Critic-Llama3.1-70B** * | **96.9** | **88.4** | **93.2** | **95.4** | **93.4** |
|
40 |
-
| Salesforce/SFR-LLaMa-3.1-70B-Judge-r | 96.9 | 84.8 |
|
41 |
| Salesforce/SFR-nemo-12B-Judge-r | 97.2 | 82.2 | 86.5 | 95.1 | 90.3 |
|
42 |
| **Skywork-Critic-Llama3.1-8B** * | **93.6** | **81.4** | **91.1** | **89.8** | **89.0** |
|
43 |
| Salesforce/SFR-LLaMa-3.1-8B-Judge-r | 95.5 | 77.7 | 86.2 | 95.1 | 88.7 |
|
@@ -54,7 +54,7 @@ As of September 2024, Skywork-Critic-Llama3.1-70B **ranks first** on RewardBench
|
|
54 |
# Demo Code
|
55 |
Below is an example of obtaining the critic of two conversations.
|
56 |
|
57 |
-
```
|
58 |
import torch
|
59 |
from transformers import AutoModelForCausalLM, AutoTokenizer
|
60 |
|
|
|
37 |
| Model | Chat | Chat Hard | Safety | Reasoning | Overall Score |
|
38 |
| ------------------------------- | :---: | :-------: | :----: | :-------: | :---: |
|
39 |
| **Skywork-Critic-Llama3.1-70B** * | **96.9** | **88.4** | **93.2** | **95.4** | **93.4** |
|
40 |
+
| Salesforce/SFR-LLaMa-3.1-70B-Judge-r | 96.9 | 84.8 | 91.6 | 97.6 | 92.7 |
|
41 |
| Salesforce/SFR-nemo-12B-Judge-r | 97.2 | 82.2 | 86.5 | 95.1 | 90.3 |
|
42 |
| **Skywork-Critic-Llama3.1-8B** * | **93.6** | **81.4** | **91.1** | **89.8** | **89.0** |
|
43 |
| Salesforce/SFR-LLaMa-3.1-8B-Judge-r | 95.5 | 77.7 | 86.2 | 95.1 | 88.7 |
|
|
|
54 |
# Demo Code
|
55 |
Below is an example of obtaining the critic of two conversations.
|
56 |
|
57 |
+
```python
|
58 |
import torch
|
59 |
from transformers import AutoModelForCausalLM, AutoTokenizer
|
60 |
|