liang.zhao commited on
Commit
4271b8c
1 Parent(s): 4e469e4

update model and config

Browse files
Files changed (1) hide show
  1. README.md +2 -2
README.md CHANGED
@@ -37,7 +37,7 @@ As of September 2024, Skywork-Critic-Llama3.1-70B **ranks first** on RewardBench
37
  | Model | Chat | Chat Hard | Safety | Reasoning | Overall Score |
38
  | ------------------------------- | :---: | :-------: | :----: | :-------: | :---: |
39
  | **Skywork-Critic-Llama3.1-70B** * | **96.9** | **88.4** | **93.2** | **95.4** | **93.4** |
40
- | Salesforce/SFR-LLaMa-3.1-70B-Judge-r | 96.9 | 84.8 | 86.2 | 95.1 | 92.7 |
41
  | Salesforce/SFR-nemo-12B-Judge-r | 97.2 | 82.2 | 86.5 | 95.1 | 90.3 |
42
  | **Skywork-Critic-Llama3.1-8B** * | **93.6** | **81.4** | **91.1** | **89.8** | **89.0** |
43
  | Salesforce/SFR-LLaMa-3.1-8B-Judge-r | 95.5 | 77.7 | 86.2 | 95.1 | 88.7 |
@@ -54,7 +54,7 @@ As of September 2024, Skywork-Critic-Llama3.1-70B **ranks first** on RewardBench
54
  # Demo Code
55
  Below is an example of obtaining the critic of two conversations.
56
 
57
- ```
58
  import torch
59
  from transformers import AutoModelForCausalLM, AutoTokenizer
60
 
 
37
  | Model | Chat | Chat Hard | Safety | Reasoning | Overall Score |
38
  | ------------------------------- | :---: | :-------: | :----: | :-------: | :---: |
39
  | **Skywork-Critic-Llama3.1-70B** * | **96.9** | **88.4** | **93.2** | **95.4** | **93.4** |
40
+ | Salesforce/SFR-LLaMa-3.1-70B-Judge-r | 96.9 | 84.8 | 91.6 | 97.6 | 92.7 |
41
  | Salesforce/SFR-nemo-12B-Judge-r | 97.2 | 82.2 | 86.5 | 95.1 | 90.3 |
42
  | **Skywork-Critic-Llama3.1-8B** * | **93.6** | **81.4** | **91.1** | **89.8** | **89.0** |
43
  | Salesforce/SFR-LLaMa-3.1-8B-Judge-r | 95.5 | 77.7 | 86.2 | 95.1 | 88.7 |
 
54
  # Demo Code
55
  Below is an example of obtaining the critic of two conversations.
56
 
57
+ ```python
58
  import torch
59
  from transformers import AutoModelForCausalLM, AutoTokenizer
60