OpenLLM-Ro
/

RoLlama2-7b-Instruct-2024-05-14

Text Generation

text-generation-inference

Inference Endpoints

Model card Files Files and versions Community

mihaimasala commited on Jun 27, 2024

Commit

42f343b

·

verified ·

1 Parent(s): 0a5760a

Update README.md

Files changed (1) hide show

README.md +11 -3

README.md CHANGED Viewed

@@ -84,10 +84,18 @@ print(tokenizer.decode(outputs[0]))
 ## MT-Bench
-| Model              | Average  | 1st turn      | 2nd turn     |
 |--------------------|:--------:|:--------:|:--------:|
-| Llama-2-7b-chat    | 1.21    | 1.68    | 0.74    |
-|*RoLlama2-7b-Instruct*| ***3.70***|***4.74***| *2.66* |
 |RoLlama2-7b-Chat    | TBC    | TBC    | TBC    |

 ## MT-Bench
+| Model              | Average  | 1st turn      | 2nd turn     | Answers in Ro |
 |--------------------|:--------:|:--------:|:--------:|
+| Llama-2-7b-chat    | 1.21    | 1.68    | 0.74    | 44 / 160 |
+|*RoLlama2-7b-Instruct*| ***3.70***|***4.74***| ***2.66*** | ***160 / 160*** |
+|RoLlama2-7b-Chat    | TBC    | TBC    | TBC    | TBC |
+## RoCulturaBench
+| Model              | Score  | Answers in Ro|
+|--------------------|:--------:|:--------:|
+| Llama-2-7b-chat    | 1.72    | 48 / 100   |
+|*RoLlama2-7b-Instruct*| ***3.43***| ***160 / 160*** |
 |RoLlama2-7b-Chat    | TBC    | TBC    | TBC    |