MoxoffSrL
/

AzzurroQuantized

Text Generation

Inference Endpoints

Model card Files Files and versions Community

JacopoAbate commited on Apr 4, 2024

Commit

af83552

·

verified ·

1 Parent(s): 56d8852

Update README.md

Files changed (1) hide show

README.md +5 -5

README.md CHANGED Viewed

@@ -22,11 +22,11 @@ XXXX is an updated version of Mistral-7B-v0.2, specifically fine-tuned with SFT
 We evaluated the model using the same test sets as used for the Open Ita LLM Leaderboard
-| model version | hellaswag_it acc_norm | arc_it acc_norm | m_mmlu_it 5-shot acc | Average |
-| :------------ |:----------------------| :--------------- | :-------------------- | :------- |
-| base | 0.6067 | 0.4405 | 0.5112 | 0,52 |
-| 4Bit | 0.6067 | 0.4405 | 0.5112 | 0,52 |
-| 8Bit | 0.6067 | 0.4405 | 0.5112 | 0,52 |
 ## Usage

 We evaluated the model using the same test sets as used for the Open Ita LLM Leaderboard
+| hellaswag_it acc_norm | arc_it acc_norm | m_mmlu_it 5-shot acc | Average |
+|:----------------------| :--------------- | :-------------------- | :------- |
+| 0.6067 | 0.4405 | 0.5112 | 0,52 |
+| 0.6067 | 0.4405 | 0.5112 | 0,52 |
+| 0.6067 | 0.4405 | 0.5112 | 0,52 |
 ## Usage