yongzx
/

pythia-410m-sft-hh

Text Generation

text-generation-inference

Inference Endpoints

Model card Files Files and versions Community

usvsnsp commited on Aug 23, 2023

Commit

48fe0da

•

1 Parent(s): 0eeb6f4

Add Lambada OpenAI to evals

Files changed (1) hide show

README.md +3 -1

README.md CHANGED Viewed

@@ -13,4 +13,6 @@ Model Evals:
 |             |       |none  |acc_norm|0.6823|±  |0.0109|
 |sciq         |Yaml   |none  |acc     |0.8050|±  |0.0125|
 |             |       |none  |acc_norm|0.7080|±  |0.0144|
-|winogrande   |Yaml   |none  |acc     |0.5335|±  |0.0140|

 |             |       |none  |acc_norm|0.6823|±  |0.0109|
 |sciq         |Yaml   |none  |acc     |0.8050|±  |0.0125|
 |             |       |none  |acc_norm|0.7080|±  |0.0144|
+|winogrande   |Yaml   |none  |acc     |0.5335|±  |0.0140|
+|lambada_openai|Yaml   |none  |perplexity|9.8265|±  |0.3139|
+|              |       |none  |acc       |0.5135|±  |0.0070|