usvsnsp/pythia-70m-ppo

Wandb Run: https://wandb.ai/eleutherai/pythia-rlhf/runs/gy2g8jj1

Model Evals:

Tasks	Version	Filter	Metric	Value		Stderr
arc_challenge	Yaml	none	acc	0.2253	±	0.0122
		none	acc_norm	0.2278	±	0.0123
arc_easy	Yaml	none	acc	0.2551	±	0.0089
		none	acc_norm	0.2567	±	0.0090
lambada_openai	Yaml	none	perplexity	NaN	±	NaN
		none	acc	0.0016	±	0.0005
logiqa	Yaml	none	acc	0.2028	±	0.0158
		none	acc_norm	0.2028	±	0.0158
piqa	Yaml	none	acc	0.4946	±	0.0117
		none	acc_norm	0.4924	±	0.0117
sciq	Yaml	none	acc	0.0140	±	0.0037
		none	acc_norm	0.0140	±	0.0037
winogrande	Yaml	none	acc	0.5036	±	0.0141
wsc	Yaml	none	acc	0.6346	±	0.0474