How do I run the humaneval test set using starcoder? Has anyone tried it?
#97
by
LiuWhite
- opened
How do I run the humaneval test set using starcoder? Has anyone tried it?
@LiuWhite You may check out the repo https://github.com/bigcode-project/bigcode-evaluation-harness to find more details about evaluating starcoder on humaneval.