temperature 0.2: {'pass@1': 0.027439024390243896, 'pass@10': 0.041979293327556816, 'pass@100': 0.04268292682926801} | |
temperature 0.8: {'pass@1': 0.013262195121951224, 'pass@10': 0.04670902438514701, 'pass@100': 0.0899080946922357} | |
best: {'pass@1': 2.74% , 'pass@10': 4.67 , 'pass@100': 8.99%} |