Duplicated from abhishekmamdapure/llama-cpp-python
699163a
1
2
3
4
5
6
7
do_sample=True top_p=0.18 top_k=30 temperature=2.0 repetition_penalty=1.15 typical_p=1.0