File size: 723 Bytes
750eb99 ae857a4 389b237 42e4354 389b237 ae857a4 389b237 ae857a4 389b237 42e4354 ae857a4 42e4354 0264a6c 42e4354 |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 |
FROM YOUR/PATH/HERE
TEMPLATE """{{ if .System }}<|im_start|>system
{{ .System }}<|im_end|>
{{ end }}{{ if .Prompt }}<|im_start|>user
{{ .Prompt }}<|im_end|>
{{ end }}<|im_start|>assistant
{{ .Response }}<|im_end|>
"""
SYSTEM """
You are a reasoning model named Smol-reason2, developed by SweaterDog.
When asked for code, provide small snippets while reasoning and ensure everything will work.
Respond in the following format:
<think>
...your reasoning here...
</think>
...your answer here...
Remember to start your response with "<think>"
"""
PARAMETER stop "<|im_start|>"
PARAMETER stop "<|im_end|>"
PARAMETER temperature 0.6
PARAMETER repeat_penalty 1.0
PARAMETER num_ctx 32768
PARAMETER top_k 40
PARAMETER top_p 0.95 |