File size: 861 Bytes
911aadb
 
99b589f
 
911aadb
a2bc088
99b589f
a2bc088
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
---
license: llama2
datasets:
- OpenAssistant/oasst1
---
- wandb: [public-sft/runs/run32_oasst1_13b](https://wandb.ai/open-assistant/public-sft/runs/run32_oasst1_13b)
- [sampling report](https://open-assistant.github.io/oasst-model-eval/?f=https%3A%2F%2Fraw.githubusercontent.com%2FOpen-Assistant%2Foasst-model-eval%2Fmain%2Fsampling_reports%2Foasst-pretrained%2F2023-08-14_andreaskoepf_llama2-13b-oasst-baseline_sampling_noprefix2.json)

### Prompt template

[chatml](https://github.com/openai/openai-python/blob/main/chatml.md) format is used:
"<|im_start|>system\n{system message}<|im_end|>\n<|im_start|>user\n{user prompt}<|im_end|>\n<|im_start|>assistant\n{Assistant answer}<|im_end|>\n" 

multi-line:

```
"""
<|im_start|>system
{system message}<|im_end|>
<|im_start|>user
{user prompt}<|im_end|>
<|im_start|>assistant
{Assistant answer}<|im_end|>
"""
```