andreaskoepf commited on
Commit
87c11e3
1 Parent(s): 9d85f55

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +11 -7
README.md CHANGED
@@ -23,20 +23,22 @@ app before March 7, 2023.
23
  ### Sources
24
 
25
  - **Repository:** [Open-Assistant/model/model_training](https://github.com/LAION-AI/Open-Assistant/tree/main/model/model_training)
26
- - **Demo:** View Assistant replies for 250 random prompts [here](https://open-assistant.github.io/oasst-model-eval/?f=https%3A%2F%2Fraw.githubusercontent.com%2FOpen-Assistant%2Foasst-model-eval%2Fmain%2Fsampling_reports%2Foasst-sft%2F2023-03-09_andreaskoepf_oasst-1_12b_7000_sampling_noprefix_lottery.json) ([sampling code](https://github.com/Open-Assistant/oasst-model-eval/blob/3d71f3be100c05cd8ddb568365e036a29fbff8c7/model_eval/manual/sampling_report.py)).
27
 
28
- ### Reply Generation
29
 
30
  Two special tokens are used to mark the beginning of user and assistant turns:
31
  `<|prompter|>` and `<|assistant|>`. Each turn ends with a `<|endoftext|>` token.
32
 
33
- Input example:
34
  ```
35
- <|prompter|>What is a meme, and what's the history behind this word?
36
- <|endoftext|><|assistant|>
37
  ```
 
 
38
 
39
- Generated continuation:
 
40
  ```
41
  A visual joke often accompanied by text that spreads rapidly from individual
42
  to individual. The exact origin of the term "meme" is unclear, but it was
@@ -56,7 +58,9 @@ fields ranging from anthropology to psychology to marketing.<|endoftext|>
56
 
57
  The model is known to fail horribly at answering math and coding questions.
58
 
59
- Beware of hallucinations: Outputs are often factually wrong or misleading. Replies might look convincing (at first glance) while containing completely made up false statements.
 
 
60
 
61
  This model is usable only for English conversations.
62
 
 
23
  ### Sources
24
 
25
  - **Repository:** [Open-Assistant/model/model_training](https://github.com/LAION-AI/Open-Assistant/tree/main/model/model_training)
26
+ - **Demo:** [Continuations for 250 random prompts](https://open-assistant.github.io/oasst-model-eval/?f=https%3A%2F%2Fraw.githubusercontent.com%2FOpen-Assistant%2Foasst-model-eval%2Fmain%2Fsampling_reports%2Foasst-sft%2F2023-03-09_andreaskoepf_oasst-1_12b_7000_sampling_noprefix_lottery.json) ([sampling code](https://github.com/Open-Assistant/oasst-model-eval/blob/3d71f3be100c05cd8ddb568365e036a29fbff8c7/model_eval/manual/sampling_report.py)).
27
 
28
+ ### Prompting
29
 
30
  Two special tokens are used to mark the beginning of user and assistant turns:
31
  `<|prompter|>` and `<|assistant|>`. Each turn ends with a `<|endoftext|>` token.
32
 
33
+ Input prompt example:
34
  ```
35
+ <|prompter|>What is a meme, and what's the history behind this word?<|endoftext|><|assistant|>
 
36
  ```
37
+ The input ends with the `<|assistant|>` token to signal that the model should
38
+ start generating the assistant reply.
39
 
40
+
41
+ Example of generated continuation (typical sampling 0.2):
42
  ```
43
  A visual joke often accompanied by text that spreads rapidly from individual
44
  to individual. The exact origin of the term "meme" is unclear, but it was
 
58
 
59
  The model is known to fail horribly at answering math and coding questions.
60
 
61
+ Beware of hallucinations: Outputs are often factually wrong or misleading.
62
+ Replies might look convincing (at first glance) while containing completely
63
+ made up false statements.
64
 
65
  This model is usable only for English conversations.
66