andreaskoepf commited on
Commit
1e3f39a
1 Parent(s): 87c11e3

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +10 -15
README.md CHANGED
@@ -12,20 +12,18 @@ of assistant conversations collected through the
12
  [https://open-assistant.io/](https://open-assistant.io/) human feedback web
13
  app before March 7, 2023.
14
 
15
- ### Model Description
16
 
17
- - **Developed by:** Open-Assistant Contributors
18
- - **Model type:** Conversational
19
  - **Language:** English
20
- - **License:** Apache 2.0
21
  - **Finetuned from:** [EleutherAI / pythia-12b-deduped](https://huggingface.co/EleutherAI/pythia-12b-deduped)
22
-
23
- ### Sources
24
-
25
- - **Repository:** [Open-Assistant/model/model_training](https://github.com/LAION-AI/Open-Assistant/tree/main/model/model_training)
26
  - **Demo:** [Continuations for 250 random prompts](https://open-assistant.github.io/oasst-model-eval/?f=https%3A%2F%2Fraw.githubusercontent.com%2FOpen-Assistant%2Foasst-model-eval%2Fmain%2Fsampling_reports%2Foasst-sft%2F2023-03-09_andreaskoepf_oasst-1_12b_7000_sampling_noprefix_lottery.json) ([sampling code](https://github.com/Open-Assistant/oasst-model-eval/blob/3d71f3be100c05cd8ddb568365e036a29fbff8c7/model_eval/manual/sampling_report.py)).
 
 
27
 
28
- ### Prompting
29
 
30
  Two special tokens are used to mark the beginning of user and assistant turns:
31
  `<|prompter|>` and `<|assistant|>`. Each turn ends with a `<|endoftext|>` token.
@@ -56,15 +54,12 @@ fields ranging from anthropology to psychology to marketing.<|endoftext|>
56
 
57
  ## Limitations
58
 
 
 
59
  The model is known to fail horribly at answering math and coding questions.
60
 
61
  Beware of hallucinations: Outputs are often factually wrong or misleading.
62
  Replies might look convincing (at first glance) while containing completely
63
  made up false statements.
64
 
65
- This model is usable only for English conversations.
66
-
67
- ## Contact the Authors
68
-
69
- - Github: [LAION-AI / Open-Assistant](https://github.com/LAION-AI/Open-Assistant)
70
- - Discord: [Open-Assistant](https://ykilcher.com/open-assistant-discord)
 
12
  [https://open-assistant.io/](https://open-assistant.io/) human feedback web
13
  app before March 7, 2023.
14
 
15
+ ## Model Details
16
 
17
+ - **Developed by:** [Open-Assistant Contributors](https://open-assistant.io/)
18
+ - **Model type:** Transformer-based Language Model
19
  - **Language:** English
 
20
  - **Finetuned from:** [EleutherAI / pythia-12b-deduped](https://huggingface.co/EleutherAI/pythia-12b-deduped)
21
+ - **Code:** [Open-Assistant/model/model_training](https://github.com/LAION-AI/Open-Assistant/tree/main/model/model_training)
 
 
 
22
  - **Demo:** [Continuations for 250 random prompts](https://open-assistant.github.io/oasst-model-eval/?f=https%3A%2F%2Fraw.githubusercontent.com%2FOpen-Assistant%2Foasst-model-eval%2Fmain%2Fsampling_reports%2Foasst-sft%2F2023-03-09_andreaskoepf_oasst-1_12b_7000_sampling_noprefix_lottery.json) ([sampling code](https://github.com/Open-Assistant/oasst-model-eval/blob/3d71f3be100c05cd8ddb568365e036a29fbff8c7/model_eval/manual/sampling_report.py)).
23
+ - **License:** Apache 2.0
24
+ - **Contact:** [Open-Assistant Discord](https://ykilcher.com/open-assistant-discord)
25
 
26
+ ## Prompting
27
 
28
  Two special tokens are used to mark the beginning of user and assistant turns:
29
  `<|prompter|>` and `<|assistant|>`. Each turn ends with a `<|endoftext|>` token.
 
54
 
55
  ## Limitations
56
 
57
+ See limitations of Pythia 12B base model [here](https://huggingface.co/EleutherAI/pythia-12b-deduped#limitations-and-biases).
58
+
59
  The model is known to fail horribly at answering math and coding questions.
60
 
61
  Beware of hallucinations: Outputs are often factually wrong or misleading.
62
  Replies might look convincing (at first glance) while containing completely
63
  made up false statements.
64
 
65
+ This model is usable only for English conversations.