andreaskoepf
commited on
Commit
•
1e3f39a
1
Parent(s):
87c11e3
Update README.md
Browse files
README.md
CHANGED
@@ -12,20 +12,18 @@ of assistant conversations collected through the
|
|
12 |
[https://open-assistant.io/](https://open-assistant.io/) human feedback web
|
13 |
app before March 7, 2023.
|
14 |
|
15 |
-
|
16 |
|
17 |
-
- **Developed by:** Open-Assistant Contributors
|
18 |
-
- **Model type:**
|
19 |
- **Language:** English
|
20 |
-
- **License:** Apache 2.0
|
21 |
- **Finetuned from:** [EleutherAI / pythia-12b-deduped](https://huggingface.co/EleutherAI/pythia-12b-deduped)
|
22 |
-
|
23 |
-
### Sources
|
24 |
-
|
25 |
-
- **Repository:** [Open-Assistant/model/model_training](https://github.com/LAION-AI/Open-Assistant/tree/main/model/model_training)
|
26 |
- **Demo:** [Continuations for 250 random prompts](https://open-assistant.github.io/oasst-model-eval/?f=https%3A%2F%2Fraw.githubusercontent.com%2FOpen-Assistant%2Foasst-model-eval%2Fmain%2Fsampling_reports%2Foasst-sft%2F2023-03-09_andreaskoepf_oasst-1_12b_7000_sampling_noprefix_lottery.json) ([sampling code](https://github.com/Open-Assistant/oasst-model-eval/blob/3d71f3be100c05cd8ddb568365e036a29fbff8c7/model_eval/manual/sampling_report.py)).
|
|
|
|
|
27 |
|
28 |
-
|
29 |
|
30 |
Two special tokens are used to mark the beginning of user and assistant turns:
|
31 |
`<|prompter|>` and `<|assistant|>`. Each turn ends with a `<|endoftext|>` token.
|
@@ -56,15 +54,12 @@ fields ranging from anthropology to psychology to marketing.<|endoftext|>
|
|
56 |
|
57 |
## Limitations
|
58 |
|
|
|
|
|
59 |
The model is known to fail horribly at answering math and coding questions.
|
60 |
|
61 |
Beware of hallucinations: Outputs are often factually wrong or misleading.
|
62 |
Replies might look convincing (at first glance) while containing completely
|
63 |
made up false statements.
|
64 |
|
65 |
-
This model is usable only for English conversations.
|
66 |
-
|
67 |
-
## Contact the Authors
|
68 |
-
|
69 |
-
- Github: [LAION-AI / Open-Assistant](https://github.com/LAION-AI/Open-Assistant)
|
70 |
-
- Discord: [Open-Assistant](https://ykilcher.com/open-assistant-discord)
|
|
|
12 |
[https://open-assistant.io/](https://open-assistant.io/) human feedback web
|
13 |
app before March 7, 2023.
|
14 |
|
15 |
+
## Model Details
|
16 |
|
17 |
+
- **Developed by:** [Open-Assistant Contributors](https://open-assistant.io/)
|
18 |
+
- **Model type:** Transformer-based Language Model
|
19 |
- **Language:** English
|
|
|
20 |
- **Finetuned from:** [EleutherAI / pythia-12b-deduped](https://huggingface.co/EleutherAI/pythia-12b-deduped)
|
21 |
+
- **Code:** [Open-Assistant/model/model_training](https://github.com/LAION-AI/Open-Assistant/tree/main/model/model_training)
|
|
|
|
|
|
|
22 |
- **Demo:** [Continuations for 250 random prompts](https://open-assistant.github.io/oasst-model-eval/?f=https%3A%2F%2Fraw.githubusercontent.com%2FOpen-Assistant%2Foasst-model-eval%2Fmain%2Fsampling_reports%2Foasst-sft%2F2023-03-09_andreaskoepf_oasst-1_12b_7000_sampling_noprefix_lottery.json) ([sampling code](https://github.com/Open-Assistant/oasst-model-eval/blob/3d71f3be100c05cd8ddb568365e036a29fbff8c7/model_eval/manual/sampling_report.py)).
|
23 |
+
- **License:** Apache 2.0
|
24 |
+
- **Contact:** [Open-Assistant Discord](https://ykilcher.com/open-assistant-discord)
|
25 |
|
26 |
+
## Prompting
|
27 |
|
28 |
Two special tokens are used to mark the beginning of user and assistant turns:
|
29 |
`<|prompter|>` and `<|assistant|>`. Each turn ends with a `<|endoftext|>` token.
|
|
|
54 |
|
55 |
## Limitations
|
56 |
|
57 |
+
See limitations of Pythia 12B base model [here](https://huggingface.co/EleutherAI/pythia-12b-deduped#limitations-and-biases).
|
58 |
+
|
59 |
The model is known to fail horribly at answering math and coding questions.
|
60 |
|
61 |
Beware of hallucinations: Outputs are often factually wrong or misleading.
|
62 |
Replies might look convincing (at first glance) while containing completely
|
63 |
made up false statements.
|
64 |
|
65 |
+
This model is usable only for English conversations.
|
|
|
|
|
|
|
|
|
|