Update README.md
Browse files
README.md
CHANGED
|
@@ -12,4 +12,19 @@ facebook/opt-2.7b finetuned with prefix tuning (https://arxiv.org/abs/2101.00190
|
|
| 12 |
|
| 13 |
24 token prefix finetuned over 3.7m new tokens of a FLAN task mixture.
|
| 14 |
|
| 15 |
-
It reaches a train ppl of 5.95 and an eval ppl of 4.50
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 12 |
|
| 13 |
24 token prefix finetuned over 3.7m new tokens of a FLAN task mixture.
|
| 14 |
|
| 15 |
+
It reaches a train ppl of 5.95 and an eval ppl of 4.50
|
| 16 |
+
|
| 17 |
+
### Example COT (Chain-of-thought) Prompt:
|
| 18 |
+
|
| 19 |
+
```
|
| 20 |
+
Q: Answer the following yes/no question by reasoning step-by-step. Could a dandelion suffer from hepatitis?
|
| 21 |
+
A: Hepatitis only affects organisms with livers. Dandelions don’t have a liver. The answer is no.
|
| 22 |
+
|
| 23 |
+
Q: Answer the following yes/no question by reasoning step-by-step. Can you write a whole Haiku in a single tweet?
|
| 24 |
+
A: A haiku is a japanese three-line poem. That is short enough to fit in 280 characters. The answer is yes.
|
| 25 |
+
|
| 26 |
+
Q: Answer the following yes/no question by reasoning step-by-step. Can you reach space with a Cessna?
|
| 27 |
+
A:
|
| 28 |
+
```
|
| 29 |
+
<p style='color:green'> > Cessna is a type of aircraft. It has a wingspan of 3.6 meters (3.6m). The answer is no.</p>
|
| 30 |
+
|