Update README.md
Browse files
README.md
CHANGED
|
@@ -126,6 +126,11 @@ Phasmid-2 has been trained on intructional data and thus can perform far better
|
|
| 126 |
This model is little more than a side project and I shall treat it as such.
|
| 127 |
Phasmid-2 (due to it's size), can still suffer from problematic hallucinations and poor information. No effort was made to reduce potentially toxic responses, as such you should train this model further if you require it to do so.
|
| 128 |
## Inference
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 129 |
Phi doesn't like device_map = auto, therefore you should specify as like the following:
|
| 130 |
|
| 131 |
1. FP16 / Flash-Attention / CUDA:
|
|
|
|
| 126 |
This model is little more than a side project and I shall treat it as such.
|
| 127 |
Phasmid-2 (due to it's size), can still suffer from problematic hallucinations and poor information. No effort was made to reduce potentially toxic responses, as such you should train this model further if you require it to do so.
|
| 128 |
## Inference
|
| 129 |
+
Ensure that eniops is installed
|
| 130 |
+
```
|
| 131 |
+
pip install einops
|
| 132 |
+
```
|
| 133 |
+
|
| 134 |
Phi doesn't like device_map = auto, therefore you should specify as like the following:
|
| 135 |
|
| 136 |
1. FP16 / Flash-Attention / CUDA:
|