Update README.md
Browse files
README.md
CHANGED
|
@@ -15,3 +15,5 @@ Unfortunately, this model doesn't work out of the box ( after dequantize and mer
|
|
| 15 |
|
| 16 |
I'm trying to recover the MLP layers by pretraining, but I'm bit low on compute and doesn't have much to spare. Also if you have small corpus which I can use feel free to comments and suggest what I should do next
|
| 17 |
|
|
|
|
|
|
|
|
|
| 15 |
|
| 16 |
I'm trying to recover the MLP layers by pretraining, but I'm bit low on compute and doesn't have much to spare. Also if you have small corpus which I can use feel free to comments and suggest what I should do next
|
| 17 |
|
| 18 |
+
QLoRA pretrained test run can be found here : [theblackcat102/whale-v3-base-concept-test-lora-380](https://huggingface.co/theblackcat102/whale-v3-base-concept-test-lora-380)
|
| 19 |
+
|