TroyDoesAI
commited on
Commit
•
0dcbe24
1
Parent(s):
7a960b9
Update README.md
Browse files
README.md
CHANGED
@@ -1,3 +1,9 @@
|
|
1 |
-
---
|
2 |
-
license: cc-by-nd-4.0
|
3 |
-
---
|
|
|
|
|
|
|
|
|
|
|
|
|
|
1 |
+
---
|
2 |
+
license: cc-by-nd-4.0
|
3 |
+
---
|
4 |
+
|
5 |
+
For those trying to shoe horn this large model on your machine every GB of saved memory counts when offloading to System RAM!
|
6 |
+
|
7 |
+
Here is a pruned down the 22.2 Billion parameter model by 4 junk layers to make a 20B that doesnt appear to lose any sense of quality.
|
8 |
+
|
9 |
+
https://huggingface.co/mistralai/Codestral-22B-v0.1
|