MarsupialAI
commited on
Commit
•
63f8b46
1
Parent(s):
75c7d12
Update README.md
Browse files
README.md
CHANGED
@@ -45,5 +45,5 @@ Prefers alpaca.
|
|
45 |
|
46 |
# Weird merge fuckery
|
47 |
According to Toasty Pigeon, FM, Akai, and probably others on the KAI discord, this merge method works better than a normal stacked merge.
|
48 |
-
I don't pretend to understand why, but the PPL improvement (
|
49 |
-
See recipe.txt for all the alchemy.
|
|
|
45 |
|
46 |
# Weird merge fuckery
|
47 |
According to Toasty Pigeon, FM, Akai, and probably others on the KAI discord, this merge method works better than a normal stacked merge.
|
48 |
+
I don't pretend to understand why, but the massive PPL improvement (5.9 for this model vs 7.65 for the 16b @ Q4km) indicates that they're right.
|
49 |
+
See recipe.txt for all the weird alchemy.
|