MarsupialAI commited on
Commit
63f8b46
1 Parent(s): 75c7d12

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +2 -2
README.md CHANGED
@@ -45,5 +45,5 @@ Prefers alpaca.
45
 
46
  # Weird merge fuckery
47
  According to Toasty Pigeon, FM, Akai, and probably others on the KAI discord, this merge method works better than a normal stacked merge.
48
- I don't pretend to understand why, but the PPL improvement (7.2 for this model vs 7.65 for the 16b @ Q4km) indicates that they're right.
49
- See recipe.txt for all the alchemy.
 
45
 
46
  # Weird merge fuckery
47
  According to Toasty Pigeon, FM, Akai, and probably others on the KAI discord, this merge method works better than a normal stacked merge.
48
+ I don't pretend to understand why, but the massive PPL improvement (5.9 for this model vs 7.65 for the 16b @ Q4km) indicates that they're right.
49
+ See recipe.txt for all the weird alchemy.