maldv commited on
Commit
070ee88
1 Parent(s): e19187e

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +1 -1
README.md CHANGED
@@ -7,7 +7,7 @@ license: cc-by-nc-4.0
7
 
8
  # Badger Mushroom 4x8b
9
 
10
- I've been really impressed with how well these frankenmoe models quant compared to the base llama 8b, but with far better speed than the 70b. 8x8b seemed a bit unneccessary for how much additonal value it brougt, so I dialed it back to a 4x4b version. This model feels pretty good out of the gate, which considering how I used a non-standard merge; is a bit surprising.
11
 
12
  ```
13
  base_model: ./maldv/badger
 
7
 
8
  # Badger Mushroom 4x8b
9
 
10
+ I've been really impressed with how well these frankenmoe models quant compared to the base llama 8b, but with far better speed than the 70b. 8x8b seemed a bit unneccessary for how much additonal value it brougt, so I dialed it back to a 4x8b version. This model feels pretty good out of the gate, which considering how I used a non-standard merge; is a bit surprising.
11
 
12
  ```
13
  base_model: ./maldv/badger