Update README.md
Browse files
README.md
CHANGED
|
@@ -139,6 +139,10 @@ Evaluation:
|
|
| 139 |
|
| 140 |
|
| 141 |
|
|
|
|
|
|
|
|
|
|
|
|
|
| 142 |
Unlike previous models we've uploaded, this one is the best one we've published! Answers in two steps: Reasoning -> Final answer like o1 mini and other similar reasoning ai models.
|
| 143 |
# 🧀 Which quant is right for you? (all tested!)
|
| 144 |
- ***Q3:*** This quant should be used on most high-end devices like rtx 2080TI's, Responses are very high quality, but its slightly slower than Q4. (Runs at ~1 tokens per second or less on a Samsung z fold 5 smartphone.)
|
|
|
|
| 139 |
|
| 140 |
|
| 141 |
|
| 142 |
+
|
| 143 |
+
|
| 144 |
+
|
| 145 |
+
|
| 146 |
Unlike previous models we've uploaded, this one is the best one we've published! Answers in two steps: Reasoning -> Final answer like o1 mini and other similar reasoning ai models.
|
| 147 |
# 🧀 Which quant is right for you? (all tested!)
|
| 148 |
- ***Q3:*** This quant should be used on most high-end devices like rtx 2080TI's, Responses are very high quality, but its slightly slower than Q4. (Runs at ~1 tokens per second or less on a Samsung z fold 5 smartphone.)
|