Update README.md
Browse files
README.md
CHANGED
@@ -1,24 +1,29 @@
|
|
1 |
-
---
|
2 |
-
tags:
|
3 |
-
- quantized
|
4 |
-
- 2-bit
|
5 |
-
- 3-bit
|
6 |
-
- 4-bit
|
7 |
-
- 5-bit
|
8 |
-
- 6-bit
|
9 |
-
- 8-bit
|
10 |
-
- GGUF
|
11 |
-
- phi
|
12 |
-
- phi-3
|
13 |
-
- text-generation
|
14 |
-
model_name: Phi-3-mini-mango-1-GGUF
|
15 |
-
base_model: rhysjones/Phi-3-mini-mango-1
|
16 |
-
inference: false
|
17 |
-
model_creator: rhysjones
|
18 |
-
pipeline_tag: text-generation
|
19 |
-
quantized_by: rhysjones
|
20 |
-
license: mit
|
21 |
-
---
|
22 |
|
23 |
## Description
|
24 |
-
These are GGUF model format files for the [rhysjones/Phi-3-mini-mango-1](https://huggingface.co/rhysjones/Phi-3-mini-mango-1) Phi-3 model.
|
|
|
|
|
|
|
|
|
|
|
|
1 |
+
---
|
2 |
+
tags:
|
3 |
+
- quantized
|
4 |
+
- 2-bit
|
5 |
+
- 3-bit
|
6 |
+
- 4-bit
|
7 |
+
- 5-bit
|
8 |
+
- 6-bit
|
9 |
+
- 8-bit
|
10 |
+
- GGUF
|
11 |
+
- phi
|
12 |
+
- phi-3
|
13 |
+
- text-generation
|
14 |
+
model_name: Phi-3-mini-mango-1-GGUF
|
15 |
+
base_model: rhysjones/Phi-3-mini-mango-1
|
16 |
+
inference: false
|
17 |
+
model_creator: rhysjones
|
18 |
+
pipeline_tag: text-generation
|
19 |
+
quantized_by: rhysjones
|
20 |
+
license: mit
|
21 |
+
---
|
22 |
|
23 |
## Description
|
24 |
+
These are GGUF model format files for the [rhysjones/Phi-3-mini-mango-1](https://huggingface.co/rhysjones/Phi-3-mini-mango-1) Phi-3 4k model.
|
25 |
+
|
26 |
+
## Conversion process
|
27 |
+
|
28 |
+
The usefull conversion script [GGUF-n-Go](https://github.com/thesven/GGUF-n-Go) by [thesven](https://github.com/thesven) was used along with
|
29 |
+
Llama.cpp to generate the different quantized sizes for the model.
|