rhysjones commited on
Commit
8e4e910
·
verified ·
1 Parent(s): e44856a

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +27 -22
README.md CHANGED
@@ -1,24 +1,29 @@
1
- ---
2
- tags:
3
- - quantized
4
- - 2-bit
5
- - 3-bit
6
- - 4-bit
7
- - 5-bit
8
- - 6-bit
9
- - 8-bit
10
- - GGUF
11
- - phi
12
- - phi-3
13
- - text-generation
14
- model_name: Phi-3-mini-mango-1-GGUF
15
- base_model: rhysjones/Phi-3-mini-mango-1
16
- inference: false
17
- model_creator: rhysjones
18
- pipeline_tag: text-generation
19
- quantized_by: rhysjones
20
- license: mit
21
- ---
22
 
23
  ## Description
24
- These are GGUF model format files for the [rhysjones/Phi-3-mini-mango-1](https://huggingface.co/rhysjones/Phi-3-mini-mango-1) Phi-3 model.
 
 
 
 
 
 
1
+ ---
2
+ tags:
3
+ - quantized
4
+ - 2-bit
5
+ - 3-bit
6
+ - 4-bit
7
+ - 5-bit
8
+ - 6-bit
9
+ - 8-bit
10
+ - GGUF
11
+ - phi
12
+ - phi-3
13
+ - text-generation
14
+ model_name: Phi-3-mini-mango-1-GGUF
15
+ base_model: rhysjones/Phi-3-mini-mango-1
16
+ inference: false
17
+ model_creator: rhysjones
18
+ pipeline_tag: text-generation
19
+ quantized_by: rhysjones
20
+ license: mit
21
+ ---
22
 
23
  ## Description
24
+ These are GGUF model format files for the [rhysjones/Phi-3-mini-mango-1](https://huggingface.co/rhysjones/Phi-3-mini-mango-1) Phi-3 4k model.
25
+
26
+ ## Conversion process
27
+
28
+ The usefull conversion script [GGUF-n-Go](https://github.com/thesven/GGUF-n-Go) by [thesven](https://github.com/thesven) was used along with
29
+ Llama.cpp to generate the different quantized sizes for the model.