mradermacher
/

megatron_1.1_MoE_2x7B-GGUF

Inference Endpoints

Model card Files Files and versions Community

mradermacher commited on Dec 9, 2024

Commit

f6bd1d5

·

verified ·

1 Parent(s): 5d60b0f

auto-patch README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -21,7 +21,7 @@ tags:
 static quants of https://huggingface.co/Eurdem/megatron_1.1_MoE_2x7B
 <!-- provided-files -->
-weighted/imatrix quants seem not to be available (by me) at this time. If they do not show up a week or so after the static ones, I have probably not planned for them. Feel free to request them by opening a Community Discussion.
 ## Usage
 If you are unsure how to use GGUF files, refer to one of [TheBloke's

 static quants of https://huggingface.co/Eurdem/megatron_1.1_MoE_2x7B
 <!-- provided-files -->
+weighted/imatrix quants are available at https://huggingface.co/mradermacher/megatron_1.1_MoE_2x7B-i1-GGUF
 ## Usage
 If you are unsure how to use GGUF files, refer to one of [TheBloke's