bullerwins
/

DeepSeek-V3-GGUF

Inference Endpoints

Model card Files Files and versions Community

bullerwins commited on 8 days ago

Commit

2484d36

·

verified ·

1 Parent(s): 9d30b4e

Update README.md

Files changed (1) hide show

README.md +4 -2

README.md CHANGED Viewed

@@ -2,8 +2,10 @@
 base_model:
 - deepseek-ai/DeepSeek-V3
 ---
-Preview for the GGUF quantized version of [deepseek-ai/DeepSeek-V3](https://huggingface.co/deepseek-ai/DeepSeek-V3)
 It needs this PR commit to work: https://github.com/ggerganov/llama.cpp/pull/11049
-Thanks to Fairydreaming for the PR!

 base_model:
 - deepseek-ai/DeepSeek-V3
 ---
+Initial preview for the GGUF quantized version of [deepseek-ai/DeepSeek-V3](https://huggingface.co/deepseek-ai/DeepSeek-V3)
 It needs this PR commit to work: https://github.com/ggerganov/llama.cpp/pull/11049
+Thanks to Fairydreaming for the PR!
+Note: no multi-token prediction (MTP) support