Felladrin
/

gguf-Mixnueza-6x32M-MoE

Inference Endpoints

Model card Files Files and versions Community

Felladrin commited on Apr 20

Commit

5d07d21

•

1 Parent(s): 9127270

Update README.md

Files changed (1) hide show

README.md +3 -2

README.md CHANGED Viewed

@@ -16,8 +16,9 @@ brew install ggerganov/ggerganov/llama.cpp
 llama-cli \
   --hf-repo Felladrin/gguf-Mixnueza-6x32M-MoE \
   --model Mixnueza-6x32M-MoE.F32.gguf \
-  --random-prompt  \
-  --dynatemp-range "0.1-2.5" \
   --top-k 0 \
   --top-p 1 \
   --min-p 0.1 \

 llama-cli \
   --hf-repo Felladrin/gguf-Mixnueza-6x32M-MoE \
   --model Mixnueza-6x32M-MoE.F32.gguf \
+  --random-prompt \
+  --temp 1.3 \
+  --dynatemp-range 1.2 \
   --top-k 0 \
   --top-p 1 \
   --min-p 0.1 \