DavidAU
/

Llama-3.2-8X3B-MOE-Dark-Champion-Instruct-uncensored-abliterated-18.4B-GGUF

Model card Files Files and versions Community

DavidAU commited on 7 days ago

Commit

dac5587

•

1 Parent(s): ef5d72b

Update README.md

Files changed (1) hide show

README.md +3 -0

README.md CHANGED Viewed

@@ -116,6 +116,9 @@ You can set the number of experts in LMStudio (https://lmstudio.ai) at the "load
 For Text-Generation-Webui (https://github.com/oobabooga/text-generation-webui)  you set the number of experts at the loading screen page.
 For server.exe / Llama-server.exe (Llamacpp - https://github.com/ggerganov/llama.cpp/blob/master/examples/server/README.md )
 add the following to the command line to start the "llamacpp server" (CLI):

 For Text-Generation-Webui (https://github.com/oobabooga/text-generation-webui)  you set the number of experts at the loading screen page.
+For KolboldCPP (https://github.com/LostRuins/koboldcpp) Version 1.8+ , on the load screen, click on "TOKENS",
+you can set experts on this page, and the launch the model.
 For server.exe / Llama-server.exe (Llamacpp - https://github.com/ggerganov/llama.cpp/blob/master/examples/server/README.md )
 add the following to the command line to start the "llamacpp server" (CLI):