jsfs11
/

MixtureofMerges-MoE-4x7b-v10-mixtralv0.3-GGUF

Mixture of Experts

mistralai/Mistral-7B-Instruct-v0.3

Kukedlc/NeuralSynthesis-7B-v0.1

mlabonne/AlphaMonarch-7B

s3nh/SeverusWestLake-7B-DPO

Inference Endpoints

Model card Files Files and versions Community

jsfs11 commited on May 28

Commit

3a9b685

•

1 Parent(s): 6861cde

Update README.md

Files changed (1) hide show

README.md +2 -2

README.md CHANGED Viewed

@@ -30,11 +30,11 @@ brew install ggerganov/ggerganov/llama.cpp
 Invoke the llama.cpp server or the CLI.
 CLI:
 ```bash
-llama-cli --hf-repo jsfs11/MixtureofMerges-MoE-4x7b-v10-mixtralv0.3-Q4_K_M-GGUF --model mixtureofmerges-moe-4x7b-v10-mixtralv0.3-q4_k_m.gguf -p "The meaning to life and the universe is"
 ```
 Server:
 ```bash
-llama-server --hf-repo jsfs11/MixtureofMerges-MoE-4x7b-v10-mixtralv0.3-Q4_K_M-GGUF --model mixtureofmerges-moe-4x7b-v10-mixtralv0.3-q4_k_m.gguf -c 2048
 ```
 Note: You can also use this checkpoint directly through the [usage steps](https://github.com/ggerganov/llama.cpp?tab=readme-ov-file#usage) listed in the Llama.cpp repo as well.
 ```

 Invoke the llama.cpp server or the CLI.
 CLI:
 ```bash
+llama-cli --hf-repo jsfs11/MixtureofMerges-MoE-4x7b-v10-mixtralv0.3-GGUF --model mixtureofmerges-moe-4x7b-v10-mixtralv0.3-q4_k_m.gguf -p "The meaning to life and the universe is"
 ```
 Server:
 ```bash
+llama-server --hf-repo jsfs11/MixtureofMerges-MoE-4x7b-v10-mixtralv0.3-GGUF --model mixtureofmerges-moe-4x7b-v10-mixtralv0.3-q4_k_m.gguf -c 2048
 ```
 Note: You can also use this checkpoint directly through the [usage steps](https://github.com/ggerganov/llama.cpp?tab=readme-ov-file#usage) listed in the Llama.cpp repo as well.
 ```