second-state
/

functionary-small-v3.2-GGUF

Inference Endpoints

Model card Files Files and versions Community

apepkuss79 commited on Oct 9

Commit

27e95b4

•

1 Parent(s): f062a52

Update README.md

Files changed (1) hide show

README.md +2 -2

README.md CHANGED Viewed

@@ -48,7 +48,7 @@ quantized_by: Second State Inc.
   wasmedge --dir .:. --nn-preload default:GGML:AUTO:functionary-small-v3.2-Q5_K_M.gguf \
     llama-api-server.wasm \
     --model-name functionary-small-v3.2 \
-    --prompt-template chatml \
     --ctx-size 128000
   ```
@@ -57,7 +57,7 @@ quantized_by: Second State Inc.
   ```bash
   wasmedge --dir .:. --nn-preload default:GGML:AUTO:functionary-small-v3.2-Q5_K_M.gguf \
     llama-chat.wasm \
-    --prompt-template chatml \
     --ctx-size 128000
   ``` -->

   wasmedge --dir .:. --nn-preload default:GGML:AUTO:functionary-small-v3.2-Q5_K_M.gguf \
     llama-api-server.wasm \
     --model-name functionary-small-v3.2 \
+    --prompt-template functionary-32 \
     --ctx-size 128000
   ```
   ```bash
   wasmedge --dir .:. --nn-preload default:GGML:AUTO:functionary-small-v3.2-Q5_K_M.gguf \
     llama-chat.wasm \
+    --prompt-template functionary-32 \
     --ctx-size 128000
   ``` -->