apepkuss79 commited on
Commit
8a1e9b5
1 Parent(s): 20de4fb

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +19 -7
README.md CHANGED
@@ -43,13 +43,25 @@ quantized_by: Second State Inc.
43
 
44
  - Run as LlamaEdge service
45
 
46
- ```bash
47
- wasmedge --dir .:. --nn-preload default:GGML:AUTO:internlm2_5-7b-chat-Q5_K_M.gguf \
48
- llama-api-server.wasm \
49
- --prompt-template chatml \
50
- --ctx-size 32000 \
51
- --model-name internlm2_5-7b-chat
52
- ```
 
 
 
 
 
 
 
 
 
 
 
 
53
 
54
  - Run as LlamaEdge command app
55
 
 
43
 
44
  - Run as LlamaEdge service
45
 
46
+ - Chat
47
+
48
+ ```bash
49
+ wasmedge --dir .:. --nn-preload default:GGML:AUTO:internlm2_5-7b-chat-Q5_K_M.gguf \
50
+ llama-api-server.wasm \
51
+ --prompt-template chatml \
52
+ --ctx-size 32000 \
53
+ --model-name internlm2_5-7b-chat
54
+ ```
55
+
56
+ - Tool use
57
+
58
+ ```bash
59
+ wasmedge --dir .:. --nn-preload default:GGML:AUTO:internlm2_5-7b-chat-Q5_K_M.gguf \
60
+ llama-api-server.wasm \
61
+ --prompt-template internlm-2-tool \
62
+ --ctx-size 32000 \
63
+ --model-name internlm2_5-7b-chat
64
+ ```
65
 
66
  - Run as LlamaEdge command app
67