unsubscribe
commited on
Commit
•
fb4929b
1
Parent(s):
673d516
Update README.md
Browse files
README.md
CHANGED
@@ -68,7 +68,7 @@ Please overview [this guide](https://opencompass.readthedocs.io/en/latest/advanc
|
|
68 |
LMDeploy's `api_server` enables models to be easily packed into services with a single command. The provided RESTful APIs are compatible with OpenAI's interfaces. Below are an example of service startup:
|
69 |
|
70 |
```shell
|
71 |
-
lmdeploy serve api_server OpenGVLab/
|
72 |
```
|
73 |
|
74 |
The default port of `api_server` is `23333`. After the server is launched, you can communicate with server on terminal through `api_client`:
|
|
|
68 |
LMDeploy's `api_server` enables models to be easily packed into services with a single command. The provided RESTful APIs are compatible with OpenAI's interfaces. Below are an example of service startup:
|
69 |
|
70 |
```shell
|
71 |
+
lmdeploy serve api_server OpenGVLab/InternVL2-2B-AWQ --backend turbomind --model-format awq --chat-template chat_template.json
|
72 |
```
|
73 |
|
74 |
The default port of `api_server` is `23333`. After the server is launched, you can communicate with server on terminal through `api_client`:
|