Spaces:
Configuration error
Configuration error
Fedir Zadniprovskyi
commited on
Commit
·
669a858
1
Parent(s):
526f427
chore: misc changes
Browse files- Dockerfile +1 -0
- compose.yaml +0 -4
- docs/installation.md +25 -4
Dockerfile
CHANGED
|
@@ -19,6 +19,7 @@ WORKDIR $HOME/faster-whisper-server
|
|
| 19 |
COPY --chown=ubuntu --from=ghcr.io/astral-sh/uv:0.5.14 /uv /bin/uv
|
| 20 |
# https://docs.astral.sh/uv/guides/integration/docker/#intermediate-layers
|
| 21 |
# https://docs.astral.sh/uv/guides/integration/docker/#compiling-bytecode
|
|
|
|
| 22 |
RUN --mount=type=cache,target=/root/.cache/uv \
|
| 23 |
--mount=type=bind,source=uv.lock,target=uv.lock \
|
| 24 |
--mount=type=bind,source=pyproject.toml,target=pyproject.toml \
|
|
|
|
| 19 |
COPY --chown=ubuntu --from=ghcr.io/astral-sh/uv:0.5.14 /uv /bin/uv
|
| 20 |
# https://docs.astral.sh/uv/guides/integration/docker/#intermediate-layers
|
| 21 |
# https://docs.astral.sh/uv/guides/integration/docker/#compiling-bytecode
|
| 22 |
+
# TODO: figure out if `/home/ubuntu/.cache/uv` should be used instead of `/root/.cache/uv`
|
| 23 |
RUN --mount=type=cache,target=/root/.cache/uv \
|
| 24 |
--mount=type=bind,source=uv.lock,target=uv.lock \
|
| 25 |
--mount=type=bind,source=pyproject.toml,target=pyproject.toml \
|
compose.yaml
CHANGED
|
@@ -11,7 +11,3 @@ services:
|
|
| 11 |
restart: unless-stopped
|
| 12 |
ports:
|
| 13 |
- 8000:8000
|
| 14 |
-
develop:
|
| 15 |
-
watch:
|
| 16 |
-
- path: faster_whisper_server
|
| 17 |
-
action: rebuild
|
|
|
|
| 11 |
restart: unless-stopped
|
| 12 |
ports:
|
| 13 |
- 8000:8000
|
|
|
|
|
|
|
|
|
|
|
|
docs/installation.md
CHANGED
|
@@ -70,26 +70,47 @@ TODO: just reference the existing compose file in the repo
|
|
| 70 |
=== "CUDA"
|
| 71 |
|
| 72 |
```bash
|
| 73 |
-
docker run
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 74 |
```
|
| 75 |
|
| 76 |
=== "CUDA (with CDI feature enabled)"
|
| 77 |
|
| 78 |
```bash
|
| 79 |
-
docker run
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 80 |
```
|
| 81 |
|
| 82 |
=== "CPU"
|
| 83 |
|
| 84 |
```bash
|
| 85 |
-
docker run
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 86 |
```
|
| 87 |
|
| 88 |
## Kubernetes
|
|
|
|
| 89 |
WARNING: it was written few months ago and may be outdated.
|
| 90 |
Please refer to this [blog post](https://substratus.ai/blog/deploying-faster-whisper-on-k8s)
|
| 91 |
|
| 92 |
-
## Python (requires Python 3.12+)
|
| 93 |
|
| 94 |
```bash
|
| 95 |
git clone https://github.com/fedirz/faster-whisper-server.git
|
|
|
|
| 70 |
=== "CUDA"
|
| 71 |
|
| 72 |
```bash
|
| 73 |
+
docker run \
|
| 74 |
+
--rm \
|
| 75 |
+
--detach \
|
| 76 |
+
--publish 8000:8000 \
|
| 77 |
+
--name faster-whisper-server \
|
| 78 |
+
--volume hf-hub-cache:/home/ubuntu/.cache/huggingface/hub \
|
| 79 |
+
--gpus=all \
|
| 80 |
+
fedirz/faster-whisper-server:latest-cuda
|
| 81 |
```
|
| 82 |
|
| 83 |
=== "CUDA (with CDI feature enabled)"
|
| 84 |
|
| 85 |
```bash
|
| 86 |
+
docker run \
|
| 87 |
+
--rm \
|
| 88 |
+
--detach \
|
| 89 |
+
--publish 8000:8000 \
|
| 90 |
+
--name faster-whisper-server \
|
| 91 |
+
--volume hf-hub-cache:/home/ubuntu/.cache/huggingface/hub \
|
| 92 |
+
--device=nvidia.com/gpu=all \
|
| 93 |
+
fedirz/faster-whisper-server:latest-cuda
|
| 94 |
```
|
| 95 |
|
| 96 |
=== "CPU"
|
| 97 |
|
| 98 |
```bash
|
| 99 |
+
docker run \
|
| 100 |
+
--rm \
|
| 101 |
+
--detach \
|
| 102 |
+
--publish 8000:8000 \
|
| 103 |
+
--name faster-whisper-server \
|
| 104 |
+
--volume hf-hub-cache:/home/ubuntu/.cache/huggingface/hub \
|
| 105 |
+
fedirz/faster-whisper-server:latest-cpu
|
| 106 |
```
|
| 107 |
|
| 108 |
## Kubernetes
|
| 109 |
+
|
| 110 |
WARNING: it was written few months ago and may be outdated.
|
| 111 |
Please refer to this [blog post](https://substratus.ai/blog/deploying-faster-whisper-on-k8s)
|
| 112 |
|
| 113 |
+
## Python (requires Python 3.12+ and `uv` package manager)
|
| 114 |
|
| 115 |
```bash
|
| 116 |
git clone https://github.com/fedirz/faster-whisper-server.git
|