We read every piece of feedback, and take your input very seriously.
To see all available qualifiers, see our documentation.
There was an error while loading. Please reload this page.
1 parent 4e201ae commit a553ac7Copy full SHA for a553ac7
docs/source/deployment/docker.md
@@ -19,6 +19,18 @@ $ docker run --runtime nvidia --gpus all \
19
--model mistralai/Mistral-7B-v0.1
20
```
21
22
+This image can also be used with other container engines such as [Podman](https://podman.io/).
23
+
24
+```console
25
+$ podman run --gpus all \
26
+ -v ~/.cache/huggingface:/root/.cache/huggingface \
27
+ --env "HUGGING_FACE_HUB_TOKEN=$HF_TOKEN" \
28
+ -p 8000:8000 \
29
+ --ipc=host \
30
+ vllm/vllm-openai:latest \
31
+ --model mistralai/Mistral-7B-v0.1
32
+```
33
34
You can add any other <project:#engine-args> you need after the image tag (`vllm/vllm-openai:latest`).
35
36
:::{note}
0 commit comments