Skip to content

Commit c4ab734

Browse files
hmellordbyoung18
authored andcommitted
Help user create custom model for Transformers backend remote code models (vllm-project#16719)
Signed-off-by: Harry Mellor <[email protected]>
1 parent 6ca2a67 commit c4ab734

File tree

1 file changed

+4
-0
lines changed

1 file changed

+4
-0
lines changed

docs/source/models/supported_models.md

Lines changed: 4 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -55,6 +55,10 @@ If your model is neither supported natively by vLLM or Transformers, you can sti
5555
Simply set `trust_remote_code=True` and vLLM will run any model on the Model Hub that is compatible with Transformers.
5656
Provided that the model writer implements their model in a compatible way, this means that you can run new models before they are officially supported in Transformers or vLLM!
5757

58+
:::{tip}
59+
If you have not yet created your custom model, you can follow this guide on [customising models in Transformers](https://huggingface.co/docs/transformers/en/custom_models).
60+
:::
61+
5862
```python
5963
from vllm import LLM
6064
llm = LLM(model=..., task="generate", trust_remote_code=True) # Name or path of your model

0 commit comments

Comments
 (0)