Skip to content

Commit 15020fa

Browse files
hmellorlionelvillard
authored andcommitted
Improve error for structured output backend selection (vllm-project#16717)
Signed-off-by: Harry Mellor <[email protected]>
1 parent a615b2d commit 15020fa

File tree

1 file changed

+7
-4
lines changed

1 file changed

+7
-4
lines changed

vllm/v1/engine/processor.py

Lines changed: 7 additions & 4 deletions
Original file line numberDiff line numberDiff line change
@@ -155,10 +155,13 @@ def _validate_structured_output(self, params: SamplingParams) -> None:
155155
"supported in V1.")
156156
if params.guided_decoding.backend:
157157
if params.guided_decoding.backend != engine_level_backend:
158-
raise ValueError("Request-level structured output backend "
159-
"must match engine-level backend. "
160-
f"{params.guided_decoding.backend}"
161-
f" != {engine_level_backend}")
158+
raise ValueError(
159+
"Request-level structured output backend selection is no "
160+
"longer supported. The request specified "
161+
f"'{params.guided_decoding.backend}', but vLLM was "
162+
f"initialised with '{engine_level_backend}'. This error "
163+
"can be resolved by removing backend selection from the "
164+
"request.")
162165
else:
163166
params.guided_decoding.backend = engine_level_backend
164167

0 commit comments

Comments
 (0)