Skip to content

Commit 89a5541

Browse files
authored
[PD] Fix unclosed prefill connection warning of mini_lb (#5155)
Signed-off-by: Shangming Cai <[email protected]>
1 parent 2695ab0 commit 89a5541

File tree

1 file changed

+3
-0
lines changed

1 file changed

+3
-0
lines changed

python/sglang/srt/disaggregation/mini_lb.py

Lines changed: 3 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -232,6 +232,9 @@ async def stream_results():
232232
yield b"data: " + orjson.dumps(
233233
error_msg, option=orjson.OPT_NON_STR_KEYS
234234
) + b"\n\n"
235+
finally:
236+
if prefill_response is not None:
237+
await prefill_response.release()
235238

236239
return StreamingResponse(
237240
stream_results(),

0 commit comments

Comments
 (0)