Skip to content

Commit 2d60fa1

Browse files
ShangmingCaiDiweiSun
authored andcommitted
[PD] Fix unclosed prefill connection warning of mini_lb (sgl-project#5155)
Signed-off-by: Shangming Cai <[email protected]>
1 parent 08f3672 commit 2d60fa1

File tree

1 file changed

+3
-0
lines changed

1 file changed

+3
-0
lines changed

python/sglang/srt/disaggregation/mini_lb.py

Lines changed: 3 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -232,6 +232,9 @@ async def stream_results():
232232
yield b"data: " + orjson.dumps(
233233
error_msg, option=orjson.OPT_NON_STR_KEYS
234234
) + b"\n\n"
235+
finally:
236+
if prefill_response is not None:
237+
await prefill_response.release()
235238

236239
return StreamingResponse(
237240
stream_results(),

0 commit comments

Comments
 (0)