Skip to content

Commit 5d4fb9a

Browse files
committed
update prefill
1 parent 389b0c2 commit 5d4fb9a

File tree

1 file changed

+8
-0
lines changed

1 file changed

+8
-0
lines changed

python/sglang/srt/disaggregation/prefill.py

Lines changed: 8 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -225,6 +225,14 @@ def event_loop_overlap_disagg_prefill(self):
225225
)
226226
self.process_prefill_chunk()
227227
batch = self.get_new_batch_prefill()
228+
229+
# Handle DP attention
230+
if (
231+
self.server_args.enable_dp_attention
232+
or self.server_args.enable_sp_layernorm
233+
):
234+
batch, _ = self.prepare_dp_attn_batch(batch)
235+
228236
self.cur_batch = batch
229237

230238
if batch:

0 commit comments

Comments
 (0)