Search results

load draft model fix

ready-to-mergeThe PR is ready to merge after the CI is green.The PR is ready to merge after the CI is green.

Status: Open (in progress).

sgl-project/sglangnumber 7506

#7506 In sgl-project/sglang;

· yilian49 opened on Jun 24, 2025

Add Triton Fused MoE kernel config for E=16 on B200

blackwell

ready-to-mergeThe PR is ready to merge after the CI is green.The PR is ready to merge after the CI is green.

Status: Open (in progress).

sgl-project/sglangnumber 7004

#7004 In sgl-project/sglang;

· b8zhong opened on Jun 9, 2025

Tiny Llama4 type error in constructor

ready-to-mergeThe PR is ready to merge after the CI is green.The PR is ready to merge after the CI is green.

Status: Open (in progress).

sgl-project/sglangnumber 6752

#6752 In sgl-project/sglang;

· b8zhong opened on May 29, 2025

[sgl-kernel] upgrade to flashinfer 0.2.5 to enable PDL in activaton

ready-to-mergeThe PR is ready to merge after the CI is green.The PR is ready to merge after the CI is green.

Status: Open (in progress).

sgl-project/sglangnumber 6722

#6722 In sgl-project/sglang;

· Edenzzzz opened on May 29, 2025

Separate the model instance create from the load weights to improve robust

high priority

ready-to-mergeThe PR is ready to merge after the CI is green.The PR is ready to merge after the CI is green.

Status: Open (in progress).

sgl-project/sglangnumber 6462

#6462 In sgl-project/sglang;

· libratiger opened on May 20, 2025

[Fix] Add undefined <code>update_tensor_inplace</code> function

ready-to-mergeThe PR is ready to merge after the CI is green.The PR is ready to merge after the CI is green.

Status: Open (in progress).

sgl-project/sglangnumber 6307

#6307 In sgl-project/sglang;

· b8zhong opened on May 15, 2025

Log the timestamps of each prefill/decode iteration

ready-to-mergeThe PR is ready to merge after the CI is green.The PR is ready to merge after the CI is green.

Status: Open (in progress).

sgl-project/sglangnumber 6094

#6094 In sgl-project/sglang;

· yuhsuan-t opened on May 7, 2025

[Intel][Gaudi] Support HPUAttnBackend and HPUGraph

intel

ready-to-mergeThe PR is ready to merge after the CI is green.The PR is ready to merge after the CI is green.

Status: Open (in progress).

sgl-project/sglangnumber 5252

#5252 In sgl-project/sglang;

· yangw1234 opened on Apr 10, 2025

[Model] Add support for nvidia/Llama-3_3-Nemotron-Super-49B-v1

ready-to-mergeThe PR is ready to merge after the CI is green.The PR is ready to merge after the CI is green.

Status: Open (in progress).

sgl-project/sglangnumber 5073

#5073 In sgl-project/sglang;

· kylehh opened on Apr 4, 2025

needed imports to support vllm's compressed_tensors quantized models

ready-to-mergeThe PR is ready to merge after the CI is green.The PR is ready to merge after the CI is green.

Status: Open (in progress).

sgl-project/sglangnumber 5042

#5042 In sgl-project/sglang;

· Sadeghi85 opened on Apr 3, 2025

[Fix] weights update for deepseek when enabling cuda graph

ready-to-mergeThe PR is ready to merge after the CI is green.The PR is ready to merge after the CI is green.

Status: Open (in progress).

sgl-project/sglangnumber 4961

#4961 In sgl-project/sglang;

· hxdtest opened on Apr 1, 2025

[QUANT] Fix Quant Method Auto Override

high priority

ready-to-mergeThe PR is ready to merge after the CI is green.The PR is ready to merge after the CI is green.

Status: Open (in progress).

sgl-project/sglangnumber 4426

#4426 In sgl-project/sglang;

· WineChord opened on Mar 14, 2025