Skip to content

Commit efd7d65

Browse files
Alcanderiantarinkk
authored andcommitted
[fix] force use deepgemm in compile_deep_gemm (sgl-project#5618)
1 parent db62f0d commit efd7d65

File tree

1 file changed

+2
-0
lines changed

1 file changed

+2
-0
lines changed

python/sglang/compile_deep_gemm.py

Lines changed: 2 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -28,6 +28,8 @@
2828

2929
# Reduce warning
3030
os.environ["SGL_IN_DEEP_GEMM_PRE_COMPILE_STAGE"] = "1"
31+
# Force enable deep gemm
32+
os.environ["SGL_ENABLE_JIT_DEEPGEMM"] = "1"
3133

3234

3335
@dataclasses.dataclass

0 commit comments

Comments
 (0)