[Bug] MTP conflicts with structural tag

[minleminzui]

Checklist

• 1. I have searched related issues but cannot get the expected help.
• 2. The bug has not been fixed in the latest version.
• 3. Please note that if the bug-related issue you submitted lacks corresponding environment info and a minimal reproducible demo, it will be challenging for us to reproduce and resolve the issue, reducing the likelihood of receiving feedback.
• 4. If the issue you raised is not a bug but a question, please raise a discussion at https://github.com/sgl-project/sglang/discussions/new/choose Otherwise, it will be closed.
• 5. Please use English, otherwise it will be closed.

Describe the bug

please see #5224 (comment)

Reproduction

please see #5224 (comment)

Environment

please see #5224 (comment)

[FeiDeng]

Just want to double check if we have some timeline to address this issue? Thanks.

[minleminzui]

Just want to double check if we have some timeline to address this issue? Thanks.

It can be completed before May 6th， thanks

[FeiDeng]

Any luck on this one? Thanks.

[minleminzui]

Any luck on this one? Thanks.

1. tool calling of dpsk-r1 is implemented using structural tags, so MTP definitely conflicts with tool calling of dpsk-r1
2. tool calling of dpsk-v3 with strict mode is implemented using structural tags, so MTP definitely conflicts with of dpsk-v3 with strict mode
3. tool calling of dpsk-v3 without strict mode shouldn't conflicts with MTP. I'm testing tool calling of dpsk-v3 without strict mode and MTP. However, due to machine issues, it will be relatively slow
4. thanks

[FeiDeng]

@minleminzui, some hint on this? I am looking at if we could support MTP and functioncall for R1 at same time. If there are some way to work around?

[minleminzui]

@minleminzui, some hint on this? I am looking at if we could support MTP and functioncall for R1 at same time. If there are some way to work around?

sorry for the delay, I've check it that dspk r1 cannot be used for tool calling, I think because during the training process, it did not train this ability. So tool calling of dpsk-r1 is implemented using structural tags, which depends on the instruction compliance ability of the model itself. If you see somewhere saying that dpsk r1 can be used for tool calling itself, please feel free to contact us, thanks

[minleminzui]

@FeiDeng https://api-docs.deepseek.com/news/news250528 dpsk-r1 0528 support tool calling now