修改platfotms by caiwenwen11 · Pull Request #130 · Ascend/sglang

caiwenwen11 · 2026-03-20T01:10:28Z

Motivation

Modifications

Accuracy Tests

Benchmarking and Profiling

Checklist

Format your code according to the Format code with pre-commit.
Add unit tests according to the Run and add unit tests.
Update documentation according to Write documentations.
Provide accuracy and speed benchmark results according to Test the accuracy and Benchmark the speed.
Follow the SGLang code style guidance.

Review Process

Ping Merge Oncalls to start the PR flow. See the PR Merge Process.
Get approvals from CODEOWNERS and other reviewers.
Trigger CI tests with comments or contact authorized users to do so.
- /tag-run-ci-label, /rerun-failed-ci, /tag-and-rerun-ci
After green CI and required approvals, ask Merge Oncalls to merge.

ascend-robot · 2026-03-20T01:10:41Z

CLA Signature Guide

@caiwenwen11 , thanks for your pull request.

The following commit(s) are not associated with a signed Contributor License Agreement (CLA).

Commit	Reason
[`3055b69` [Diffusion] Document torch.comp...](`3055b69`)	the email used in the commit is not linked to a signed CLA! please verify that it matches the email you used when signing the CLA.

To sign CLA, click here.

To check if your email is configured correctly, refer to the FAQs.

Once you've signed the CLA or updating your email, please comment /check-cla to revalidate CLA status.

sgl-project#21421) Co-authored-by: Chen, Todd <zhenchen@amd.com>

…ect#21470) Co-authored-by: Kelon <kelonlu@163.com>

…gl-project#21135)

Co-authored-by: Jianzhao Xu <xujianchao@huawei.com>

…se is used with FP8 KV cache (sgl-project#20606) Signed-off-by: Ho-Ren (Jack) Chuang <horenchuang@bytedance.com>

…project#21471)

…ow_size`, matching all suffixes of the Trie (sgl-project#21225)

…1910)

…l-project#20394)

ascend-robot · 2026-04-10T02:28:27Z

CLA Signature Guide

@caiwenwen11 , thanks for your pull request.

The following commit(s) are not associated with a signed Contributor License Agreement (CLA).

Commit	Reason
[`3055b69` [Diffusion] Document torch.comp...](`3055b69`)	the email used in the commit is not linked to a signed CLA! please verify that it matches the email you used when signing the CLA.
2ff6b9c1 modified the doc tools in the ma...	the email used in the commit is not linked to a signed CLA! please verify that it matches the email you used when signing the CLA.

To sign CLA, click here.

To check if your email is configured correctly, refer to the FAQs.

Once you've signed the CLA or updating your email, please comment /check-cla to revalidate CLA status.

ascend-robot · 2026-04-10T08:17:32Z

CLA Signature Guide

@caiwenwen11 , thanks for your pull request.

The following commit(s) are not associated with a signed Contributor License Agreement (CLA).

Commit	Reason
[`3055b69` [Diffusion] Document torch.comp...](`3055b69`)	the email used in the commit is not linked to a signed CLA! please verify that it matches the email you used when signing the CLA.
2ff6b9c1 modified the doc tools in the ma...	the email used in the commit is not linked to a signed CLA! please verify that it matches the email you used when signing the CLA.

To sign CLA, click here.

To check if your email is configured correctly, refer to the FAQs.

Once you've signed the CLA or updating your email, please comment /check-cla to revalidate CLA status.

ascend-robot · 2026-04-11T01:40:33Z

CLA Signature Guide

@caiwenwen11 , thanks for your pull request.

The following commit(s) are not associated with a signed Contributor License Agreement (CLA).

Commit	Reason
[`f142608` [MUSA] apply_vocab_mask support...](`f142608`)	the email used in the commit is not linked to a signed CLA! please verify that it matches the email you used when signing the CLA.

To sign CLA, click here.

To check if your email is configured correctly, refer to the FAQs.

Once you've signed the CLA or updating your email, please comment /check-cla to revalidate CLA status.

ascend-robot · 2026-04-11T01:57:51Z

CLA Signature Guide

@caiwenwen11 , thanks for your pull request.

The following commit(s) are not associated with a signed Contributor License Agreement (CLA).

Commit	Reason
[`7ca015f` [Diffusion] Refactor diffusion ...](`7ca015f`)	the email used in the commit is not linked to a signed CLA! please verify that it matches the email you used when signing the CLA.
2ff6b9c1 modified the doc tools in the ma...	the email used in the commit is not linked to a signed CLA! please verify that it matches the email you used when signing the CLA.

To sign CLA, click here.

To check if your email is configured correctly, refer to the FAQs.

Once you've signed the CLA or updating your email, please comment /check-cla to revalidate CLA status.

ascend-robot · 2026-04-11T03:14:24Z

CLA Signature Guide

@caiwenwen11 , thanks for your pull request.

The following commit(s) are not associated with a signed Contributor License Agreement (CLA).

Commit	Reason
[`a305964` [MLX] Add native MLX execution ...](`a305964`)	the email used in the commit is not linked to a signed CLA! please verify that it matches the email you used when signing the CLA.
2ff6b9c1 modified the doc tools in the ma...	the email used in the commit is not linked to a signed CLA! please verify that it matches the email you used when signing the CLA.

To sign CLA, click here.

To check if your email is configured correctly, refer to the FAQs.

Once you've signed the CLA or updating your email, please comment /check-cla to revalidate CLA status.

ascend-robot · 2026-04-11T04:13:33Z

CLA Signature Guide

@caiwenwen11 , thanks for your pull request.

The following commit(s) are not associated with a signed Contributor License Agreement (CLA).

Commit	Reason
[`fd53594` [AMD]Integrate aiter's fused_to...](`fd53594`)	the email used in the commit is not linked to a signed CLA! please verify that it matches the email you used when signing the CLA.
2ff6b9c1 modified the doc tools in the ma...	the email used in the commit is not linked to a signed CLA! please verify that it matches the email you used when signing the CLA.

To sign CLA, click here.

To check if your email is configured correctly, refer to the FAQs.

Once you've signed the CLA or updating your email, please comment /check-cla to revalidate CLA status.

ascend-robot · 2026-04-17T08:00:00Z

CLA Signature Guide

@caiwenwen11 , thanks for your pull request.

The following commit(s) are not associated with a signed Contributor License Agreement (CLA).

Commit	Reason
[`fd53594` [AMD]Integrate aiter's fused_to...](`fd53594`)	the email used in the commit is not linked to a signed CLA! please verify that it matches the email you used when signing the CLA.
2ff6b9c1 modified the doc tools in the ma...	the email used in the commit is not linked to a signed CLA! please verify that it matches the email you used when signing the CLA.

To sign CLA, click here.

To check if your email is configured correctly, refer to the FAQs.

Once you've signed the CLA or updating your email, please comment /check-cla to revalidate CLA status.

ascend-robot · 2026-04-17T08:23:37Z

CLA Signature Guide

@caiwenwen11 , thanks for your pull request.

The following commit(s) are not associated with a signed Contributor License Agreement (CLA).

Commit	Reason
[`fd53594` [AMD]Integrate aiter's fused_to...](`fd53594`)	the email used in the commit is not linked to a signed CLA! please verify that it matches the email you used when signing the CLA.
2ff6b9c1 modified the doc tools in the ma...	the email used in the commit is not linked to a signed CLA! please verify that it matches the email you used when signing the CLA.

To sign CLA, click here.

To check if your email is configured correctly, refer to the FAQs.

Once you've signed the CLA or updating your email, please comment /check-cla to revalidate CLA status.

ascend-robot · 2026-04-17T08:36:01Z

CLA Signature Guide

@caiwenwen11 , thanks for your pull request.

The following commit(s) are not associated with a signed Contributor License Agreement (CLA).

Commit	Reason
[`fd53594` [AMD]Integrate aiter's fused_to...](`fd53594`)	the email used in the commit is not linked to a signed CLA! please verify that it matches the email you used when signing the CLA.
2ff6b9c1 modified the doc tools in the ma...	the email used in the commit is not linked to a signed CLA! please verify that it matches the email you used when signing the CLA.

To sign CLA, click here.

To check if your email is configured correctly, refer to the FAQs.

Once you've signed the CLA or updating your email, please comment /check-cla to revalidate CLA status.

caiwenwen11 requested review from iforgetmyname and ping1jing2 as code owners March 20, 2026 01:10

ascend-robot added the ascend-cla/no label Mar 20, 2026

github-actions Bot added documentation Improvements or additions to documentation npu sgl-kernel dependencies Multi-modal diffusion lora quant amd deepseek hicache jit-kernel mthreads and removed ascend-cla/no labels Mar 20, 2026

zhentaocc and others added 12 commits March 26, 2026 00:57

[AMD]Integrate aiter's fused_topk for softmax scoring in topk function (

fd53594

sgl-project#21421) Co-authored-by: Chen, Todd <zhenchen@amd.com>

[Deps] Bump xgrammar to 0.1.32 (sgl-project#21032)

f289d17

[diffusion] fix: fix qwen-image with nunchaku (sgl-project#21415)

35720d9

[diffusion] CI: fix breaking import path in nightly (sgl-project#21449)

238a4b8

[AMD] CI - fix amd 4-GPU PR test (sgl-project#21444)

013fa55

[NPU] multimodal-gen-test-8-npu-a3,Cache pytorch dependency (sgl-proj…

8febc36

…ect#21470) Co-authored-by: Kelon <kelonlu@163.com>

bugfix for weight loading for qwen3-next (sgl-project#21313)

0906e45

fix: use get_rope_config() to support models without rope_parameters (s…

646573e

…gl-project#21135)

Fix bug in dbrx model (sgl-project#21445)

3867c64

Co-authored-by: Jianzhao Xu <xujianchao@huawei.com>

FIX: (NSA) Compute topk_indices_offset when NSA prefill flashmla_spar…

4b5f63e

…se is used with FP8 KV cache (sgl-project#20606) Signed-off-by: Ho-Ren (Jack) Chuang <horenchuang@bytedance.com>

[CI] Skip stage health check for release branch cut (sgl-project#21488)

17f43d1

Fix UnboundLocalError when DetokenizerManager constructor fails (sgl-…

e5b7650

…project#21471)

kpham-sgl and others added 7 commits April 1, 2026 21:53

Multi tool streaming fix (sgl-project#20004)

153359b

Return HTTP 400 for streaming validation errors (sgl-project#21900)

269589a

[Spec][Ngram] 4/N: Remove max_match_window_size and `min_match_wind…

f836658

…ow_size`, matching all suffixes of the Trie (sgl-project#21225)

Fix ngram doc for speculative_num_draft_tokens default (sgl-project#2…

f25bf86

…1910)

[NVIDIA] Enable fp8 flashinfer_trtllm_routed MoE for MiniMax-M2.5 (sg…

d24ea24

…l-project#20394)

scheduler: add prefill-only update in merge batch (sgl-project#21840)

f30df72

modified the doc tools in the main repository

2ff6b9c

ascend-robot added the ascend-cla/no label Apr 10, 2026

111

b0d5fad

caiwenwen11 force-pushed the main branch from b0d5fad to f30df72 Compare April 11, 2026 01:40

github-actions Bot added model-gateway blackwell speculative-decoding piecewise-cuda-graph labels Apr 11, 2026

caiwenwen added 2 commits April 11, 2026 09:56

131

74fb2e6

131

6db4701

修改问题

b9037f0

caiwenwen11 force-pushed the main branch from 7a23832 to 2732608 Compare April 17, 2026 07:59

caiwenwen11 force-pushed the main branch from 2732608 to 0ad272d Compare April 17, 2026 08:23

xiugai3456

7c04dd0

caiwenwen11 force-pushed the main branch from 0ad272d to 7c04dd0 Compare April 17, 2026 08:35

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

修改platfotms#130

修改platfotms#130
caiwenwen11 wants to merge 584 commits intoAscend:docsfrom
caiwenwen11:main

caiwenwen11 commented Mar 20, 2026

Uh oh!

ascend-robot commented Mar 20, 2026

Uh oh!

ascend-robot commented Apr 10, 2026

Uh oh!

ascend-robot commented Apr 10, 2026

Uh oh!

ascend-robot commented Apr 11, 2026

Uh oh!

ascend-robot commented Apr 11, 2026

Uh oh!

ascend-robot commented Apr 11, 2026

Uh oh!

ascend-robot commented Apr 11, 2026

Uh oh!

ascend-robot commented Apr 17, 2026

Uh oh!

ascend-robot commented Apr 17, 2026

Uh oh!

ascend-robot commented Apr 17, 2026

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

20 participants

Conversation

caiwenwen11 commented Mar 20, 2026

Motivation

Modifications

Accuracy Tests

Benchmarking and Profiling

Checklist

Review Process

Uh oh!

ascend-robot commented Mar 20, 2026

CLA Signature Guide

Uh oh!

ascend-robot commented Apr 10, 2026

CLA Signature Guide

Uh oh!

ascend-robot commented Apr 10, 2026

CLA Signature Guide

Uh oh!

ascend-robot commented Apr 11, 2026

CLA Signature Guide

Uh oh!

ascend-robot commented Apr 11, 2026

CLA Signature Guide

Uh oh!

ascend-robot commented Apr 11, 2026

CLA Signature Guide

Uh oh!

ascend-robot commented Apr 11, 2026

CLA Signature Guide

Uh oh!

ascend-robot commented Apr 17, 2026

CLA Signature Guide

Uh oh!

ascend-robot commented Apr 17, 2026

CLA Signature Guide

Uh oh!

ascend-robot commented Apr 17, 2026

CLA Signature Guide

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

20 participants