Skip to content

update awq backend infos, refine UT#1581

Merged
WeiweiZhang1 merged 7 commits intomainfrom
refine_doc_update_awq_backend_info
Mar 20, 2026
Merged

update awq backend infos, refine UT#1581
WeiweiZhang1 merged 7 commits intomainfrom
refine_doc_update_awq_backend_info

Conversation

@WeiweiZhang1
Copy link
Copy Markdown
Contributor

@WeiweiZhang1 WeiweiZhang1 commented Mar 20, 2026

Description

Please briefly describe your main changes, the motivation.

Type of Change

  • Bug fix
  • New feature
  • Documentation update
  • Performance improvement
  • Code refactoring
  • Other (please specify):

Related Issues

Fixes or relates to #

Checklist Before Submitting

  • My code has been tested locally.
  • Documentation has been updated as needed.
  • New or updated tests are included where applicable.

Signed-off-by: WeiweiZhang1 <weiwei1.zhang@intel.com>
Copy link
Copy Markdown
Contributor

Copilot AI left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull request overview

Updates AWQ backend documentation (including gptqmodel-based AWQ variants) and refines a CUDA integration test to explicitly release SGLang resources.

Changes:

  • Add explicit llm.shutdown() in SGLang CUDA integration test.
  • Expand AWQ backend matrix docs to include gptqmodel AWQ variants and add a Transformers version constraint for auto-awq.
  • Clean up/align backend table formatting in the English step-by-step doc.

Reviewed changes

Copilot reviewed 3 out of 3 changed files in this pull request and generated 3 comments.

File Description
test/test_cuda/integrations/test_sglang.py Ensures SGLang inference test shuts down the LLM instance after generation.
docs/step_by_step_CN.md Updates backend capability table with AWQ-related backend entries and requirements.
docs/step_by_step.md Re-formats backend selection docs/table and adds AWQ backend requirement details.

Comment thread test/test_cuda/integrations/test_sglang.py
Comment thread docs/step_by_step.md
Comment thread docs/step_by_step_CN.md Outdated
WeiweiZhang1 and others added 3 commits March 20, 2026 14:28
Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>
Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>
@WeiweiZhang1 WeiweiZhang1 added this to the 0.12.0 milestone Mar 20, 2026
Signed-off-by: WeiweiZhang1 <weiwei1.zhang@intel.com>
Signed-off-by: WeiweiZhang1 <weiwei1.zhang@intel.com>
Signed-off-by: WeiweiZhang1 <weiwei1.zhang@intel.com>
@WeiweiZhang1 WeiweiZhang1 added the documentation Improvements or additions to documentation label Mar 20, 2026
@WeiweiZhang1 WeiweiZhang1 merged commit 06dfc83 into main Mar 20, 2026
8 checks passed
@WeiweiZhang1 WeiweiZhang1 deleted the refine_doc_update_awq_backend_info branch March 20, 2026 08:44
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

documentation Improvements or additions to documentation

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants