multi item scoring testcase#225
Conversation
Adds a function to send scoring requests to the server.
Implement tests for multi-item scoring with softmax options.
This test verifies the multi-item scoring functionality with text input and softmax normalization. It checks response structure, score ordering, and ensures the correct item is ranked highest.
CLA Signature Guide@EdwardXuy , thanks for your pull request. The following commit(s) are not associated with a signed Contributor License Agreement (CLA).
To sign CLA, click here. To check if your email is configured correctly, refer to the FAQs. Once you've signed the CLA or updating your email, please comment |
CLA Signature Guide@EdwardXuy , thanks for your pull request. The following commit(s) are not associated with a signed Contributor License Agreement (CLA).
To sign CLA, click here. To check if your email is configured correctly, refer to the FAQs. Once you've signed the CLA or updating your email, please comment |
CLA Signature Guide@EdwardXuy , thanks for your pull request. The following commit(s) are not associated with a signed Contributor License Agreement (CLA).
To sign CLA, click here. To check if your email is configured correctly, refer to the FAQs. Once you've signed the CLA or updating your email, please comment |
CLA Signature Guide@EdwardXuy , thanks for your pull request. The following commit(s) are not associated with a signed Contributor License Agreement (CLA).
To sign CLA, click here. To check if your email is configured correctly, refer to the FAQs. Once you've signed the CLA or updating your email, please comment |
CLA Signature Guide@EdwardXuy , thanks for your pull request. The following commit(s) are not associated with a signed Contributor License Agreement (CLA).
To sign CLA, click here. To check if your email is configured correctly, refer to the FAQs. Once you've signed the CLA or updating your email, please comment |
1 similar comment
CLA Signature Guide@EdwardXuy , thanks for your pull request. The following commit(s) are not associated with a signed Contributor License Agreement (CLA).
To sign CLA, click here. To check if your email is configured correctly, refer to the FAQs. Once you've signed the CLA or updating your email, please comment |
CLA Signature Guide@EdwardXuy , thanks for your pull request. The following commit(s) are not associated with a signed Contributor License Agreement (CLA).
To sign CLA, click here. To check if your email is configured correctly, refer to the FAQs. Once you've signed the CLA or updating your email, please comment |
CLA Signature Guide@EdwardXuy , thanks for your pull request. The following commit(s) are not associated with a signed Contributor License Agreement (CLA).
To sign CLA, click here. To check if your email is configured correctly, refer to the FAQs. Once you've signed the CLA or updating your email, please comment |
CLA Signature Guide@EdwardXuy , thanks for your pull request. The following commit(s) are not associated with a signed Contributor License Agreement (CLA).
To sign CLA, click here. To check if your email is configured correctly, refer to the FAQs. Once you've signed the CLA or updating your email, please comment |
CLA Signature Guide@EdwardXuy , thanks for your pull request. The following commit(s) are not associated with a signed Contributor License Agreement (CLA).
To sign CLA, click here. To check if your email is configured correctly, refer to the FAQs. Once you've signed the CLA or updating your email, please comment |
CLA Signature Guide@EdwardXuy , thanks for your pull request. The following commit(s) are not associated with a signed Contributor License Agreement (CLA).
To sign CLA, click here. To check if your email is configured correctly, refer to the FAQs. Once you've signed the CLA or updating your email, please comment |
3 participants
[Ascend] Add multi-item scoring tests for NPU basic functionality
Summary:
This commit introduces comprehensive test cases for multi-item scoring
functionality on Ascend NPU, ensuring correct behavior of softmax scoring
and parameter handling in SGLang's Ascend backend.
Test File Added:
test_npu_multi_item_scoring_softmax.py
Validates semantic correctness of multi-item scoring
Verifies that "Yes" token receives higher scores for positive queries
Tests basic scoring pipeline with tokenized input
Tests apply_softmax=False vs apply_softmax=True parameter distinction
Verifies softmax probability normalization (scores sum to 1.0)
Covers both tokenized and text input scenarios
test_ascend_utils.py (Helper)
Provides utility functions for Ascend NPU test setup
Includes server management and scoring helper methods
Key Validations:
✓ apply_softmax=False returns raw logits
✓ apply_softmax=True returns normalized probabilities (sum = 1.0)
✓ Correct token ranking for semantic scoring
✓ All tests pass on Ascend 910B with CANN 8.5.0
Test Results:
test_npu_multi_item_scoring_softmax.py: 3/3 passed
Total: 3/3 tests passed
Related:
Improves test coverage for Ascend NPU scoring functionality
Enables CI validation for multi-item scoring parameters