Skip to content

feat: serverless auto benchmark#1051

Merged
HaiHui886 merged 1 commit into
mainfrom
sync_mr_2474_2a5fb0a
May 8, 2026
Merged

feat: serverless auto benchmark#1051
HaiHui886 merged 1 commit into
mainfrom
sync_mr_2474_2a5fb0a

Conversation

@csg-pr-bot
Copy link
Copy Markdown
Collaborator

@csg-pr-bot csg-pr-bot commented May 6, 2026

Summary:

  • Implemented a DeployRunningCallback mechanism to automatically trigger performance benchmarks when a serverless deployment enters the Running state, addressing the inability to assess concurrent throughput limits.
  • Added a benchmark activity that uses binary search to determine optimal concurrency, validating success rates, P95 latency, and TPM thresholds, with results stored in a database.

@csg-pr-bot
Copy link
Copy Markdown
Collaborator Author

csg-pr-bot commented May 6, 2026

Depends on #1050

@csg-pr-bot csg-pr-bot mentioned this pull request May 7, 2026
Merged
HaiHui886
HaiHui886 approved these changes May 8, 2026
View reviewed changes
Copy link
Copy Markdown
Collaborator

@HaiHui886 HaiHui886 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

lgtm

@HaiHui886 HaiHui886 merged commit 3116ed2 into main May 8, 2026
7 checks passed
@HaiHui886 HaiHui886 deleted the sync_mr_2474_2a5fb0a branch May 8, 2026 08:20
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@HaiHui886 HaiHui886 HaiHui886 approved these changes

Assignees

No one assigned

Labels

None yet

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

3 participants

@csg-pr-bot @HaiHui886 @CementZhang