Skip to content

Add --suites filter to generate_reference_results#728

Open
Geethapranay1 wants to merge 1 commit intoprecice:developfrom
Geethapranay1:fix/issue-711
Open

Add --suites filter to generate_reference_results#728
Geethapranay1 wants to merge 1 commit intoprecice:developfrom
Geethapranay1:fix/issue-711

Conversation

@Geethapranay1
Copy link
Contributor

@Geethapranay1 Geethapranay1 commented Feb 27, 2026

Closes #711

Changes

  1. tools/tests/generate_reference_results.py — added --suites argument (comma-separated, optional) to filter which test suites to generate reference results for. When not provided, all suites run (backward compatible).
  2. generate_reference_results_workflow.yml — added optional suites input. When provided, passes --suites to the script and uses selective git add --update to only commit modified files. When empty, behavior is unchanged.
  3. generate_reference_results_manual.yml — added suites input field for the manual trigger UI.

Testing

1. full docker test passed for --suites filter
Screenshot From 2026-02-26 17-56-26

only 3 elastic tube tests ran not all 10

2. error handling for invalid suite name
image

3. backward compatible default behavior (no --suites)
Screenshot From 2026-02-26 18-09-55

4. --help shows a new argument
image

Checklist:

  • I added a summary of any user-facing changes (compared to the last release) in the changelog-entries/<711>.md.
  • I will remember to squash-and-merge, providing a useful summary of the changes of this PR.

@Geethapranay1
Copy link
Contributor Author

hi @MakisH
this pr solves the #711 issue.
check once and let me know if any further requirements needed in the pr.

@MakisH MakisH added GSoC Contributed in the context of the Google Summer of Code systemtests labels Feb 27, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

GSoC Contributed in the context of the Google Summer of Code systemtests

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Workflow to generate reference results always updates all cases

2 participants