Skip to content

Improve acceptance tests#782

Merged
peanball merged 15 commits intocloudfoundry:masterfrom
sap-contributions:improve-acceptance-tests
Apr 9, 2025
Merged

Improve acceptance tests#782
peanball merged 15 commits intocloudfoundry:masterfrom
sap-contributions:improve-acceptance-tests

Conversation

@mtekel
Copy link
Copy Markdown
Contributor

@mtekel mtekel commented Apr 1, 2025

Fix tech debt on acceptance tests:

  • remove unused bpm

Improve runtime/user friendliness for development and debug:

  • use local/cached testflight image
  • DRY wrapper scripts
  • run with "dirty" git
  • add persistence for containers (bosh stays running)
  • optimise speed (compilation = 2, working overlay2 in bosh docker for internal docker)
  • apply shellcheck recommended fixes

Update docs.

mtekel and others added 9 commits March 20, 2025 15:32
BPM release and version is now specified in haproxy manifest.
There is no need to handle it in a custom way.
This is to avoid rebuilding image on every local run.
Put common functions into a file that can be sourced by scripts that need them.
When developing, do not check for clean repository.
Run only on one node when specifying focus. This is to
simplifly debug.

co-authored-by: Alexander Lais <alexander.lais@sap.com>
Copy link
Copy Markdown
Contributor

@peanball peanball left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Added some articles to the text, will try out on the dev-box. But it looks very promising. I like the name KEEP_RUNNING and that it auto-enables when you run a test in focus mode.

Comment thread acceptance-tests/README.md Outdated
Comment thread acceptance-tests/README.md Outdated
Comment thread acceptance-tests/README.md Outdated
Comment thread acceptance-tests/README.md Outdated
Comment thread acceptance-tests/README.md Outdated
Comment thread acceptance-tests/run-local.sh
Comment thread ci/scripts/functions-ci.sh
peanball
peanball previously approved these changes Apr 7, 2025
Copy link
Copy Markdown
Contributor

@peanball peanball left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

some very minor comments still left. Everything should work as is though.

Comment thread ci/scripts/functions-ci.sh
Comment thread ci/scripts/start-bosh.sh Outdated
@github-project-automation github-project-automation Bot moved this from Inbox to Pending Merge | Prioritized in Application Runtime Platform Working Group Apr 7, 2025
mtekel and others added 5 commits April 7, 2025 12:02
When doing manual debug, we want bosh container to keep running,
so that we can easily run multiple focused tests.
Creating VMs with docker-cpi, when running in docker, is I/O heavy and slow.
There is no need for 5 compilation VMs, there is not much to compile in this release.

Reduce to 2 to speed up deployment (and overall acceptance tests run time).
Mouting ext4 scratch inside docker means that internal docker can
run overlay2 filesystem, meaning it doesn't need to copy data on
container creation like with VFS.
Reflect updated scripts and describe new persistence options.
Co-authored-by: Alexander Lais <Alexander.lais@me.com>
@mtekel mtekel force-pushed the improve-acceptance-tests branch 2 times, most recently from 084ac4f to 21ae00c Compare April 7, 2025 11:51
peanball
peanball previously approved these changes Apr 8, 2025
Copy link
Copy Markdown
Contributor

@peanball peanball left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

very minor nit about the (pre-existing) use of a weird manifest trimming thing by counting lines, instead of head -n -4 to cut the last 4 lines.

Comment thread ci/scripts/update-manifest Outdated
SC2086 (info): Double quote to prevent globbing and word splitting.
and similar.

Note that in some cases scripts do depend on various side effect,
so not all SC recommendations are applied.
@peanball peanball added the run-ci Allow this PR to be tested on Concourse label Apr 9, 2025
@peanball peanball enabled auto-merge (rebase) April 9, 2025 08:11
@peanball peanball merged commit 3e42ca3 into cloudfoundry:master Apr 9, 2025
4 checks passed
@github-project-automation github-project-automation Bot moved this from Pending Merge | Prioritized to Done in Application Runtime Platform Working Group Apr 9, 2025
@mtekel mtekel deleted the improve-acceptance-tests branch April 9, 2025 08:48
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

run-ci Allow this PR to be tested on Concourse

Projects

Development

Successfully merging this pull request may close these issues.

2 participants