Skip to content

Add chaos testing scripts and verification scenarios for SQLite and SQL Server#81

Closed
isdaniel wants to merge 4 commits into
mainfrom
chore/add-sqlserver-sqlite-integration-test
Closed

Add chaos testing scripts and verification scenarios for SQLite and SQL Server#81
isdaniel wants to merge 4 commits into
mainfrom
chore/add-sqlserver-sqlite-integration-test

Conversation

@isdaniel
Copy link
Copy Markdown
Owner

  • Introduced scenario5_verify.sql to verify high-volume data replication (3M rows) in SQL Server.
  • Created run_chaos_tests_sqlite.sh for executing chaos tests with SQLite as the destination.
  • Developed run_chaos_tests_sqlserver.sh for executing chaos tests with SQL Server as the destination.
  • Implemented run_pgbench_chaos_test_sqlite.sh for performance testing with pgbench on SQLite.
  • Implemented run_pgbench_chaos_test_sqlserver.sh for performance testing with pgbench on SQL Server.
  • Added logging and cleanup functionalities to all scripts for better traceability and resource management.

…QL Server

- Introduced `scenario5_verify.sql` to verify high-volume data replication (3M rows) in SQL Server.
- Created `run_chaos_tests_sqlite.sh` for executing chaos tests with SQLite as the destination.
- Developed `run_chaos_tests_sqlserver.sh` for executing chaos tests with SQL Server as the destination.
- Implemented `run_pgbench_chaos_test_sqlite.sh` for performance testing with pgbench on SQLite.
- Implemented `run_pgbench_chaos_test_sqlserver.sh` for performance testing with pgbench on SQL Server.
- Added logging and cleanup functionalities to all scripts for better traceability and resource management.
Copy link
Copy Markdown

@gemini-code-assist gemini-code-assist Bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Code Review

This pull request introduces comprehensive chaos and performance testing infrastructure for the CDC application, specifically targeting SQLite and SQL Server destinations. Changes include updated Docker configurations, environment files, and a suite of shell scripts and SQL scenarios to automate testing under adverse conditions. Feedback focuses on ensuring LSN metadata persistence across container restarts, fixing a logic error in the SQLite verification SQL, improving shell script robustness by avoiding ls parsing, and addressing security concerns regarding the exposure of database passwords in process lists and connection strings.

Comment thread docker-compose.chaos-test-sqlite.yml Outdated
Comment thread docker-compose.chaos-test-sqlserver.yml Outdated
Comment thread tests/chaos/scenarios/verify_sqlite/scenario5_verify.sql Outdated
Comment thread tests/chaos/scripts/run_chaos_tests_sqlite.sh Outdated
Comment thread tests/chaos/scripts/run_chaos_tests_sqlserver.sh Outdated
Comment thread tests/chaos/scripts/run_pgbench_chaos_test_sqlite.sh Outdated
@isdaniel
Copy link
Copy Markdown
Owner Author

/gemini review

Copy link
Copy Markdown

@gemini-code-assist gemini-code-assist Bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Code Review

This pull request introduces comprehensive chaos and performance testing infrastructure for SQL Server and SQLite destinations, including new Docker Compose configurations, environment files, and automated test runners. The changes also update the build process to support feature-based compilation. Feedback focuses on enhancing the security and robustness of the testing scripts by recommending the removal of hardcoded credentials in the Makefile, improving environment variable loading logic, and ensuring proper quoting of command paths in shell scripts to prevent execution errors.

Comment thread Makefile
Comment thread tests/chaos/scripts/run_chaos_tests_sqlite.sh
Comment thread tests/chaos/scripts/run_chaos_tests_sqlserver.sh
Comment thread tests/chaos/scripts/run_pgbench_chaos_test_sqlserver.sh
@isdaniel isdaniel closed this Apr 27, 2026
@isdaniel isdaniel deleted the chore/add-sqlserver-sqlite-integration-test branch April 27, 2026 06:54
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant