Skip to content

test: stabilize comparator avoid delta assertion#218

Merged
cafitac merged 1 commit intomainfrom
test/stabilize-comparator-matrix-avoid-delta-after-restore-fingerprint
May 7, 2026
Merged

test: stabilize comparator avoid delta assertion#218
cafitac merged 1 commit intomainfrom
test/stabilize-comparator-matrix-avoid-delta-after-restore-fingerprint

Conversation

@cafitac
Copy link
Copy Markdown
Owner

@cafitac cafitac commented May 7, 2026

Summary

  • Stabilize the retrieval comparator matrix avoid-delta assertion for Linux/SQLite FTS variance seen after PR feat: source-bind query preview cleanup restore dry run #216 merged to main.
  • Keep strict baseline matrix counts while allowing a bounded +1 avoid-delta only for baseline modes with no baseline avoid hits.

Test Plan

  • uv run pytest tests/test_retrieval_evaluation.py::test_checked_in_retrieval_fixture_examples_have_stable_comparator_matrix -q
  • uv run pytest tests/ -q
  • uv run ruff check src tests
  • git diff --check

Notes

@cafitac cafitac merged commit cee89b6 into main May 7, 2026
2 checks passed
@cafitac cafitac deleted the test/stabilize-comparator-matrix-avoid-delta-after-restore-fingerprint branch May 7, 2026 15:55
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant