Multi-SWE-Bench: Evaluation Changes#47

Draft

Vladislav0Art wants to merge 67 commits into

mainfrom

vartiukhov/evaluation

Commits on Apr 16, 2026

feat: cherry-pick method renaming with overload families

dragoi75
authored and
Vladislav0Art
committed
feat: add some changes in `configureCodeStyle` (cannot fully prevent unused import optimization)
Vladislav0Art
committed
feat: parameterize `searchInComments` of `RenameProcessor` in all renaming transformations
Vladislav0Art
committed

Commits on Apr 17, 2026

feat: print whitelisted annotations and log whether class/method is whitelisted
Vladislav0Art
committed
feat: print filter-out reason for classes/methods
Vladislav0Art
committed
feat: filter out method overload families + check when super class is `java.lang.Object` (don't filter)
Vladislav0Art
committed
feat: remove Public API Guard filter (allow public API with no refs be renamed)
Vladislav0Art
committed
feat: print override methods in log
Vladislav0Art
committed
feat: separate static and instance methods in overload grouping and filter overrides before grouping
Vladislav0Art
committed
feat: log overload family details in `RenameMethodTransformation`
Vladislav0Art
committed
feat: group overload families by class and improve logging in `RenameMethodTransformation`
Vladislav0Art
committed
feat: add annotation filtering mode (whitelist/blacklist) in `RenameMethodTransformation`
Vladislav0Art
committed
feat: add annotation filtering mode (whitelist/blacklist) in `RenameClassTransformation`
Vladislav0Art
committed
feat: support default blacklist merging and improve blacklist logging in `RenameMethodTransformation`
Vladislav0Art
committed
feat: support default blacklist merging and improve blacklist logging in `RenameClassTransformation`
Vladislav0Art
committed
feat: update readme and agents md files
Vladislav0Art
committed

Commits on Apr 18, 2026

Commits on Apr 21, 2026

feat: Add support for transforming `problem_statement` using transformation memory.

dragoi75
authored and
Vladislav0Art
committed

Commits on Apr 23, 2026

feat: delete transform_metamorphic_texts.py
Vladislav0Art
committed

Commits on Apr 25, 2026

Commits on Apr 27, 2026

Commits on Apr 29, 2026

Commits on May 1, 2026

fix: set `successfullyMoved` to false on found conflicts when tried file move
Vladislav0Art
committed

Commits on May 3, 2026

Commits on May 5, 2026

Commits on May 7, 2026

Commits on May 8, 2026

fix: avoid `IndexNotReadyException` in rename transformations by promoting discovery reads to smart-mode
Vladislav0Art
committed