feat(data-pipeline): add concurrent idempotent processing flow#25

W1ndrunn3rr merged 2 commits intomainSolvro/ml-mcp:mainfrom

feat/pipeline-concurrencySolvro/ml-mcp:feat/pipeline-concurrencyCopy head branch name to clipboard