Skip to content

Navigation Menu

Appearance settings

View all features
- BY COMPANY SIZE
  Enterprises
  Small and medium teams
  Startups
  Nonprofits
- BY USE CASE
  App Modernization
  DevSecOps
  DevOps
  CI/CD
  View all use cases
- BY INDUSTRY
  Healthcare
  Financial services
  Manufacturing
  Government
  View all industries
View all solutions
- EXPLORE BY TOPIC
  AI
  Software Development
  DevOps
  Security
  View all topics
- EXPLORE BY TYPE
  Customer stories
  Events & webinars
  Ebooks & reports
  Business insights
  GitHub Skills
- SUPPORT & SERVICES
  Documentation
  Customer support
  Community forum
  Trust center
  Partners
View all resources
- COMMUNITY
  GitHub SponsorsFund open source developers
- PROGRAMS
  Security Lab
  Maintainer Community
  Accelerator
  GitHub Stars
  Archive Program
- REPOSITORIES
  Topics
  Trending
  Collections
- ENTERPRISE SOLUTIONS
  Enterprise platformAI-powered developer platform
- AVAILABLE ADD-ONS
  GitHub Advanced SecurityEnterprise-grade security features
  Copilot for BusinessEnterprise-grade AI features
  Premium SupportEnterprise-grade 24/7 support
Pricing

Search code, repositories, users, issues, pull requests...

Search

Clear

Search syntax tips

Provide feedback

We read every piece of feedback, and take your input very seriously.

Include my email address so I can be contacted

Saved searches

Use saved searches to filter your results more quickly

Name

Query

To see all available qualifiers, see our documentation.

Appearance settings

You signed in with another tab or window. Reload to refresh your session. You signed out in another tab or window. Reload to refresh your session. You switched accounts on another tab or window. Reload to refresh your session.

Dismiss alert

wordlift / python-sdk Public

Notifications You must be signed in to change notification settings
Fork 1
Star 1

Code
Issues
Pull requests 1
Actions
Projects
Security
Insights

Additional navigation options

Code
Issues
Pull requests
Actions
Projects
Security
Insights

feat!: concurrency refactor, postprocessors reorganisation, and v7 packaging slices#15

Merged

rpanfili merged 63 commits intomainwordlift/python-sdk:mainfrom

concurrency_refactorwordlift/python-sdk:concurrency_refactorCopy head branch name to clipboard

Mar 23, 2026

Conversation Commits63 (63)Checks Files changed

Merged

feat!: concurrency refactor, postprocessors reorganisation, and v7 packaging slices#15
rpanfili merged 63 commits intomainfrom
concurrency_refactor

Commits

Commits on Mar 20, 2026

chore: vscode excluded by gitignore
rpanfili
committed
fix: run ingestion in executor to avoid blocking event loop
rpanfili
committed
fix: offload postprocessors and validation to executor to prevent blocking event loop
rpanfili
committed
feat: use postprocessor pool for true concurrent processing
rpanfili
committed
fix: increase postprocessor startup timeout from 10s to 60s
rpanfili
committed
debug: add timing instrumentation to mapping, postprocessor, and validation stages
rpanfili
committed
refactor: pre-load SHACL and validate in-memory to avoid I/O
rpanfili
committed
feat: run SHACL validation in a process pool to bypass GIL and parallelize across CPUs
rpanfili
committed
feat: add separate pool size settings for postprocessors and SHACL validation
rpanfili
committed
feat: track SHACL process pool queue wait and execution time separately in timing log
rpanfili
committed
feat: add inprocess postprocessor runtime for running processors in the same process
rpanfili
committed
feat: run postprocessors on a dedicated thread pool instead of the default executor
rpanfili
committed
fix: handle SHACL process pool timeout and broken executor errors gracefully
rpanfili
committed
fix: offload graph hashing to executor to avoid blocking the event loop
rpanfili
committed
fix: enable stop_after_attempt(5) retry limit on graph queue put
rpanfili
committed
fix: disable morph_kgc internal multiprocessing to prevent fork deadlocks in threaded context
rpanfili
committed
fix: offload RML mapping to dedicated thread pool to prevent blocking the event loop
rpanfili
committed
fix: serialize morph_kgc calls with a lock to prevent thread-safety issues in pyparsing
rpanfili
committed
Revert "fix: offload RML mapping to dedicated thread pool to prevent blocking the event loop"
rpanfili
committed
perf: run morph_kgc in a subprocess pool for true parallelism without pyparsing lock contention
rpanfili
committed
perf: expose morph_kgc pool size setting and track subprocess queue wait in timing log
rpanfili
committed
fix: read morph_kgc queue wait from worker thread via closure to avoid thread-local race
rpanfili
committed
perf: reuse a single persistent ApiClient across requests instead of creating one per graph
rpanfili
committed
fix: create ApiClient directly on the event loop thread instead of in an executor
rpanfili
committed
refactor: make load_shapes_graph and normalize_schema_org_uris public in shacl module
rpanfili
committed
feat: add ShaclValidationService to validation package
rpanfili
committed
refactor: wire ShaclValidationService into ProfileImportProtocol
rpanfili
committed
refactor: delegate load_postprocessors_for_profile to load_postprocessors
rpanfili
committed
refactor: replace runtime string constants with PostprocessorRuntime enum
rpanfili
committed
fix: remove to_xhtml from public contract of RmlMappingService
rpanfili
committed
refactor: extract Closeable protocol and use isinstance check in close_loaded_postprocessors
rpanfili
committed
refactor: split SubprocessPostprocessor into Oneshot and Persistent variants
rpanfili
committed
refactor: introduce PostprocessorResult and remove dead _apply_postprocessors
rpanfili
committed
refactor: extract PostprocessorService from ProfileImportProtocol
rpanfili
committed
fix+refactor: inject MaterializationPipeline/HtmlConverter and fix TLS attribute name
rpanfili
committed
refactor: wire _setting helper into __init__ to eliminate nested .get() chains
rpanfili
committed
refactor: extract _init_postprocessor_service/_mapping_executor/_shacl_validator from __init__
rpanfili
committed
refactor: split callback into _run_mapping_stage and _run_postprocessing_stage
rpanfili
committed
refactor: move canonical_id_strategy and _core_ids into _init_postprocessor_service
rpanfili
committed
refactor: move RmlMappingService construction into _init_mapping_service
rpanfili
committed
refactor: extract _init_graph_writer, moving patcher and import_hash_mode together
rpanfili
committed
refactor(kg_build): decompose ProfileImportProtocol.__init__ and reduce class surface
rpanfili
committed
refactor: extract RootIdReconcilerPostprocessor from protocol._reconcile_root_id
rpanfili
committed
refactor: extract ImportAnnotationPostprocessor
rpanfili
committed
refactor: make PostprocessorService profile-agnostic, unify postprocessor pipeline
rpanfili
committed
refactor: extract first_level_subjects into graph_utils helper
rpanfili
committed
refactor: drop redundant tuple from _run_postprocessing_stage
rpanfili
committed
refactor: extract _dataset_uri property and _url_hash helper
rpanfili
committed
refactor: simplify record_validation to accept ValidationOutcome directly
rpanfili
committed
refactor: reorganise into postprocessors/ subpackage
rpanfili
committed
rename: runner.py → oneshot.py, worker.py → persistent.py
rpanfili
committed
fix: close GraphQueue ApiClient on protocol shutdown
rpanfili
committed
feat(tests): align kg_build tests with refactored protocol and postprocessor API
rpanfili
committed
feat(tests): reorganise kg_build tests to mirror source package structure
rpanfili
committed
fix: update kg_build __init__ export paths after postprocessors reorganisation
rpanfili
committed
fix: update engine tests to mock at pool level after morph_kgc moved to subprocess
rpanfili
committed
fix(slicing): remap stdlib-only lazy exports to modules with real deps so the guard fires correctly
rpanfili
committed
fix(tests): make lazy export tests slice-independent by stubbing heavy-dep modules
rpanfili
committed
fix(slicing): defer legacy import in create_google_search_console_data_import to avoid gql at collection time
rpanfili
committed
fix(slicing): remove test_ingestion_source_bridge from ingestion slice — needs legacy (gql)
rpanfili
committed
fix(slicing): add python-liquid to workflow extra (needed by graph.ttl_liquid)
rpanfili
committed
fix: v7 integration fixes
rpanfili
committed
chore: bump to v8.0.0
rpanfili
committed

Footer

© 2026 GitHub, Inc.

Footer navigation

Terms
Privacy
Security
Status
Community
Docs
Contact

You can’t perform that action at this time.