Hotfix/celery import issues

[Prajna1999]

Summary

Target issue is #PLEASE_TYPE_ISSUE_NUMBER
Explain the motivation for making this change. What existing problem does the pull request solve?

Checklist

Before submitting a pull request, please ensure that you mark these task.

• Ran fastapi run --reload app/main.py or docker compose up in the repository root and test.
• If you've fixed a bug or added code that is tested and has test cases.

Notes

Please add here if any other information is required for the reviewer.

Summary by CodeRabbit

• Refactor
  • Optimized task execution system for improved performance and reliability.
  • Enhanced task function initialization process.

[coderabbitai]

Caution

Review failed

Pull request was closed or merged during review

📝 Walkthrough

Walkthrough

This PR removes the Celery worker startup warmup mechanism and refactors job execution to use a static function registry instead of dynamic imports, while deferring task function imports from module load time to call time.

Changes

Cohort / File(s)	Summary
Warmup Mechanism Removal backend/app/celery/celery_app.py	Deleted _JOB_MODULES list, importlib import, and warmup_job_modules signal handler that pre-imported job modules during worker startup.
Static Registry Pattern backend/app/celery/tasks/job_execution.py	Introduced _FUNCTION_REGISTRY dispatch table mapping function paths to pre-imported callables, replacing dynamic importlib.import_module + getattr resolution in _execute_job_internal.
Lazy Task Imports backend/app/celery/utils.py	Moved task function imports (execute_high_priority_task, execute_low_priority_task) from module-level to function-level in start_high_priority_job and start_low_priority_job.

Estimated code review effort

🎯 3 (Moderate) | ⏱️ ~20 minutes

Possibly related PRs

• fix: import celery issues #703 — Introduced the worker startup warmup mechanism (_JOB_MODULES and warmup_job_modules) that this PR now removes.

Suggested reviewers

• kartpop

Poem

🐰 The warmup is gone, the registry arrives,
Static dispatch makes job execution thrive,
Lazy imports dance at call-time's door,
No more pre-loading—simpler than before! ✨

🚥 Pre-merge checks | ✅ 3

✅ Passed checks (3 passed)

Check name	Status	Explanation
Description Check	✅ Passed	Check skipped - CodeRabbit’s high-level summary is enabled.
Title check	✅ Passed	The title 'Hotfix/celery import issues' directly relates to the changeset, which removes Celery import mechanisms and replaces dynamic imports with static dispatch table to address import-related problems.
Docstring Coverage	✅ Passed	Docstring coverage is 100.00% which is sufficient. The required threshold is 80.00%.

_{✏️ Tip: You can configure your own custom pre-merge checks in the settings.}

✨ Finishing Touches

📝 Generate docstrings

• Create stacked PR
• Commit on current branch

🧪 Generate unit tests (beta)

• Create PR with unit tests
• Commit unit tests in branch hotfix/celery-import-issues

📝 Coding Plan

• Generate coding plan for human review comments

---

Thanks for using CodeRabbit! It's free for OSS, and your support helps us grow. If you like it, consider giving us a shout-out.

❤️ Share

• X
• Mastodon
• Reddit
• LinkedIn

_{Comment @coderabbitai help to get the list of available commands and usage tips.}