Skip to content

sync llm log from oss to dataset#1075

Merged
HaiHui886 merged 1 commit into
mainfrom
sync_mr_2480_2d10879
May 11, 2026
Merged

sync llm log from oss to dataset#1075
HaiHui886 merged 1 commit into
mainfrom
sync_mr_2480_2d10879

Conversation

@csg-pr-bot
Copy link
Copy Markdown
Collaborator

@csg-pr-bot csg-pr-bot commented May 10, 2026

Summary:

  • Syncs LLM request/response logs from OSS to the dataset for training data, enabling scheduled incremental updates and historical data restoration by date range.
  • Introduces a new Temporal workflow for log synchronization, aggregates logs into daily jsonl shards, and adds configuration options for dataset management and cron job registration.

@csg-pr-bot
Copy link
Copy Markdown
Collaborator Author

csg-pr-bot commented May 10, 2026

Depends on #1074

HaiHui886
HaiHui886 approved these changes May 11, 2026
View reviewed changes
Copy link
Copy Markdown
Collaborator

@HaiHui886 HaiHui886 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

lgtm

@HaiHui886 HaiHui886 merged commit b556929 into main May 11, 2026
7 checks passed
@HaiHui886 HaiHui886 deleted the sync_mr_2480_2d10879 branch May 11, 2026 00:56
@csg-pr-bot csg-pr-bot mentioned this pull request May 11, 2026
Merged
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@HaiHui886 HaiHui886 HaiHui886 approved these changes

Assignees

No one assigned

Labels

None yet

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

3 participants

@csg-pr-bot @HaiHui886 @luojun96