Skip to content

[PDR-16375][feat(sdk)]: 采集框架相关功能点补充#82

Open
PapaPiya wants to merge 1 commit intoqiniu:sdk-v2from
PapaPiya:opt_flume
Open

[PDR-16375][feat(sdk)]: 采集框架相关功能点补充#82
PapaPiya wants to merge 1 commit intoqiniu:sdk-v2from
PapaPiya:opt_flume

Conversation

@PapaPiya
Copy link
Copy Markdown

@PapaPiya PapaPiya commented Jan 26, 2022

Fixes PDR-XXX

Changes

  • source增加meta管理
  • supervisor由collector生成,并管理所有runner
  • pandora sink错误处理
  • 打点token更新
  • log4j -> log4j2
  • 一些小的bug修复

Reviewers

  • @[someone] please review
  • @[someotherone] please review

Checklist

  • Rebased/mergable
  • Tests pass
  • CHANGELOG.md updated
  • Jira issue/task done

@@ -0,0 +1,6 @@
package com.qiniu.pandora.collect.runner.model;

public class MetaData {
Copy link
Copy Markdown
Collaborator

@warsky007 warsky007 Jan 28, 2022

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

我觉得MetaData定义成String比较好
configure的时候可以通过source.metaData="xxx"传递给source,然后由source进行解析,我们再提供一个接口供客户持久化metaData,入参还是个string,至于持久化的方式客户是不关心的。
也就是说我们不关心metaData是什么格式,也不去处理metaData,完全由source来处理
当前的方案我觉得我们要做的事情有点多

@PapaPiya PapaPiya force-pushed the opt_flume branch 10 times, most recently from 0a12cd4 to 74c52ab Compare February 14, 2022 05:02
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants