Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

扩展LogEventConvert中的字段过滤，支持只过滤真正发生变化的字段 #2829

Closed
wants to merge 1 commit into from
Closed

扩展LogEventConvert中的字段过滤，支持只过滤真正发生变化的字段 #2829

wants to merge 1 commit into from

Conversation

guodage
Copy link

@guodage guodage commented Jun 21, 2020

扩展这个fieldFilter的PR #1914

它仅支持当一张表的任意字段发生变更，即便不在过滤字段内，也会sink、store到后续的流程中。

扩展后，对外暴露配置有如下变更

# 增强已有的字段过滤--在后面新增一个`:`，可以自行指定的必要字段（同样也是`/`分隔）
canal.instance.filter.field=dbName.tableName:column4/column5:column2/column3
# 新增配置，控制是否只关心filter字段的变化，不配置时默认false，向前兼容
canal.instance.filter.changed.field=true

这样后续对增量数据的处理有更好的灵活性和准确性。

@CLAassistant
Copy link

CLAassistant commented Jun 21, 2020 •
edited
Loading

CLA assistant check
All committers have signed the CLA.

@guodage guodage closed this Jun 23, 2020
@guodage guodage deleted the canal-1.1.4.OnePiece.1 branch June 23, 2020 03:01
@guodage guodage restored the canal-1.1.4.OnePiece.1 branch June 23, 2020 03:06
@guodage guodage deleted the canal-1.1.4.OnePiece.1 branch June 23, 2020 03:09
@guodage guodage mentioned this pull request Jun 23, 2020
Open
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@SylviaLee89 SylviaLee89 SylviaLee89 left review comments

Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
3 participants
@guodage @CLAassistant @SylviaLee89