Skip to content

Latest commit

 

History

History
33 lines (22 loc) · 1.36 KB

common-options.md

File metadata and controls

33 lines (22 loc) · 1.36 KB

Common Options

Common parameters of source connectors

name type required default value
result_table_name string no -
parallelism int no -

result_table_name [string]

When result_table_name is not specified, the data processed by this plugin will not be registered as a data set (dataStream/dataset) that can be directly accessed by other plugins, or called a temporary table (table) ;

When result_table_name is specified, the data processed by this plugin will be registered as a data set (dataStream/dataset) that can be directly accessed by other plugins, or called a temporary table (table) . The data set (dataStream/dataset) registered here can be directly accessed by other plugins by specifying source_table_name .

parallelism [int]

When parallelism is not specified, the parallelism in env is used by default.

When parallelism is specified, it will override the parallelism in env.

Example

source {
    FakeSourceStream {
        result_table_name = "fake"
    }
}

The result of the data source FakeSourceStream will be registered as a temporary table named fake . This temporary table can be used by any Transform or Sink plugin by specifying source_table_name .