Skip to content

Commit

Permalink
[HUDI-3598] Row Data to Hoodie Record Operator parallelism needs to a…
Browse files Browse the repository at this point in the history
…lways be consistent with input operator (#5049)

for chaining purpose

Co-authored-by: jerryyue <jerryyue@didiglobal.com>
  • Loading branch information
JerryYue-M and jerryyue authored Mar 18, 2022
1 parent 9ece775 commit 6fe4d6e
Showing 1 changed file with 2 additions and 1 deletion.
Original file line number Diff line number Diff line change
Expand Up @@ -246,7 +246,8 @@ private static DataStream<HoodieRecord> boundedBootstrap(
* Transforms the row data to hoodie records.
*/
public static DataStream<HoodieRecord> rowDataToHoodieRecord(Configuration conf, RowType rowType, DataStream<RowData> dataStream) {
return dataStream.map(RowDataToHoodieFunctions.create(rowType, conf), TypeInformation.of(HoodieRecord.class));
return dataStream.map(RowDataToHoodieFunctions.create(rowType, conf), TypeInformation.of(HoodieRecord.class))
.setParallelism(dataStream.getParallelism()).name("row_data_to_hoodie_record");
}

/**
Expand Down

0 comments on commit 6fe4d6e

Please sign in to comment.