lanyuanxiaoyao/hudi
1
0
Fork 0
Code Activity

[HUDI-3598] Row Data to Hoodie Record Operator parallelism needs to always be consistent with input operator (#5049)

Browse Source 
for chaining purpose

Co-authored-by: jerryyue <jerryyue@didiglobal.com>
This commit is contained in:
JerryYue-M
2022-03-18 10:47:29 +08:00
committed by GitHub
parent 9ece77561a
commit 6fe4d6e2f6
1 changed files with 2 additions and 1 deletions
Download Patch File Download Diff File Expand all files Collapse all files

3
hudi-flink/src/main/java/org/apache/hudi/sink/utils/Pipelines.java
View File

@@ -246,7 +246,8 @@ public class Pipelines {
* Transforms the row data to hoodie records. * Transforms the row data to hoodie records.
*/ */
public static DataStream<HoodieRecord> rowDataToHoodieRecord(Configuration conf, RowType rowType, DataStream<RowData> dataStream) { public static DataStream<HoodieRecord> rowDataToHoodieRecord(Configuration conf, RowType rowType, DataStream<RowData> dataStream) {
return dataStream.map(RowDataToHoodieFunctions.create(rowType, conf), TypeInformation.of(HoodieRecord.class)); return dataStream.map(RowDataToHoodieFunctions.create(rowType, conf), TypeInformation.of(HoodieRecord.class))
.setParallelism(dataStream.getParallelism()).name("row_data_to_hoodie_record");
} }
/** /**