Dongwook 8d19ebfd0f [HUDI-993] Let delete API use "hoodie.delete.shuffle.parallelism" (#1703) ...

For Delete API, "hoodie.delete.shuffle.parallelism" isn't used as opposed to "hoodie.upsert.shuffle.parallelism" is used for upsert, this creates the performance difference between delete by upsert API with "EmptyHoodieRecordPayload" and delete API for certain cases.

This patch makes the following fixes in this regard. 
- Let deduplicateKeys method use "hoodie.delete.shuffle.parallelism"
- Repartition inputRDD as "hoodie.delete.shuffle.parallelism" in case "hoodie.combine.before.delete=false"

2020-09-01 12:55:31 -04:00

..

test-suite

[HUDI-993] Let delete API use "hoodie.delete.shuffle.parallelism" (#1703)

2020-09-01 12:55:31 -04:00

base.properties

[HUDI-993] Let delete API use "hoodie.delete.shuffle.parallelism" (#1703)

2020-09-01 12:55:31 -04:00

dfs-source.properties

[HUDI-580] Fix incorrect license header in files

2020-02-25 08:54:26 -08:00

hoodie-incr.properties

[HUDI-993] Let delete API use "hoodie.delete.shuffle.parallelism" (#1703)

2020-09-01 12:55:31 -04:00

hoodie-schema.avsc

[HUDI-703] Add test for HoodieSyncCommand (#1774)

2020-07-28 08:31:43 +08:00

kafka-source.properties

[HUDI-580] Fix incorrect license header in files

2020-02-25 08:54:26 -08:00

log4j.properties

[MINOR] Suppressing spark logs for hudi-integ and hudi-utilities (#1894)

2020-07-31 19:01:25 -07:00

schema.avsc

[HUDI-249] Update Release-notes. Add sign-artifacts to POM and release related scripts. Add missing license headers

2019-09-13 08:41:29 -07:00

spark-defaults.conf

Docker Container Build and Run setup with foundations for adding docker integration tests. Docker images built with Hadoop 2.8.4 Hive 2.3.3 and Spark 2.3.1 and published to docker-hub

2018-10-02 09:28:21 +05:30