[HUDI-1757] Assigns the buckets by record key for Flink writer (#2757)
Currently we assign the buckets by record partition path which could cause hotspot if the partition field is datetime type. Changes to assign buckets by grouping the record whth their key first, the assignment is valid if only there is no conflict(two task write to the same bucket). This patch also changes the coordinator execution to be asynchronous.
This commit is contained in:
@@ -47,7 +47,7 @@ public class ReflectionUtils {
|
||||
|
||||
private static Map<String, Class<?>> clazzCache = new HashMap<>();
|
||||
|
||||
private static Class<?> getClass(String clazzName) {
|
||||
public static Class<?> getClass(String clazzName) {
|
||||
if (!clazzCache.containsKey(clazzName)) {
|
||||
try {
|
||||
Class<?> clazz = Class.forName(clazzName);
|
||||
|
||||
Reference in New Issue
Block a user