Manoj Govindassamy f6326693ef [HUDI-1295] Hash ID generator util for Hudi table columns, partition and files (#3884) ...

* [HUDI-1295] Hash ID generator util for Hudi table columns, partition and files

- Adding a new utility class HashID to generate 32,64,128 bits hashes for any
  given message of string or byte array type. This class internally uses
  MessageDigest and xxhash libraries.

- Adding stateful hash holders for Hudi table columns, partition and files to
  pass around for metaindex and to convert to base64encoded strings whenever
  needed

2021-10-29 19:19:38 -04:00

8.6 KiB

Raw Blame History

View Raw