Alexey Kudinkin
60b23b9797
[HUDI-2788] Fixing issues w/ Z-order Layout Optimization (#4026)
* Simplyfying, tidying up
* Fixed packaging for `TestOptimizeTable`
* Cleaned up `HoodiFileIndex` file filtering seq;
Removed optimization manually reading Parquet table circumventing Spark
* Refactored `DataSkippingUtils`:
- Fixed checks to validate all statistics cols are present
- Fixed some predicates being constructed incorrectly
- Rewrote comments for easier comprehension, added more notes
- Tidying up
* Tidying up tests
* `lint`
* Fixing compilation
* `TestOptimizeTable` > `TestTableLayoutOptimization`;
Added assertions to test data skipping paths
* Fixed tests to properly hit data-skipping path
* Fixed pruned files candidates lookup seq to conservatively included all non-indexed files
* Added java-doc
* Fixed compilation
2021-11-24 10:10:28 -08:00
..
2021-11-24 10:05:36 -08:00
2021-11-24 17:34:42 +08:00
2021-11-23 14:23:28 +05:30
2021-11-24 10:10:28 -08:00
2021-08-14 18:51:09 -07:00