Alexey Kudinkin
60b23b9797
[HUDI-2788] Fixing issues w/ Z-order Layout Optimization (#4026)
* Simplyfying, tidying up
* Fixed packaging for `TestOptimizeTable`
* Cleaned up `HoodiFileIndex` file filtering seq;
Removed optimization manually reading Parquet table circumventing Spark
* Refactored `DataSkippingUtils`:
- Fixed checks to validate all statistics cols are present
- Fixed some predicates being constructed incorrectly
- Rewrote comments for easier comprehension, added more notes
- Tidying up
* Tidying up tests
* `lint`
* Fixing compilation
* `TestOptimizeTable` > `TestTableLayoutOptimization`;
Added assertions to test data skipping paths
* Fixed tests to properly hit data-skipping path
* Fixed pruned files candidates lookup seq to conservatively included all non-indexed files
* Added java-doc
* Fixed compilation
2021-11-24 10:10:28 -08:00
..
2021-11-24 10:10:28 -08:00
2021-11-02 18:25:12 -07:00
2021-11-22 02:16:45 -08:00
2021-11-19 19:38:38 -08:00
2021-08-14 18:51:09 -07:00