Gary Li
452f5e2d66
[HOTFIX] close spark session in functional test suite and disable spark3 test for spark2 ( #2727 )
2021-03-29 06:04:48 -07:00
garyli1019
6e803e08b1
Moving to 0.9.0-SNAPSHOT on master branch.
2021-03-24 21:37:14 +08:00
wenningd
976420c49a
[HUDI-1512] Fix spark 2 unit tests failure with Spark 3 ( #2412 )
...
* [HUDI-1512] Fix spark 2 unit tests failure with Spark 3
* resolve comments
Co-authored-by: Wenning Ding <wenningd@amazon.com >
2021-01-21 07:04:28 -08:00
Vinoth Chandar
3719e7b388
Moving to 0.8.0-SNAPSHOT on master branch.
2021-01-20 11:31:22 -08:00
Sivabalan Narayanan
b9c2856d16
[HUDI-1535] Fix 0.7.0 snapshot ( #2456 )
...
* Revert "[MINOR] Bumping snapshot version to 0.7.0 (#2435 )"
This reverts commit a43e191d6c
2021-01-19 12:20:43 -08:00
Sivabalan Narayanan
a43e191d6c
[MINOR] Bumping snapshot version to 0.7.0 ( #2435 )
2021-01-16 09:56:28 -05:00
wenningd
286055ce34
[HUDI-1451] Support bulk insert v2 with Spark 3.0.0 ( #2328 )
...
Co-authored-by: Wenning Ding <wenningd@amazon.com >
- Added support for bulk insert v2 with datasource v2 api in Spark 3.0.0.
2020-12-25 09:43:34 -05:00
wenningd
fce1453fa6
[HUDI-1040] Make Hudi support Spark 3 ( #2208 )
...
* Fix flaky MOR unit test
* Update Spark APIs to make it be compatible with both spark2 & spark3
* Refactor bulk insert v2 part to make Hudi be able to compile with Spark3
* Add spark3 profile to handle fasterxml & spark version
* Create hudi-spark-common module & refactor hudi-spark related modules
Co-authored-by: Wenning Ding <wenningd@amazon.com >
2020-12-09 15:52:23 -08:00
