Yann Byron
05942e018c
[HUDI-2811] Support Spark 3.2 ( #4270 )
2021-12-28 00:12:44 -08:00
Raymond Xu
02f7ca2b05
[HUDI-1870] Add more Spark CI build tasks ( #4022 )
...
* [HUDI-1870] Add more Spark CI build tasks
- build for spark3.0.x
- build for spark-shade-unbundle-avro
- fix build failures
- delete unnecessary assertion for spark 3.0.x
- use AvroConversionUtils#convertAvroSchemaToStructType instead of calling SchemaConverters#toSqlType directly to solve the compilation failures with spark-shade-unbundle-avro (#5 )
Co-authored-by: Yann <biyan900116@gmail.com >
2021-11-22 02:16:45 -08:00
Yann Byron
1f17467f73
[HUDI-1869] Upgrading Spark3 To 3.1 ( #3844 )
...
Co-authored-by: pengzhiwei <pengzhiwei2015@icloud.com >
2021-11-02 18:25:12 -07:00
zhangyue19921010
73d898322b
[MINOR] Fix travis from errors ( #3432 )
2021-08-10 08:25:49 -07:00
wenningd
91bb0d1318
[HUDI-2255] Refactor Datasource options ( #3373 )
...
Co-authored-by: Wenning Ding <wenningd@amazon.com >
2021-08-03 17:50:30 -07:00
Sivabalan Narayanan
7bdae69053
[HUDI-2253] Refactoring few tests to reduce runningtime. DeltaStreamer and MultiDeltaStreamer tests. Bulk insert row writer tests ( #3371 )
...
Co-authored-by: Sivabalan Narayanan <nsb@Sivabalans-MBP.attlocal.net >
2021-07-29 22:22:26 -07:00
Sivabalan Narayanan
d5026e9a24
[HUDI-2161] Adding support to disable meta columns with bulk insert operation ( #3247 )
2021-07-19 20:43:48 -04:00
Sivabalan Narayanan
8c0dbaa9b3
[HUDI-2009] Fixing extra commit metadata in row writer path ( #3075 )
2021-07-08 03:07:27 -04:00
Sivabalan Narayanan
ea9e5d0e8b
[HUDI-1104] Adding support for UserDefinedPartitioners and SortModes to BulkInsert with Rows ( #3149 )
2021-07-07 11:15:25 -04:00
wangxianghu
b593f10629
[MINOR] Rename unit test package of hudi-spark3 from scala to java ( #2411 )
2021-01-06 23:07:24 +08:00
wenningd
286055ce34
[HUDI-1451] Support bulk insert v2 with Spark 3.0.0 ( #2328 )
...
Co-authored-by: Wenning Ding <wenningd@amazon.com >
- Added support for bulk insert v2 with datasource v2 api in Spark 3.0.0.
2020-12-25 09:43:34 -05:00
