This website requires JavaScript.
33436aa359
Revert "[HUDI-2677] Add DFS based message queue for flink writer (#3915 )" (#3923 )
2021-11-04 20:48:57 +08:00
dbf8c44bdb
[HUDI-2677] Add DFS based message queue for flink writer (#3915 )
2021-11-04 18:09:00 +08:00
689020f303
[HUDI-2684] Use DefaultHoodieRecordPayload when precombine field is specified specifically (#3922 )
2021-11-04 16:23:36 +08:00
8932c4f7b5
[HUDI-2678] flink writer writes huge log file (#3916 )
2021-11-03 22:12:49 +08:00
acc40625f5
[HUDI-2676] Hudi should synchronize owner information to hudi _rt/_ro table. (#3911 )
2021-11-03 20:36:01 +08:00
f2fb1aac26
[HUDI-2509] OverwriteNonDefaultsWithLatestAvroPayload doesn`t work when upsert data with some null value column (#3761 )
2021-11-03 20:23:40 +08:00
7fc7e9b2bc
[HUDI-2660] Delete the view storage properties first before creation (#3899 )
2021-11-03 14:30:20 +08:00
5517d292f9
[HUDI-2674] hudi hive reader should not print read values. (#3910 )
2021-11-03 11:10:18 +08:00
b12a25b0b1
[MINOR] Fixed RAT config for "hudi-utilities-bundle" to ignore transient build-bound artifiacts (#3909 )
2021-11-02 20:06:26 -07:00
6351e5f4d0
[HUDI-2538] persist some configs to hoodie.properties when the first write (#3823 )
2021-11-03 10:04:23 +08:00
1f17467f73
[HUDI-1869] Upgrading Spark3 To 3.1 (#3844 )
2021-11-03 09:25:12 +08:00
dee3a14aae
[HUDI-2582] Support concurrent key gen for different tables with row writer path (#3817 )
2021-11-03 06:05:09 +08:00
d194643b49
[HUDI-2101][RFC-28] support z-order for hudi (#3330 )
2021-11-03 00:31:57 +08:00
f9bc3e03e5
[MINOR] Adding a deprecated constructor to AbstractSyncHoodieClient (#3902 )
2021-11-02 12:16:38 -04:00
f239187da8
[HUDI-2515] Add close when producing records failed (#3746 )
2021-11-02 19:43:20 +08:00
2eaf0fd939
[HUDI-2472] Enabling Metadata table for some of TestCleaner unit tests (#3803 )
2021-11-02 03:54:36 -07:00
35111131c3
[HUDI-2005] Fixing partition path creation in AbstractTableFileSystemView (#3769 )
2021-11-02 00:16:45 -04:00
5302b9a4ef
[HUDI-2662] Downloads from Nexus Pentaho repo taking too long (#3901 )
2021-11-02 04:44:48 +05:30
13b637ddc3
[HUDI-2643] Remove duplicated hbase-common with tests classifier exists in bundles (#3886 )
2021-11-01 20:11:00 +08:00
87c6f9cd07
[HUDI-2654] Add compaction failed event(part2) (#3896 )
2021-10-31 17:51:11 +08:00
92a3c458bd
[HUDI-2654] Schedules the compaction from earliest for flink (#3891 )
2021-10-30 08:37:30 +08:00
f6326693ef
[HUDI-1295] Hash ID generator util for Hudi table columns, partition and files (#3884 )
2021-10-29 16:19:38 -07:00
5b1992a92d
[HUDI-1500] Support replace commit in DeltaSync with commit metadata preserved (#3802 )
2021-10-29 22:39:09 +05:30
29574af239
[HUDI-2573] Fixing double locking with multi-writers (#3827 )
2021-10-29 12:14:39 -04:00
69ee790a47
[HUDI-1294] Adding inline read and seek based read(batch get) for hfile log blocks in metadata table (#3762 )
2021-10-29 12:12:44 -04:00
0223c442ec
[HUDI-2502] Refactor index in hudi-client module (#3778 )
2021-10-28 01:16:00 -07:00
e5b6b8602c
[HUDI-2633] Make precombine field optional for flink (#3874 )
2021-10-28 13:52:06 +08:00
af3ffe5e42
[MINOR] Add links to all the existing RFCs in rfc/README.md (#3876 )
2021-10-27 05:25:19 -07:00
909c3ba45e
[HUDI-2632] Schema evolution for flink parquet reader (#3872 )
2021-10-27 20:00:24 +08:00
ae000795d7
[HUDI-1475]: fixed java doc for precombine api (#3867 )
2021-10-27 03:45:20 +05:30
643b1a4df2
[MINOR] Fix README for hudi-kafka-connect (#3858 )
2021-10-26 14:45:52 -07:00
b1c4acf0ae
[HUDI-2614] Remove duplicated hadoop-hdfs with tests classifier exists in bundles (#3864 )
2021-10-26 22:36:10 +08:00
e3fc74668f
[HUDI-2625] Revert "[HUDI-2005] Avoiding direct fs calls in HoodieLogFileReader (#3757 )" (#3863 )
2021-10-25 21:43:15 -04:00
4b5512e685
[MINOR] Fix typo,'deseralized' corrected to 'deserialized' & 'Kyro' corrected to 'Kryo' (#3846 )
2021-10-25 21:56:47 +08:00
220bf6a7e6
[HUDI-2600] Remove duplicated hadoop-common with tests classifier exists in bundles (#3847 )
2021-10-25 13:45:28 +08:00
1bb0532563
[HUDI-2005] Avoiding direct fs calls in HoodieLogFileReader (#3757 )
2021-10-25 01:21:08 -04:00
d8560377c3
[HUDI-2077] Fix TestHoodieDeltaStreamerWithMultiWriter (#3849 )
2021-10-24 21:14:39 -07:00
91845e241d
[MINOR] Show source table operator details on the flink web when reading hudi table (#3842 )
2021-10-24 23:18:01 +08:00
c9d641cc30
[HUDI-2468] Metadata table support for rolling back the first commit (#3843 )
2021-10-23 07:07:09 -07:00
5ed35bff83
[HUDI-2501] Add HoodieData abstraction and refactor compaction actions in hudi-client module (#3741 )
2021-10-22 12:58:51 -07:00
1e285dc399
[HUDI-2489]Tuning HoodieROTablePathFilter by caching hoodieTableFileSystemView, aiming to reduce unnecessary list/get requests (#3719 )
2021-10-23 00:03:58 +08:00
499af7c039
[HUDI-2592] Fix write empty array when write.precombine.field is decimal type (#3837 )
2021-10-22 19:42:13 +08:00
84ca981cd0
[HUDI-2553] Metadata table compaction trigger max delta commits (#3794 )
2021-10-21 10:09:37 -07:00
b480294e79
[HUDI-2507] Generate more dependency list file for other bundles (#3773 )
2021-10-21 14:10:01 +08:00
aa3c4ecda5
[HUDI-2583] Refactor TestWriteCopyOnWrite test cases (#3832 )
2021-10-21 12:36:41 +08:00
f5d7362ee8
[HUDI-2077] Fix flakiness in TestHoodieDeltaStreamer (#3829 )
2021-10-20 20:57:12 -07:00
b68c5a68f9
[HUDI-2472] Fix few Cleaner tests with metadata table enabled (#3825 )
2021-10-20 15:57:00 -07:00
e355ab52db
[HUDI-2578] Support merging small files for flink insert operation (#3822 )
2021-10-20 21:10:07 +08:00
3686c25fae
[HUDI-2469] [Kafka Connect] Replace json based payload with protobuf for Transaction protocol. (#3694 )
2021-10-19 14:29:48 -07:00
46f0496a08
[MINOR] Fix typo,'intance' corrected to 'instance' (#3788 )
2021-10-19 23:16:48 +08:00
1e2be85a0f
[HUDI-2482] support 'drop partition' sql (#3754 )
2021-10-19 22:09:53 +08:00
60d4cb505a
[MINOR] Fix typo, 'upsert' corrected to 'insert' in java write example (#3809 )
2021-10-19 20:04:18 +08:00
3a78be9203
[HUDI-2572] Strength flink compaction rollback strategy (#3819 )
2021-10-19 10:47:38 +08:00
335e80ea1b
[HUDI-2561] BitCaskDiskMap - avoiding hostname resolution when logging messages (#3811 )
2021-10-18 10:07:53 -07:00
588a34aa95
[HUDI-2571] Remove include-flink-sql-connector-hive profile from flink bundle (#3818 )
2021-10-18 17:34:49 +08:00
dfdfbbedae
HUDI-2569 shaded hive (#3816 )
2021-10-18 17:12:13 +08:00
3025f4d796
[HUDI-2568] Simplify the view storage config properties (#3815 )
2021-10-18 14:42:33 +08:00
5276850415
[HUDI-2557] Shade javax.servlet for flink bundle jar (#3807 )
2021-10-18 11:26:21 +08:00
2eda3de7f9
[HUDI-2562] Embedded timeline server on JobManager (#3812 )
2021-10-18 10:45:39 +08:00
9aa7cfb802
[MINOR] fix typo,'seprarated' corrected to 'separated' (#3789 )
2021-10-16 04:26:16 +08:00
2c370cbae0
[HUDI-2556] Tweak some default config options for flink (#3800 )
2021-10-14 19:42:56 +08:00
f897e6d73e
[HUDI-2551] Support DefaultHoodieRecordPayload for flink (#3792 )
2021-10-14 13:46:53 +08:00
abf3e3fe71
[HUDI-2548] Flink streaming reader misses the rolling over file handles (#3787 )
2021-10-14 10:36:18 +08:00
cff384d23f
[HUDI-2552] Fixing some test failures to unblock broken CI master (#3793 )
2021-10-13 18:44:43 -04:00
e6711b171a
[HUDI-2435][BUG]Fix clustering handle errors (#3666 )
2021-10-13 06:24:48 +08:00
8a487eafa7
[HUDI-2494] Fixing glob pattern to skip all hoodie meta paths (#3768 )
2021-10-12 14:06:40 -04:00
252c4ed380
[HUDI-2532] Metadata table compaction trigger max delta commits (#3784 )
2021-10-12 06:49:42 -07:00
48a3906ccc
[MINOR] Fix typo,'paritition' corrected to 'partition' (#3764 )
2021-10-12 02:07:34 +08:00
f14d4e65e7
[HUDI-2540] Fixed wrong validation for metadataTableEnabled in HoodieTable (#3781 )
2021-10-12 01:58:33 +08:00
5b8bc664a8
[HUDI-2542] AppendWriteFunction throws NPE when checkpointing without written data (#3777 )
2021-10-11 16:22:22 +08:00
ceace1c653
[HUDI-2496] Insert duplicate records when precombined is deactivated for "insert" operation (#3740 )
2021-10-11 04:33:16 +03:00
ad63938890
[HUDI-2537] Fix metadata table for flink (#3774 )
2021-10-10 09:30:39 +08:00
2a392d8e8e
[HUDI-2534] Remove the sort operation when bulk_insert in batch mode (#3772 )
2021-10-09 18:02:10 +08:00
a818020f72
[HUDI-2530] Adding async compaction support to integ test suite framework (#3750 )
2021-10-08 11:30:48 -04:00
10e3a9a3fb
[MINOR] Fix typo,'properites' corrected to 'properties' (#3738 )
2021-10-07 08:37:01 +08:00
2e152177fb
[HUDI-2513] Refactor table upgrade and downgrade actions in hudi-client module (#3743 )
2021-10-06 17:20:41 -07:00
e91e611afb
[HUDI-2456] support 'show partitions' sql (#3693 )
2021-10-06 15:46:49 +08:00
5f32162a2f
[HUDI-2285][HUDI-2476] Metadata table synchronous design. Rebased and Squashed from pull/3426 (#3590 )
2021-10-06 00:17:52 -04:00
46808dcb1f
[HUDI-2497] Refactor clean and restore actions in hudi-client module (#3734 )
2021-09-30 15:20:25 -07:00
73e8ba7620
[HUDI-2499] Making jdbc-url, user and pass as non-required field for other sync modes (#3732 )
2021-09-30 21:11:15 +05:30
47ed917999
[HUDI-2440] Add dependency change diff script for dependency governace (#3674 )
2021-09-30 16:56:11 +08:00
def08d703d
[MINOR] Support JuiceFileSystem (#3729 )
2021-09-30 12:50:46 +08:00
2f07e1267f
[MINOR] Fix typo Hooodie corrected to Hoodie & reuqired corrected to required (#3730 )
2021-09-30 09:55:32 +08:00
dd1bd62684
[HUDI-2277] HoodieDeltaStreamer reading ORC files directly using ORCDFSSource (#3413 )
2021-09-29 23:54:12 +08:00
2aa660f99d
[MINOR] Add a RFC template and folder (#3726 )
2021-09-28 10:33:27 -06:00
f0585facd6
[HUDI-2474] Refreshing timeline for every operation in Hudi when metadata is enabled (#3698 )
2021-09-28 05:16:52 -04:00
9067657a5f
[HUDI-2487] Fix JsonKafkaSource cannot filter empty messages from kafka (#3715 )
2021-09-28 13:47:15 +08:00
36be287121
[MINOR] Fix typo,'Kakfa' corrected to 'Kafka' & 'parquest' corrected to 'parquet' (#3717 )
2021-09-26 21:53:39 +08:00
7e887b54d7
[MINOR] fix typo,'SPAKR' corrected to 'SPARK' (#3721 )
2021-09-26 21:52:35 +08:00
aa546554ff
[HUDI-2451] On windows client with hdfs server for wrong file separator (#3687 )
2021-09-26 21:51:27 +08:00
bc4966ea73
[HUDI-2484] Fix hive sync mode setting in Deltastreamer (#3712 )
2021-09-24 22:35:42 +05:30
31a301f0aa
[HUDI-2485] Consume as mini-batch for flink stream reader (#3710 )
2021-09-24 23:44:01 +08:00
440525ccbb
[HUDI-2483] Infer changelog mode for flink compactor (#3706 )
2021-09-24 14:52:27 +08:00
06c2cc2c8b
[HUDI-2385] Make parquet dictionary encoding configurable (#3578 )
2021-09-24 13:33:34 +08:00
f52cb32f5f
[HUDI-2248] Fixing the closing of hms client (#3364 )
2021-09-24 02:15:24 +05:30
b4b23e401b
[HUDI-2383] Clean the marker files after compaction (#3576 )
2021-09-24 03:40:58 +08:00
eeafd24f4c
[HUDI-2395] Metadata tests rewrite (#3695 )
2021-09-24 01:10:11 +05:30
5515a0d319
[HUDI-2479] HoodieFileIndex throws NPE for FileSlice with pure log files (#3702 )
2021-09-23 15:14:30 +08:00
e813dae36d
[MINOR] Cosmetic changes for flink (#3701 )
2021-09-22 12:18:02 +08:00
55df8f61e1
[MINOR] Fix typo."funcitons" corrected to "functions" (#3681 )
2021-09-22 08:30:13 +08:00
Danny Chan