lanyuanxiaoyao/hudi
1
0
Fork 0
Code Activity

Commit Graph

  • 096f7f55b2 [HUDI-813] Migrate hudi-utilities tests to JUnit 5 (#1589) Raymond Xu 2020-05-03 21:43:42 -07:00
  • 506447fd4f [HUDI-850] Avoid unnecessary listings in incremental cleaning mode (#1576) Balaji Varadarajan 2020-05-01 21:37:21 -07:00
  • c4b71622b9 [MINOR] Reorder HoodieTimeline#compareTimestamp arguments for better readability (#1575) vinoth chandar 2020-04-30 09:19:39 -07:00
  • 9059bce977 [HUDI-702] Add test for HoodieLogFileCommand (#1522) hongdd 2020-04-29 18:47:27 +08:00
  • 69b16309c8 [HUDI-814] Migrate hudi-client tests to JUnit 5 (#1570) Raymond Xu 2020-04-28 22:57:28 -07:00
  • 06dae30297 [HUDI-810] Migrate ClientTestHarness to JUnit 5 (#1553) Raymond Xu 2020-04-28 08:38:16 -07:00
  • 6de9f5d9e5 [HUDI-819] Fix a bug with MergeOnReadLazyInsertIterable. satishkotha 2020-04-27 12:50:39 -07:00
  • 19ca0b5629 [HUDI-785] Refactor compaction/savepoint execution based on ActionExector abstraction (#1548) vinoth chandar 2020-04-25 18:26:44 -07:00
  • 19cc15c098 [MINOR]: Fix cli docs for DeltaStreamer (#1547) dengziming 2020-04-23 02:37:17 +08:00
  • aea7c1657e [HUDI-795] Handle auto-deleted empty aux folder (#1515) Alexander Filipchik 2020-04-22 09:47:32 -07:00
  • 26684f5984 [HUDI-816] Fixed MAX_MEMORY_FOR_MERGE_PROP and MAX_MEMORY_FOR_COMPACTION_PROP do not work due to HUDI-678 (#1536) leesf 2020-04-22 16:33:18 +08:00
  • 6e15eebd81 [HUDI-809] Migrate CommonTestHarness to JUnit 5 (#1530) Raymond Xu 2020-04-21 23:10:25 -07:00
  • 2a56f82908 [HUDI-821] Fixing JCommander param parsing in deltastreamer (#1525) Alexander Filipchik 2020-04-21 20:12:34 -07:00
  • 62bd3e7ded [HUDI-757] Added hudi-cli command to export metadata of Instants. Prashant Wason 2020-03-31 22:32:13 -07:00
  • 84dd9047d3 [HUDI-789]Adjust logic of upsert in HDFSParquetImporter (#1511) hongdd 2020-04-21 14:21:30 +08:00
  • 332072bc6d [HUDI-371] Supporting hive combine input format for realtime tables (#1503) n3nash 2020-04-20 20:40:06 -07:00
  • 2a2f31d919 [MINOR] Remove reduntant code and fix typo in HoodieDefaultTimeline (#1535) Mathieu 2020-04-21 09:40:22 +08:00
  • ddd105bb31 [HUDI-772] Make UserDefinedBulkInsertPartitioner configurable for DataSource (#1500) Dongwook 2020-04-20 08:38:18 -07:00
  • 09fd6f64c5 [HUDI-800] Fix Metrics getReporter().close() throws NPE. (#1529) lw0090 2020-04-19 21:33:07 +08:00
  • 75523657a4 [MINOR] use Option and fix description in toString method (#1527) baobaoyeye 2020-04-18 12:51:37 +08:00
  • acb1ada2f7 [HUDI-799] Use appropriate FS when loading configs (#1517) Alexander Filipchik 2020-04-16 13:49:39 -07:00
  • acdc4a8d00 [HUDI-798] Migrate to Mockito Jupiter for JUnit 5 (#1521) Raymond Xu 2020-04-16 01:07:32 -07:00
  • 19d29ac7d0 [HUDI-741] Added checks to validate Hoodie's schema evolution. Prashant Wason 2020-03-27 00:53:49 -07:00
  • 9ca710cb02 [HUDI-777] Updated description for --target-table parameter (#1519) Iftach Schonbaum 2020-04-16 00:56:13 +03:00
  • d65efe659d [HUDI-780] Migrate test cases to Junit 5 (#1504) Raymond Xu 2020-04-15 12:35:01 -07:00
  • 14d4fea833 [HUDI-759] Integrate checkpoint provider with delta streamer (#1486) Gary Li 2020-04-14 14:51:04 -07:00
  • 644c1cc8bd [HUDI-698]Add unit test for CleansCommand (#1449) hongdd 2020-04-14 17:54:47 +08:00
  • 661b0b3bab [HUDI-761] Refactoring rollback and restore actions using the ActionExecutor abstraction (#1492) vinoth chandar 2020-04-13 08:29:19 -07:00
  • 17bf930342 [HUDI-770] Organize upsert/insert API implementation under a single package (#1495) Balaji Varadarajan 2020-04-12 23:11:00 -07:00
  • 447ba3bae6 [MINOR] Disabling flaky test in InlineFileSystem (#1510) Sivabalan Narayanan 2020-04-12 22:38:56 -04:00
  • 6d7ca2cf7e [HUDI-727]: Copy default values of fields if not present when rewriting incoming record with new schema (#1427) Pratyaksh Sharma 2020-04-13 06:25:26 +05:30
  • 5d717a28f4 [HUDI-782] Add support of Aliyun object storage service. (#1506) Shen Hong 2020-04-12 10:06:30 +08:00
  • a464a2972e [HUDI-700]Add unit test for FileSystemViewCommand (#1490) hongdd 2020-04-11 10:12:21 +08:00
  • c0f96e0726 [HUDI-687] Stop incremental reader on RO table when there is a pending compaction (#1396) satishkotha 2020-04-10 10:45:41 -07:00
  • 8c7cef3e50 [HUDI - 738] Add validation to DeltaStreamer to fail fast when filterDupes is enabled on UPSERT mode. (#1505) Bhavani Sudha Saktheeswaran 2020-04-10 08:58:55 -07:00
  • f5f34bb1c1 [HUDI-568] Improve unit test coverage Ramachandran Madtas Subramaniam 2020-03-11 12:58:31 -07:00
  • 996f761232 Trying git merge --squash Abhishek Modi 2020-04-08 22:50:36 -07:00
  • 3c803421e0 rename variable per review comments Satish Kotha 2020-04-08 16:35:15 -07:00
  • 1f6be820f3 [HUDI-758] Modify Integration test to include incremental queries for MOR tables Satish Kotha 2020-04-02 11:05:54 -07:00
  • f7b55afb74 [MINOR] Fix typo in TimelineService (#1497) Jiayi Liao 2020-04-09 09:14:50 +08:00
  • 4e5c8671ef [HUDI-740]Fix can not specify the sparkMaster and code clean for SparkUtil (#1452) hongdd 2020-04-08 21:33:15 +08:00
  • d610252d6b [HUDI-288]: Add support for ingesting multiple kafka streams in a single DeltaStreamer deployment (#1150) Pratyaksh Sharma 2020-04-08 04:40:26 +05:30
  • b5d093a21b [MINOR] Clear up the redundant comment. (#1489) Zhiyuan Zhao 2020-04-06 16:31:54 +08:00
  • eaf6cc2d90 [HUDI-756] Organize Cleaning Action execution into a single package in hudi-client (#1485) vinoth chandar 2020-04-04 00:07:34 -07:00
  • 575d87cf7d HUDI-644 kafka connect checkpoint provider (#1453) YanJia-Gary-Li 2020-04-03 18:57:34 -07:00
  • deb95ad996 [HUDI-748] Adding .codecov.yml to set exclusions for code coverage reports. (#1468) Prashant Wason 2020-04-03 16:25:01 -07:00
  • 6808559b01 [HUDI-717] Fixed usage of HiveDriver for DDL statements. (#1416) Prashant Wason 2020-04-03 16:23:05 -07:00
  • 639ec20412 [HUDI-562] Enable testing at debug log level Ramachandran Madtas Subramaniam 2020-03-23 23:23:19 -07:00
  • bd716ece18 [MINIOR] Add license header for .asf.yaml and adjust labels yanghua 2020-04-02 16:14:35 +08:00
  • 194e20e661 [MINOR] Fix label issue in .asf.yaml (#1478) vinoyang 2020-04-02 15:51:51 +08:00
  • 5b53b0d85e [HUDI-731] Add ChainedTransformer (#1440) Raymond Xu 2020-04-01 08:21:31 -07:00
  • 2a611f4ad3 [HUDI-749] Fix hudi-timeline-server-bundle run_server.sh start error (#1477) Trevor 2020-04-01 22:19:54 +08:00
  • c146ca90fd [HUDI-754] Configure .asf.yaml for Hudi Github repository (#1472) vinoyang 2020-04-01 10:02:47 +08:00
  • 78b3194e82 [HUDI-751] Fix some coding issues reported by FindBugs (#1470) Shaofeng Shi 2020-03-31 21:19:32 +08:00
  • 9ecf0ccfb2 [HUDI-742] Fix Java Math Exception (#1466) Edwin Guo 2020-03-31 00:56:20 -04:00
  • ce0a4c64d0 [HUDI-713] Fix conversion of Spark array of struct type to Avro schema (#1406) wenningd 2020-03-30 15:52:15 -07:00
  • dbc9acd23a [HUDI-716] Exception: Not an Avro data file when running HoodieCleanClient.runClean (#1432) lamber-ken 2020-03-30 13:19:17 -05:00
  • 9f51b99174 [MINOR] Updated HoodieMergeOnReadTestUtils for future testing requirements (#1456) Prashant Wason 2020-03-30 07:36:12 -07:00
  • 1f5b0c77d6 [HUDI-724] Parallelize getSmallFiles for partitions (#1421) ffcchi 2020-03-30 01:14:38 -06:00
  • fa36082554 [HUDI-746] Reduce build warnings < 10 (#1465) Suneel Marthi 2020-03-29 23:46:52 -04:00
  • fad4bd377b [HUDI-745] CI should fail PRs with unapproved license files (#1464) vinoth chandar 2020-03-29 10:59:40 -07:00
  • e057c27603 [HUDI-744] Restructure hudi-common and clean up files under util packages (#1462) vinoth chandar 2020-03-29 10:58:49 -07:00
  • 07c3c5d797 [HUDI-679] Make io package Spark free (#1460) leesf 2020-03-29 16:54:00 +08:00
  • ac73bdcdc3 [HUDI-430] Adding InlineFileSystem to support embedding any file format as an InlineFile (#1176) Sivabalan Narayanan 2020-03-28 12:13:35 -04:00
  • 04449f33fe [HUDI-743]: Remove FileIOUtils.close() (#1461) Suneel Marthi 2020-03-28 06:03:15 -04:00
  • 8c3001363d HUDI-479: Eliminate or Minimize use of Guava if possible (#1159) Suneel Marthi 2020-03-28 03:11:32 -04:00
  • 1713f686f8 [MINOR] Add error message when check arguments (#1451) Raymond Xu 2020-03-26 19:21:38 -07:00
  • 8b0a4009a9 [HUDI-678] Make config package spark free (#1418) leesf 2020-03-26 23:30:27 +08:00
  • e101ea9bd4 [MINOR] Update DOAP with 0.5.2 Release (#1448) Suneel Marthi 2020-03-25 23:37:32 -04:00
  • 5eed6c98a8 [MINOR] Fix javadoc of InsertBucket (#1445) Mathieu 2020-03-25 22:25:47 +08:00
  • bc82e2be6c [HUDI-711] Refactor exporter main logic (#1436) Raymond Xu 2020-03-25 03:02:24 -07:00
  • cafc87041b [HUDI-697]Add unit test for ArchivedCommitsCommand (#1424) hongdd 2020-03-23 13:46:10 +08:00
  • 0241b21f77 [HUDI-65] commitTime rename to instantTime (#1431) Zhiyuan Zhao 2020-03-23 09:06:00 +08:00
  • 38c3ccc51a [HUDI-663] Fix HoodieDeltaStreamer offset not handled correctly (#1377) lamber-ken 2020-03-22 12:31:48 -05:00
  • 1e1d9e1d34 [HUDI-616] Fixed parquet files getting created on local FS (#1434) Pratyaksh Sharma 2020-03-22 19:49:47 +05:30
  • 06652aa935 [MINOR] Add omissive param desc on method doc and cleanup redundant code (#1437) Zhiyuan Zhao 2020-03-22 21:39:33 +08:00
  • 8b00791ef4 [MINOR] cleanup redundant comment and unused variable and fix typo (#1435) Zhiyuan Zhao 2020-03-22 11:12:06 +08:00
  • c5030f77a0 [HUDI-720] NOTICE file needs to add more content based on the NOTICE files of the ASF projects that hudi bundles (#1417) vinoyang 2020-03-21 10:54:04 +08:00
  • 83fb9651f3 [HUDI-650] Modify handleUpdate path to validate partitionPath (#1368) satishkotha 2020-03-20 08:37:22 -07:00
  • eeab532d79 [HUDI-725] Remove init log in the constructor of DeltaSync (#1425) Mathieu 2020-03-20 17:47:59 +08:00
  • 21c45e1051 [HUDI-726]Delete unused method in HoodieDeltaStreamer (#1426) Mathieu 2020-03-20 17:44:16 +08:00
  • 14e0c95206 [HUDI-400] Check upgrade from old plan to new plan for compaction (#1422) Zhiyuan Zhao 2020-03-20 15:13:17 +08:00
  • a752b7b18c Merge pull request #1165 from yihua/HUDI-76-deltastreamer-csv-source Sivabalan Narayanan 2020-03-19 10:00:53 -04:00
  • 1e321c2fc0 [HUDI-209] Implement JMX metrics reporter (#1106) ForwardXu 2020-03-19 20:10:35 +08:00
  • 779edc0688 [HUDI-344] Add partitioner param to Exporter (#1405) Raymond Xu 2020-03-18 04:24:04 -07:00
  • 0a4902ecce [HUDI-437] Support user-defined index (#1408) leesf 2020-03-18 10:27:40 +08:00
  • e3019031d8 [HUDI-539] Make ROPathFilter conf member serializable (#1415) vinoth chandar 2020-03-17 12:52:48 -07:00
  • f1d7bb381d [HUDI-695]Add unit test for TableCommand (#1411) hongdd 2020-03-17 14:15:30 +08:00
  • 418f9bb2e9 Add constructor to HoodieROTablePathFilter (#1413) bschell 2020-03-16 15:19:16 -07:00
  • 3ef9e885ca [HUDI-715] Fix duplicate name in TableCommand (#1410) hongdd 2020-03-16 17:19:57 +08:00
  • 55e6d34815 [HUDI-694]Add unit test for SparkEnvCommand (#1401) hongdd 2020-03-16 11:52:40 +08:00
  • cf765df606 [HUDI-76] Add CSV Source support for Hudi Delta Streamer Y Ethan Guo 2020-01-18 23:11:14 -08:00
  • 23afe7a487 [HUDI-710] Fixing failure in Staging Validation Script (#1403) Balaji Varadarajan 2020-03-15 07:13:20 -07:00
  • 14323cb100 [HUDI-344] Improve exporter tests (#1404) Raymond Xu 2020-03-15 05:24:30 -07:00
  • 99b7e9eb9e [HUDI-629]: Replace Guava's Hashing with an equivalent in NumericUtils.java (#1350) Suneel Marthi 2020-03-13 20:28:05 -04:00
  • fb7fba365f [HUDI-646] fix failing test due to improper filesytem cleanup (#1373) vinoth chandar 2020-03-12 23:59:09 -07:00
  • c40a0d4e91 [HUDI-656][Performance] Return a dummy Spark relation after writing the DataFrame (#1394) Udit Mehrotra 2020-03-11 20:27:46 -07:00
  • 0f892ef62c [HUDI-692] Add delete savepoint for cli (#1397) hongdd 2020-03-12 07:49:02 +08:00
  • 7d66831444 [MINOR] Removing code which is duplicated from the base class HoodieWriteHandle. (#1399) Prashant Wason 2020-03-11 16:43:04 -07:00
  • 7194514aff [HUDI-689] Change CLI command names to not have overlap (#1392) satishkotha 2020-03-11 16:29:54 -07:00