lanyuanxiaoyao/hudi
1
0
Fork 0
Code Activity

Commit Graph

  • 10e457278b [HUDI-1078]Fix IllegalArgumentException in Delete data demo of Quick-Start Guide (#1808) miaomiaomiao 2020-07-13 23:38:06 +08:00
  • 20ac7c3337 [HUDI-994] Make TestHBaseQPSResourceAllocator a unit test (#1820) Raymond Xu 2020-07-11 09:15:05 -07:00
  • abfebd30f3 [MINOR] Update parameter description (#1821) GuoPhilipse 2020-07-11 22:57:12 +08:00
  • 9627a385fe [HUDI-916]: Added support for multiple input formats in TimestampBasedKeyGenerator (#1648) Pratyaksh Sharma 2020-07-11 00:58:45 +05:30
  • c7f1a781ab [HUDI-728]: Implemented custom key generator (#1433) Pratyaksh Sharma 2020-07-09 17:05:07 +05:30
  • d58644b657 [HUDI-1062]Remove unnecessary maxEvent check and add some log in KafkaOffsetGen (#1779) Trevor 2020-07-09 12:07:34 +08:00
  • 086853c004 [HUDI-1080] Fix backward compatibility for com.uber inputformats Satish Kotha 2020-07-07 13:30:58 -07:00
  • 7b2a947aed [HUDI-1069] Remove duplicate assertNoWriteErrors() (#1797) Raymond Xu 2020-07-07 22:58:15 -07:00
  • 8c4ff185f1 [HUDI-1064]Trim hoodie table name (#1805) mabin001 2020-07-07 19:10:16 +08:00
  • be85a6c32b [HUDI-1004] Support update metrics in HoodieDeltaStreamerMetrics (#1732) Shen Hong 2020-07-07 00:44:02 +08:00
  • 3b9a30528b [HUDI-996] Add functional test suite for hudi-utilities (#1746) Raymond Xu 2020-07-05 16:44:31 -07:00
  • 574dcf920c [MINOR] Relocate jetty during shading/packaging for Databricks runtime (#1781) Cory Locklear 2020-07-03 19:22:52 -04:00
  • 37ea79566d [HUDI-539] Make HoodieROTablePathFilter implement Configurable (#1784) andreitaleanu 2020-07-03 23:39:53 +03:00
  • 2be924fd3a [HUDI-760]Remove Rolling Stat management from Hudi Writer (#1739) baobaoyeye 2020-07-01 11:07:09 +08:00
  • 8919be6a5d [HUDI-855] Run Cleaner async with writing (#1577) Balaji Varadarajan 2020-06-28 02:04:50 -07:00
  • 31247e9b34 [HUDI-896] Report test coverage by modules & parallelize CI (#1753) Raymond Xu 2020-06-27 23:16:12 -07:00
  • 2603cfb33e [HUDI-684] Introduced abstraction for writing and reading different types of base file formats. (#1687) Prashant Wason 2020-06-25 23:46:55 -07:00
  • 5e47673341 [HUDI-1035] Remove unused class KeyLookupResult (#1754) wangxianghu 2020-06-24 08:01:03 +08:00
  • 89e37d5273 [HUDI-908] Add some data types to HoodieTestDataGenerator and fix some some bugs. (#1690) Shen Hong 2020-06-22 23:13:28 +08:00
  • 68a656b016 [HUDI-1032] Remove unused code in HoodieCopyOnWriteTable and code clean (#1750) wangxianghu 2020-06-21 22:34:47 +08:00
  • 8a9fdd603e [HUDI-1023] Add validation error messages in delta sync (#1710) Raymond Xu 2020-06-19 12:12:35 -07:00
  • ab724af5c4 [MINOR] Rename TestSourceConfig to SourceConfigs (#1749) Raymond Xu 2020-06-19 12:08:19 -07:00
  • f3a701757b [HUDI-696] Add unit test for CommitsCommand (#1724) hongdd 2020-06-18 21:42:13 +08:00
  • 5099a91edd [HUDI-709] Add unit test for UtilsCommand (#1686) hongdd 2020-06-18 19:54:14 +08:00
  • 2a04647f5e [MINOR] Updating doap file for 0.5.3 release (#1740) Sivabalan Narayanan 2020-06-16 15:47:30 -04:00
  • 043eb564c2 [HUDI-1003] Handle partitions correctly for syncing hudi non-parititioned table to hive (#1720) Yajun Luo 2020-06-15 19:02:03 +08:00
  • ede6c9bda4 [HUDI-1006] Deltastreamer use kafkaSource with offset reset strategy:latest can't consume data (#1719) Litianye 2020-06-14 18:01:44 +08:00
  • 31ef4acc59 [MINOR] Fix the ordered list for the hudi-examples README file (#1733) vinoyang 2020-06-14 16:27:26 +08:00
  • fcabc8fbca [HUDI-1019] Clean refresh command in CLI (#1725) hongdd 2020-06-14 14:30:28 +08:00
  • a7fd331624 Add unit test for snapshot reads in hadoop-mr Satish Kotha 2020-06-08 12:09:21 -07:00
  • df2e0c760e HUDI-942 Increase default value number of delta commits for inline compaction (#1664) sathyaprakashg 2020-06-10 16:16:44 -07:00
  • 37838cea60 [HUDI-822] decouple Hudi related logics from HoodieInputFormat (#1592) Gary Li 2020-06-09 06:10:16 -07:00
  • 3387b3841f [HUDI-1005] fix NPE in HoodieWriteClient.clean shenhong 2020-06-08 11:59:09 +08:00
  • 6318e943d1 [HUDI-1016] Code optimization in MergeOnReadRollbackActionExecutor(#1718) Shen Hong 2020-06-09 19:14:26 +08:00
  • 22cd824d99 HUDI-494 fix incorrect record size estimation garyli1019 2020-05-14 20:20:44 -07:00
  • 9e07cebece [HUDI-974] Fix fields out of order in MOR mode when using Hive (#1711) lw0090 2020-06-09 09:22:06 +08:00
  • 7d40f19f39 HUDI-515 Resolve API conflict for Hive 2 & Hive 3 Wenning Ding 2020-05-16 13:39:53 -07:00
  • 97ab97b726 [HUDI-918] Fix kafkaOffsetGen can not read kafka data bug (#1652) liujinhui 2020-06-08 20:46:47 +08:00
  • 2901f5423a [HUDI-1002] Ignore case when setting incremental mode in hive query (#1715) Shen Hong 2020-06-08 19:38:32 +08:00
  • e0a5e0d343 [HUDI-1000] Fix incremental query for COW non-partitioned table with no data (#1708) hj2016 2020-06-08 15:34:42 +08:00
  • e9cab67b80 [HUDI-988] Fix More Unit Test Flakiness garyli1019 2020-06-05 17:25:59 -07:00
  • fb283934a3 [HUDI-990] Timeline API : filterCompletedAndCompactionInstants needs to handle requested state correctly. Also ensure timeline gets reloaded after we revert committed transactions Balaji Varadarajan 2020-06-03 00:35:14 -07:00
  • a68180b179 [HUDI-988] Fix Unit Test Flakiness : Ensure all instantiations of HoodieWriteClient is closed properly. Fix bug in TestRollbacks. Make CLI unit tests for Hudi CLI check skip redering strings Balaji Varadarajan 2020-06-02 01:49:37 -07:00
  • a9a97d6af4 [HUDI-934] Add processing logic for the decimal LogicalType (#1677) Yajun Luo 2020-06-02 19:50:55 +08:00
  • 742c204099 [HUDI-811] Restructure test packages in hudi-client/cli (#1689) Raymond Xu 2020-06-01 19:25:42 -07:00
  • 7c59095314 [HUDI-975] Add unit tests in TestHoodieTableFileSystemView to test view for non-partitioned table (#1692) cxzl25 2020-06-01 22:23:28 +08:00
  • 8cb86b4d36 Added python3 to the spark_base docker image to support pyspark (#1632) Vinoth Govindarajan 2020-05-31 22:53:50 -07:00
  • 1a9fef48e7 Fixing binary file checks and disclaimer file checks (#1691) Sivabalan Narayanan 2020-05-30 23:09:21 -04:00
  • 7fb1251c6e [HUDI-980] Fixing dir path for metastore_db and derby.logs generated in hive tests (#1688) Sivabalan Narayanan 2020-05-29 20:42:20 -04:00
  • 5a0d3f1cf9 [HUDI-786] Fixing read beyond inline length in InlineFS (#1616) Sivabalan Narayanan 2020-05-28 15:59:11 -04:00
  • 3574a89232 [HUDI-973] RemoteHoodieTableFileSystemView supports non-partitioned table queries (#1674) cxzl25 2020-05-29 01:50:47 +08:00
  • bde7a7043e [HUDI-476]: Add hudi-examples module (#1151) dengziming 2020-05-28 01:44:39 +08:00
  • 03f136361a [HUDI-811] Restructure test packages in hudi-common (#1644) Raymond Xu 2020-05-27 01:28:17 -07:00
  • 9697fbf71e [HUDI-936] Fix fetch ordering val in HoodieSparkSqlWriter to remove unnecessary conversion to String (#1659) Bhavani Sudha Saktheeswaran 2020-05-26 21:09:02 -07:00
  • 6c450957ce [HUDI-690] Filter out inflight compaction in exporter (#1667) Raymond Xu 2020-05-26 09:23:34 -07:00
  • 46572d04c4 [MINOR] Fix PMC tag in doap file (#1666) vinoth chandar 2020-05-25 09:12:29 -07:00
  • 492f324bc7 [HUDI-938] Removing incubating/incubator from project (#1658) leesf 2020-05-24 18:28:13 +08:00
  • f22c3e933e [HUDI-926] Removing DISCLAIMER from the repo (#1657) leesf 2020-05-24 18:27:08 +08:00
  • d3edac4612 HUDI-921 Remove inlineCompactionEvery method in HoodieCompactionConfig.Builder (#1654) sathyaprakashg 2020-05-24 01:09:18 -07:00
  • 45acccdb8a [MINOR] Remove incubating from README vinoth chandar 2020-05-23 14:51:58 -07:00
  • f34de3fb27 [HUDI-836] Implement datadog metrics reporter (#1572) Raymond Xu 2020-05-22 09:14:21 -07:00
  • 802d16c8c9 [HUDI-707] Add unit test for StatsCommand (#1645) hongdd 2020-05-21 18:28:04 +08:00
  • 6a0aa9a645 [HUDI-803] Replaced used of NullNode with JsonProperties.NULL_VALUE in HoodieAvroUtils (#1538) Pratyaksh Sharma 2020-05-20 21:34:43 +05:30
  • 74ecc27e92 [HUDI-846][HUDI-848] Enable Incremental cleaning and embedded timeline-server by default (#1634) Balaji Varadarajan 2020-05-20 05:29:43 -07:00
  • f802d4400b [MINOR] Fix resource cleanup in TestTableSchemaEvolution (#1640) Raymond Xu 2020-05-20 05:07:30 -07:00
  • 244d47494e [HUDI-888] fix NullPointerException in HoodieCompactor (#1622) rolandjohann 2020-05-20 13:22:35 +02:00
  • 0dc2fa6172 [MINOR] Fix HoodieCompactor config abbreviation (#1642) wenningd 2020-05-19 21:03:54 -07:00
  • 161a798337 [HUDI-706] Add unit test for SavepointsCommand (#1624) hongdd 2020-05-19 18:36:01 +08:00
  • e6f3bf10cf [HUDI-858] Allow multiple operations to be executed within a single commit (#1633) Balaji Varadarajan 2020-05-18 19:27:24 -07:00
  • 2600d2de8d [MINOR] Fix apache-rat violations (#1639) Joey 2020-05-18 13:16:49 -05:00
  • 459356e292 [HUDI-863] get decimal properties from derived spark DataType (#1596) rolandjohann 2020-05-18 13:28:27 +02:00
  • 57132f79bb [HUDI-705] Add unit test for RollbacksCommand (#1611) hongdd 2020-05-18 14:04:06 +08:00
  • 29edf4b3b8 [HUDI-407] Adding Simple Index to Hoodie. (#1402) Sivabalan Narayanan 2020-05-17 21:32:24 -04:00
  • 3c9da2e5f0 [HUDI-895] Remove unnecessary listing .hoodie folder when using timeline server (#1636) Balaji Varadarajan 2020-05-17 18:18:53 -07:00
  • 25a0080b2f [HUDI-714]Add javadoc and comments to hudi write method link (#1409) Mathieu 2020-05-16 20:36:51 +08:00
  • 148b2458f6 [MINOR] Increase heap space for surefire (#1623) Raymond Xu 2020-05-16 01:11:57 -07:00
  • 2ada2ef50f [HUDI-902] Avoid exception when getSchemaProvider (#1584) Raymond Xu 2020-05-15 21:33:02 -07:00
  • 25e0b75b3d [HUDI-723] Register avro schema if infered from SQL transformation (#1518) Alexander Filipchik 2020-05-15 12:44:03 -07:00
  • a64afdfd17 HUDI-528 Handle empty commit in incremental pulling (#1612) Gary Li 2020-05-14 22:55:25 -07:00
  • f094f42857 [HUDI-843] Add ability to specify time unit for TimestampBasedKeyGenerator (#1541) Alexander Filipchik 2020-05-14 13:37:59 -07:00
  • 3a2fe13fcb [HUDI-701] Add unit test for HDFSParquetImportCommand (#1574) hongdd 2020-05-14 19:15:49 +08:00
  • 83796b3189 [HUDI-793] Adding proper default to hudi metadata fields and proper handling to rewrite routine (#1513) Alexander Filipchik 2020-05-13 18:04:38 -07:00
  • 0d4848b68b [HUDI-811] Restructure test packages (#1607) Raymond Xu 2020-05-13 15:37:03 -07:00
  • 32bada29dc [HUDI-889] Writer supports useJdbc configuration when hive synchronization is enabled (#1627) cxzl25 2020-05-14 00:20:13 +08:00
  • 32ea4c70ff [HUDI-869] Add support for alluxio (#1608) liujinhui 2020-05-13 21:00:34 +08:00
  • 404c7e82d9 [HUDI-884] Shade avro and parquet-avro in hudi-hive-sync-bundle (#1618) Udit Mehrotra 2020-05-12 11:40:31 -07:00
  • e8ffc6f0aa [HUDI-881] Replace part of spark context by hadoop configuration in AbstractHoodieClient and HoodieReadClient (#1620) Shen Hong 2020-05-13 00:33:29 +08:00
  • b54517aad0 [HUDI-886] Replace jsc.hadoopConfiguration by hadoop configuration in hudi-client testcase (#1621) Shen Hong 2020-05-12 23:51:31 +08:00
  • 295d00beea [HUDI-880] Replace part of spark context by hadoop configuration in HoodieTable. (#1614) Shen Hong 2020-05-12 14:33:57 +08:00
  • 5d37e66b7e [MINOR] Fix HoodieNotSupportedException description in KafkaOffsetGen (#1615) liujinhui 2020-05-11 23:14:43 +08:00
  • 6dac10115c [HUDI-870] Remove spark context in ClientUtils and HoodieIndex (#1609) Shen Hong 2020-05-11 19:05:36 +08:00
  • 8d0e23173b [HUDI-820] cleaner repair command should only inspect clean metadata files (#1542) Balaji Varadarajan 2020-05-10 18:25:54 -07:00
  • f92b9fdcc4 [MINOR] Fix hardcoding of ports in TestHoodieJmxMetrics (#1606) vinoth chandar 2020-05-10 16:23:26 -07:00
  • fa6aba751d [MINOR] fixed building IndexFileFilter with a wrong condition in HoodieGlobalBloomIndex class (#1537) Carm 2020-05-10 09:45:07 +08:00
  • d54b4b8a52 [HUDI-838] Support schema from HoodieCommitMetadata for HiveSync (#1559) Udit Mehrotra 2020-05-07 16:33:09 -07:00
  • e783ab1749 [HUDI-784] Adressing issue with log reader on GCS (#1516) Alexander Filipchik 2020-05-07 13:05:32 -07:00
  • f921469afc [HUDI-704] Add test for RepairsCommand (#1554) hongdd 2020-05-07 23:02:28 +08:00
  • 366bb10d8c [HUDI-812] Migrate hudi common tests to JUnit 5 (#1590) Raymond Xu 2020-05-06 04:15:20 -07:00
  • e21441ad83 Add changes for presto mor queries (#1578) bschell 2020-05-04 11:27:14 -07:00
  • 5e0f5e5521 [HUDI-852] adding check for table name for Append Save mode (#1580) AakashPradeep 2020-05-03 23:09:17 -07:00