lanyuanxiaoyao/hudi
1
0
Fork 0
Code Activity
581 Commits 1 Branch 0 Tags
77f4e73615d0949eec70187e397ef17f62e908a0
Commit Graph

581 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Balaji Varadarajan
77f4e73615 [HUDI-121] Fix licensing issues found during RC voting by general incubator group 2019-10-16 02:09:02 -07:00
Mehrotra
8c13340062 Shade and relocate Avro dependency in hadoop-mr-bundle 2019-10-16 02:08:12 -07:00
Wenning Ding
1c09f5b055 [HUDI-301] fix path error when update a non-partition MOR table 2019-10-16 02:07:33 -07:00
Udit Mehrotra
12523c379f [HUDI-298] Fix issue with incorrect column mapping casusing bad data, during on-the-fly merge of Real Time tables (#956) 
* Fix issue with incorrect column mapping casusing bad data, during on-the-fly merge of Real Time tables
 2019-10-16 02:05:53 -07:00
Anurag870
c052167c06 [Docs] Update README.md (#955) 2019-10-13 21:02:25 -07:00
leesf
e10e06918e [HUDI-292] Avoid consuming more entries from kafka than specified sourceLimit. (#947) 
- Special handling when allocedEvents > numEvents 
 - Added unit tests
 2019-10-11 05:28:45 -07:00
leesf
b19bed442d [HUDI-296] Explore use of spotless to auto fix formatting errors (#945) 
- Add spotless format fixing to project
- One time reformatting for conformity
- Build fails for formatting changes and mvn spotless:apply autofixes them
 2019-10-10 05:19:40 -07:00
Balaji Varadarajan
834c591955 [MINOR] Add incubating to NOTICE and README.md 
Please enter the commit message for your changes. Lines starting
 2019-10-09 21:42:29 -07:00
vinoth chandar
e655cfba30 [HOTFIX] Move to openjdk to get travis passing (#944) 2019-10-08 12:06:47 -07:00
leesf
d050d98071 [HUDI-232] Implement sealing/unsealing for HoodieRecord class (#938) 2019-10-07 10:56:46 -07:00
Balaji Varadarajan
8a55938ca1 [HUDI-293] Remove KEYS file from github repository 2019-10-04 22:39:07 -07:00
Balaji Varadarajan
eb4cc05c1b [HUDI-121] Prepare for 0.5.0-incubating-rc5 2019-10-04 09:22:36 -07:00
Balaji Varadarajan
9b66ea41fd [HUDI-121] Remove leftover notice file and replace com.uber.hoodie with org.apache.hudi in log4j properties 2019-10-04 09:18:57 -07:00
leesf
7dd9c74b1b [HUDI-285] Implement HoodieStorageWriter based on actual file type (#936) 2019-10-04 07:45:16 -07:00
leesf
3dedc7e5fd [HUDI-265] Failed to delete tmp dirs created in unit tests (#928) 2019-10-03 09:48:13 -07:00
Balaji Varadarajan
cef06c1e48 [HUDI-121] Fix bug in validation in deploy_staging_jars.sh 2019-10-03 09:42:59 -07:00
Balaji Varadarajan
e75fa070f8 [HUDI-121] Fix bug in validation in create_source_release.sh 2019-10-03 09:20:26 -07:00
Balaji Varadarajan
e78ba598c5 Update Release notes 2019-10-03 09:11:37 -07:00
Balaji Varadarajan
6da2f9ac7c [HUDI-287] Address comments during review of release candidate 
1. Remove LICENSE and NOTICE files in hoodie child modules.
  2. Remove developers and contributor section from pom
  3. Also ensure any failures in validation script is reported appropriately
  4. Make hoodie parent pom consistent with that of its parent apache-21 (https://github.com/apache/maven-apache-parent/blob/apache-21/pom.xml)
 2019-10-03 09:00:07 -07:00
Balaji Varadarajan
e41835fd91 [HUDI-121] Fix bugs in Release Scripts found during RC creation 2019-10-01 21:34:24 -07:00
Balaji Varadarajan
1d2e3dcc65 [HUDI-121] Update Release notes 2019-09-30 16:24:45 -07:00
Balaji Varadarajan
6e8a28bcae HUDI-121 : Address comments during RC2 voting 
1. Remove dnl utils jar from git
2. Add LICENSE Headers in missing files
3. Fix NOTICE and LICENSE in all HUDI packages and in top-level
4. Fix License wording in certain HUDI source files
5. Include non java/scala code in RAT licensing check
6. Use whitelist to include dependencies as part of timeline-server bundling
 2019-09-30 15:42:15 -07:00
Bhavani Sudha Saktheeswaran
50a073ff57 [HUDI-271] Create QuickstartUtils for simplifying quickstart guide 
- This will be used in Quickstart guide (Doc changes to follow in a seperate PR). The intention is to simplify quickstart to showcase hudi APIs by writing and reading using spark datasources.
- This is located in hudi-spark module intentionally to bring all the necessary classes in hudi-spark-bundle finally.
 2019-09-30 15:22:18 -07:00
vinoyang
01e803b00e [HUDI-247] Unify the re-initialization of HoodieTableMetaClient in test for hoodie-client module (#930) 2019-09-30 05:38:52 -07:00
Balaji Varadarajan
2ea8b0c3f1 [HUDI-279] Fix regression in Schema Evolution due to PR-755 2019-09-25 22:53:43 -07:00
Xing Pan
bf05f95413 [HUDI-269] Limit sync frequency (#921) 
* [HUDI-269] Throttle DeltaStreamer sync runs
 2019-09-24 05:30:35 -07:00
vinoth chandar
1e6dd1ca1d [MINOR] : Further updates to .mailmap for vinoth (#919) 2019-09-22 17:26:04 -07:00
PanXing
635154c439 [MINOR] support reading cfg file in another s3 bucket (#914) 2019-09-22 06:47:23 -07:00
vinoyang
f020d029c4 HUDI-267 Refactor bad method name HoodieTestUtils#initTableType and HoodieTableMetaClient#initializePathAsHoodieDataset (#916) 2019-09-21 09:05:02 -07:00
Nishith Agarwal
1104f9526f HUDI-180 : Adding support for hive registration using metastore along with JDBC 2019-09-21 08:04:34 -07:00
Balaji Varadarajan
69ca45b2da Fix mailmap to allow mapping of defunct emailIds to active emailIds 2019-09-19 00:17:56 -07:00
Balaji Varadarajan
2e75a6973d Adding mailmap to allow mapping of defunct emailIds to active emailIds 2019-09-19 00:12:20 -07:00
Balaji Varadarajan
4bda742a93 Updating release notes and preparing for 0.5.0-incubating-rc2 release 2019-09-17 12:41:54 -07:00
Vinoth Chandar
e217db56ab [HUDI-254]: Bundle and shade databricks/avro with spark bundle 
- spark 2.4 onwards, spark has built in support. shading to avoid conflicts
 - spark 2.3 still needs this bundled, so that dropping bundle into jars folder would work
 2019-09-17 12:38:51 -07:00
Balaji Varadarajan
c1e7d0e5a6 [HUDI-121] Update Release notes and fix master version 2019-09-17 09:50:30 -07:00
Balaji Varadarajan
2c6da09d9d [HUDI-257] Fix Bloom Index unit-test failures 2019-09-17 09:41:15 -07:00
Balaji Varadarajan
96a46d8701 [HUDI-252] Identify packages which are under non-apache license in LICENSE file 2019-09-16 21:56:12 -07:00
Balaji Varadarajan
629698d54f [HUDI-252] Add Disclaimer and cleanup NOTICE and LICENSE files in hudi 2019-09-16 13:08:26 -07:00
Taher Koitawala
c0f42afa35 [HUDI-62] Index Lookup Timer added to HoodieWriteClient 2019-09-16 11:12:52 -07:00
Balaji Varadarajan
63cc455d9c [HUDI-121] ASF Release : Ensure NOTICE.txt is generated as part of cutting release branch 2019-09-13 13:58:29 -07:00
Balaji Varadarajan
7190c022bb [HUDI-249] Updating Notice files 2019-09-13 13:50:58 -07:00
Balaji Varadarajan
1a61d6bc4d [HUDI-249] Fix RELEASE-NOTES to match correct state 2019-09-13 12:48:38 -07:00
Vinoth Chandar
b1446be2b4 [HUDI-244] : Hive sync should escape partition field name 
- now supports field names beginning with '_' for e.g
 2019-09-13 12:41:52 -07:00
Balaji Varadarajan
3ee16b5439 [HUDI-250] Ensure Hudi CLI wrapper works with non snapshot jars too. Also Fix bug in cut_release_branch script 2019-09-13 12:40:32 -07:00
Nishith Agarwal
0b032b2761 Fix requested eompaction rollback during restore command 2019-09-13 12:40:13 -07:00
Balaji Varadarajan
d2525c31b7 Moving to 0.6.0-SNAPSHOT on master branch. 2019-09-13 09:58:29 -07:00
Balaji Varadarajan
36c74c8a16 [HUDI-249] Fix cut_release_branch script 2019-09-13 09:54:39 -07:00
Balaji Varadarajan
117a68d503 Add missing commit in release notes 2019-09-13 09:45:19 -07:00
Balaji Varadarajan
58623631d4 [HUDI-249] Update Release-notes. Add sign-artifacts to POM and release related scripts. Add missing license headers 2019-09-13 08:41:29 -07:00
yanghua
895d732a14 refactor code 2019-09-12 05:15:07 -07:00