lanyuanxiaoyao/hudi
1
0
Fork 0
Code Activity
781 Commits 1 Branch 0 Tags
578efa2a0778f1d747c24e7ee3ca321acaab8024
Commit Graph

781 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
RickyRajinder
578efa2a07 [HUDI-582] Update NOTICE year 2020-02-11 22:19:31 +08:00
Mathieu
5fdf5a1927 [HUDI-560] Remove legacy IdentityTransformer (#1264) 2020-02-10 10:04:58 +08:00
Prashant Wason
d26dc0b229 [HUDI-587] Fixed generation of jacoco coverage reports. 
surefire plugin's argLine is moved into a property. This configuration allows jacoco plugin to modify the argLine to insert it's Java Agent's configuration during pre-unit-test stage.
 2020-02-05 14:27:03 -08:00
Balajee Nagasubramaniam
1fb0b001a3 [HUDI-570] - Improve test coverage for FSUtils.java 2020-02-05 14:25:24 -08:00
Satish Kotha
462fd02556 [HUDI-571] Add 'commits show archived' command to CLI 2020-02-05 11:25:34 -08:00
Raymond Xu
c1516df8ac [HUDI-499] Allow update partition path with GLOBAL_BLOOM (#1187) 
* Handle partition path update by deleting a record from the old partition and
  insert into the new one
* Add a new configuration "hoodie.bloom.index.update.partition.path" to
  enable the behavior
* Add a new unit test case for global bloom index
 2020-02-05 09:33:33 -08:00
lamber-ken
46842f4e92 [MINOR] Remove the declaration of thrown RuntimeException (#1305) 2020-02-05 23:23:20 +08:00
lamber-ken
425e3e6c78 [HUDI-585] Optimize the steps of building with scala-2.12 (#1293) 2020-02-05 23:13:10 +08:00
Prashant Wason
4de0fcfcb5 [HUDI-566] Added new test cases for class HoodieTimeline, HoodieDefaultTimeline and HoodieActiveTimeline. 2020-02-04 18:55:04 -08:00
Suneel Marthi
594da28fbf [HUDI-595] code cleanup, refactoring code out of PR# 1159 (#1302) 2020-02-04 21:52:03 +08:00
dengziming
347e297ac1 [HUDI-596] Close KafkaConsumer every time (#1303) 2020-02-03 23:42:21 -08:00
Satish Kotha
d07ac588ac Increase test coverage for HoodieReadClient 2020-02-03 18:11:57 -08:00
Suneel Marthi
fcf9e4aded [MINOR] Updated DOAP with 0.5.1 release (#1301) 2020-02-02 22:41:30 +08:00
Suneel Marthi
0026234011 [MINOR] Updated DOAP with 0.5.1 release (#1300) 2020-02-02 15:13:24 +01:00
Suneel Marthi
5b7bb142dc [HUDI-583] Code Cleanup, remove redundant code, and other changes (#1237) 2020-02-02 18:03:44 +08:00
Prashant Wason
f27c7a16c6 [HUDI-564] Added new test cases for HoodieLogFormat and HoodieLogFormatVersion. 2020-01-30 13:53:18 -08:00
leesf
652224edc8 [HUDI-578] Trim recordKeyFields and partitionPathFields in ComplexKeyGenerator (#1281) 
* [HUDI-578] Trim recordKeyFields and partitionPathFields in ComplexKeyGenerator

* add tests
 2020-01-29 16:26:26 -08:00
Balajee Nagasubramaniam
6f34be1b8d HUDI-117 Close file handle before throwing an exception due to append failure. 
Add test cases to handle/verify stage failure scenarios.
 2020-01-29 15:28:51 -08:00
lamber-ken
c06ec8bfc7 [MINOR] Fix assigning to configuration more times (#1291) 2020-01-29 17:18:35 -05:00
hmatu
362a9b9aab [MINOR] Remove junit-dep dependency 2020-01-28 10:31:55 -08:00
lamber-ken
56a4e0d56c [MINOR] Fix invalid issue url & quickstart url (#1282) 2020-01-27 16:53:03 +08:00
lamber-ken
cdb028f1f3 [MINOR] Fix missing groupId / version property of dependency 2020-01-25 09:19:55 -08:00
Bhavani Sudha Saktheeswaran
1e79cbc259 [HUDI-549] update Github README with instructions to build with Scala 2.12 (#1275) 2020-01-22 23:43:50 -08:00
leesf
fc8d4a71ad [MINOR] fix license issue (#1273) 2020-01-23 02:03:49 +08:00
leesf
ed54eb20a5 [MINOR] Add missing licenses (#1271) 2020-01-22 08:06:45 -05:00
Balaji Varadarajan
8e3d81cff1 [MINOR] Change deploy_staging_jars script to take in scala version (#1270) 2020-01-22 14:28:30 +08:00
Balaji Varadarajan
a46fea9ff4 [MINOR] Change deploy_staging_jars script to take in scala version (#1269) 2020-01-22 14:19:47 +08:00
lamber-ken
a54535ed5a [MINOR] Fix invalid maven repo address (#1265) 2020-01-21 04:41:59 -08:00
Mathieu
b6e2993ceb [MINOR] Update the javadoc of HoodieTableMetaClient#scanFiles (#1263) 
[MINOR] Update the javadoc of HoodieTableMetaClient#scanFiles
 2020-01-21 15:50:40 +08:00
Balaji Varadarajan
924bf514e2 [MINOR] Download KEYS file when validating release candidate (#1259) 2020-01-21 09:20:47 +08:00
leesf
6e59c1c777 Moving to 0.5.2-SNAPSHOT on master branch. 2020-01-20 10:51:33 -08:00
Balaji Varadarajan
ba54a7e973 [HUDI-559] : Make the timeline layout version default to be null version 2020-01-20 00:02:55 -08:00
leesf
7087e7d766 [HUDI-556] Add lisence for PR#1233 2020-01-19 09:26:14 -08:00
Y Ethan Guo
9489d0fb84 [HUDI-551] Abstract a test case class for DFS Source to make it extensible (#1239) 2020-01-19 18:50:12 +08:00
Y Ethan Guo
d0ee95ed16 [HUDI-552] Fix the schema mismatch in Row-to-Avro conversion (#1246) 2020-01-18 16:40:56 -08:00
Suneel Marthi
3f4966ddea [MINOR] Fix PMC in DOAP] (#1247) 2020-01-18 11:03:29 -05:00
leesf
5471d8f0c2 [MINOR] Add toString method to TimelineLayoutVersion to make it more readable (#1244) 2020-01-17 20:22:55 -05:00
wenningd
292c1e2ff4 [HUDI-238] Make Hudi support Scala 2.12 (#1226) 
* [HUDI-238] Rename scala related artifactId & add maven profile to support Scala 2.12
 2020-01-17 14:02:21 -08:00
Balaji Varadarajan
923e2b4a1e [HUDI-535] Ensure Compaction Plan is always written in .aux folder to avoid 0.5.0/0.5.1 reader-writer compatibility issues (#1229) 2020-01-17 10:56:35 -08:00
Prashant Wason
0a07752dc0 [HUDI-527] scalastyle-maven-plugin moved to pluginManagement as it is only used in hoodie-spark and hoodie-cli modules. 
This fixes compile warnings as well as unnecessary plugin invocation for most of the modules which do not have scala code.
 2020-01-17 10:46:10 -08:00
vinoth chandar
baa6b5e889 [HUDI-537] Introduce repair overwrite-hoodie-props CLI command (#1241) 2020-01-17 01:21:44 -08:00
vinoth chandar
c2c0f6b13d [HUDI-509] Renaming code in sync with cWiki restructuring (#1212) 
- Storage Type replaced with Table Type (remaining instances)
 - View types replaced with query types;
 - ReadOptimized view referred as Snapshot Query
 - TableFileSystemView sub interfaces renamed to BaseFileOnly and Slice Views
 - HoodieDataFile renamed to HoodieBaseFile
 - Hive Sync tool will register RO tables for MOR with a `_ro` suffix
 - Datasource/Deltastreamer options renamed accordingly
 - Support fallback to old config values as well, so migration is painless
 - Config for controlling _ro suffix addition
 - Renaming DataFile to BaseFile across DTOs, HoodieFileSlice and AbstractTableFileSystemView
 2020-01-16 23:58:47 -08:00
lamber-ken
8a3a50309b [MINOR] Fix missing @Override annotation on BufferedRandomAccessFile method (#1236) 2020-01-16 11:14:39 -08:00
Y Ethan Guo
b39458b008 [MINOR] Make constant fields final in HoodieTestDataGenerator (#1234) 2020-01-16 12:42:30 +08:00
Scheller
1daba24065 Add GlobalDeleteKeyGenerator 
Adds new GlobalDeleteKeyGenerator for record_key deletes with global indices. Also refactors key generators into their own package.
 2020-01-15 17:01:29 -08:00
Balajee Nagasubramaniam
dd09abb56d [HUDI-335] Improvements to DiskBasedMap used by ExternalSpillableMap, for write and random/sequential read paths, by introducing bufferedRandmomAccessFile 2020-01-15 16:45:45 -08:00
lamber-ken
7aa3ce31e6 [MINOR] Fix redundant judgment statement (#1231) 2020-01-15 16:30:14 -08:00
Sivabalan Narayanan
2248fd9aea Fixing checkstyle issues 2020-01-15 14:21:26 -08:00
Sivabalan Narayanan
2b2f23aa60 Fixing delete util method 2020-01-15 14:21:26 -08:00
Sivabalan Narayanan
87fdb769f0 Adding util methods to assist in adding deletion support to Quick Start 2020-01-15 14:21:26 -08:00