lanyuanxiaoyao/hudi
1
0
Fork 0
Code Activity

Fixes HUDI-9 : Check precondition minInstantsToKeep > cleanerCommitsRetained

Browse Source 
- Added a precondition check, otherwise incr pull could miss commits
 - Lowered default cleaner retention to 10, to enable simpler understanding for newbies
 - Bumped down min/max instants to retain as well
This commit is contained in:
Vinoth Chandar
2019-03-26 18:52:33 -07:00
committed by vinoth chandar
parent 3d9041e216
commit 372fbc4733
4 changed files with 31 additions and 21 deletions
Download Patch File Download Diff File Expand all files Collapse all files

4
hoodie-client/src/main/java/com/uber/hoodie/config/HoodieWriteConfig.java
View File

@@ -176,11 +176,11 @@ public class HoodieWriteConfig extends DefaultHoodieConfig {
}
public int getMaxCommitsToKeep() {
return Integer.parseInt(props.getProperty(HoodieCompactionConfig.MAX_COMMITS_TO_KEEP));
return Integer.parseInt(props.getProperty(HoodieCompactionConfig.MAX_COMMITS_TO_KEEP_PROP));
}
public int getMinCommitsToKeep() {
return Integer.parseInt(props.getProperty(HoodieCompactionConfig.MIN_COMMITS_TO_KEEP));
return Integer.parseInt(props.getProperty(HoodieCompactionConfig.MIN_COMMITS_TO_KEEP_PROP));
}
public int getParquetSmallFileLimit() {