lanyuanxiaoyao/hudi
1
0
Fork 0
Code Activity

[HUDI-1289] Remove relocation of pattern for hbase dependencies and add shading of guava in hadoop, spark, and presto bundles (#2147)

Browse Source 
- Update hudi-spark-bundle pom to not relocate hbase and htrace pattern
- Remove codec relocation as this is not included in bundle which was causing error
This commit is contained in:
rmpifer
2020-10-14 17:04:35 -07:00
committed by GitHub
parent 7fa641ea9a
commit a44f66869f
3 changed files with 6 additions and 31 deletions
Download Patch File Download Diff File Expand all files Collapse all files

15
packaging/hudi-hadoop-mr-bundle/pom.xml
View File

@@ -78,6 +78,7 @@
<include>org.apache.hbase:hbase-server</include>
<include>org.apache.htrace:htrace-core</include>
<include>com.yammer.metrics:metrics-core</include>
<include>com.google.guava:guava</include>
</includes>
</artifactSet>
<relocations>
@@ -102,18 +103,8 @@
<shadedPattern>org.apache.hudi.org.apache.avro.</shadedPattern>
</relocation>
<relocation>
<pattern>org.apache.hadoop.hbase.</pattern>
<shadedPattern>org.apache.hudi.org.apache.hadoop.hbase.</shadedPattern>
<excludes>
<!-- Hive 2.3.3 brings in Hbase 1.1.1 which conflicts with our version even with shading -->
<!-- Hbase Version check is implemented using a global runtime configuration hbase.defaults.for.version -->
<!-- The above configuration is auto set by hbase version used by hive at load time which conflicts with our version. Hence, the below exclusion to skip this check -->
<exclude>org.apache.hadoop.hbase.util.VersionInfo</exclude>
</excludes>
</relocation>
<relocation>
<pattern>org.apache.htrace.</pattern>
<shadedPattern>org.apache.hudi.org.apache.htrace.</shadedPattern>
<pattern>com.google.common.</pattern>
<shadedPattern>org.apache.hudi.com.google.common.</shadedPattern>
</relocation>
</relocations>
<createDependencyReducedPom>false</createDependencyReducedPom>