lanyuanxiaoyao/hudi
1
0
Fork 0
Code Activity

[HUDI-254]: Bundle and shade databricks/avro with spark bundle

Browse Source 
- spark 2.4 onwards, spark has built in support. shading to avoid conflicts
 - spark 2.3 still needs this bundled, so that dropping bundle into jars folder would work
This commit is contained in:
Vinoth Chandar
2019-09-17 12:00:41 -07:00
committed by Balaji Varadarajan
parent c1e7d0e5a6
commit e217db56ab
2 changed files with 6 additions and 1 deletions
Download Patch File Download Diff File Expand all files Collapse all files

1
hudi-spark/pom.xml
View File

@@ -216,7 +216,6 @@
<groupId>com.databricks</groupId>
<artifactId>spark-avro_2.11</artifactId>
<version>4.0.0</version>
<scope>provided</scope>
</dependency>
<!-- Hadoop -->