lanyuanxiaoyao/hudi
1
0
Fork 0
Code Activity

[HUDI-1650] Custom avro kafka deserializer. (#2619)

Browse Source 
* Custom avro kafka deserializer

Co-authored-by: volodymyr.burenin <volodymyr.burenin@cloudkitchens.com>
Co-authored-by: Sivabalan Narayanan <sivabala@uber.com>
This commit is contained in:
Volodymyr Burenin
2021-03-20 02:51:08 -05:00
committed by GitHub
parent 161d530f93
commit 900de34e45
6 changed files with 314 additions and 4 deletions
Download Patch File Download Diff File Expand all files Collapse all files

7
hudi-spark-datasource/hudi-spark-common/src/main/scala/org/apache/hudi/DataSourceOptions.scala
View File

@@ -373,4 +373,11 @@ object DataSourceWriteOptions {
// Async Compaction - Enabled by default for MOR
val ASYNC_COMPACT_ENABLE_OPT_KEY = "hoodie.datasource.compaction.async.enable"
val DEFAULT_ASYNC_COMPACT_ENABLE_OPT_VAL = "true"
// Avro Kafka Source configs
val KAFKA_AVRO_VALUE_DESERIALIZER = "hoodie.deltastreamer.source.kafka.value.deserializer.class"
// Schema provider class to be set to be used in custom kakfa deserializer
val SCHEMA_PROVIDER_CLASS_PROP = "hoodie.deltastreamer.schemaprovider.class"
}