improve documentations
This commit is contained in:
committed by
vinoth chandar
parent
d6f94b998d
commit
bca7e7dae4
@@ -76,4 +76,7 @@ summary: "Here we list all possible configurations and what they mean"
|
||||
- [usePrefix](#usePrefix) () <br/>
|
||||
<span style="color:grey">Standard prefix for all metrics</span>
|
||||
|
||||
- [S3Configs](s3_hoodie.html) (Hoodie S3 Configs) <br/>
|
||||
<span style="color:grey">Configurations required for S3 and Hoodie co-operability.</span>
|
||||
|
||||
{% include callout.html content="Hoodie is a young project. A lot of pluggable interfaces and configurations to support diverse workloads need to be created. Get involved [here](https://github.com/uber/hoodie)" type="info" %}
|
||||
|
||||
@@ -10,6 +10,10 @@ Hoodie works with HDFS by default. There is an experimental work going on Hoodie
|
||||
|
||||
## S3 configs
|
||||
|
||||
There are two configurations required for Hoodie-S3 compatibility:
|
||||
- Adding AWS Credentials for Hoodie
|
||||
- Adding required Jars to classpath
|
||||
|
||||
Add the required configs in your core-site.xml from where Hoodie can fetch them. Replace the `fs.defaultFS` with your S3 bucket name and Hoodie should be able to read/write from the bucket.
|
||||
|
||||
```
|
||||
@@ -44,4 +48,8 @@ Add the required configs in your core-site.xml from where Hoodie can fetch them.
|
||||
</property>
|
||||
```
|
||||
|
||||
AWS hadoop libraries to add to your classpath -
|
||||
- com.amazonaws:aws-java-sdk:1.10.34
|
||||
- org.apache.hadoop:hadoop-aws:2.7.3
|
||||
|
||||
|
||||
|
||||
Reference in New Issue
Block a user