lanyuanxiaoyao/hudi
1
0
Fork 0
Code Activity

improve documentations

Browse Source
This commit is contained in:
Yash Sharma
2017-03-27 17:29:00 +11:00
committed by vinoth chandar
parent d6f94b998d
commit bca7e7dae4
5 changed files with 29 additions and 33 deletions
Download Patch File Download Diff File Expand all files Collapse all files

8
docs/s3_filesystem.md
View File

@@ -10,6 +10,10 @@ Hoodie works with HDFS by default. There is an experimental work going on Hoodie
## S3 configs
There are two configurations required for Hoodie-S3 compatibility:
- Adding AWS Credentials for Hoodie
- Adding required Jars to classpath
Add the required configs in your core-site.xml from where Hoodie can fetch them. Replace the `fs.defaultFS` with your S3 bucket name and Hoodie should be able to read/write from the bucket.
```
@@ -44,4 +48,8 @@ Add the required configs in your core-site.xml from where Hoodie can fetch them.
</property>
```
AWS hadoop libraries to add to your classpath -
- com.amazonaws:aws-java-sdk:1.10.34
- org.apache.hadoop:hadoop-aws:2.7.3