--- title: S3 Filesystem (experimental) keywords: sql hive s3 spark presto sidebar: mydoc_sidebar permalink: s3_hoodie.html toc: false summary: In this page, we go over how to configure hoodie with S3 filesystem. --- Hoodie works with HDFS by default. There is an experimental work going on Hoodie-S3 compatibility. ## AWS configs There are two configurations required for Hoodie-S3 compatibility: - Adding AWS Credentials for Hoodie - Adding required Jars to classpath ### AWS Credentials Add the required configs in your core-site.xml from where Hoodie can fetch them. Replace the `fs.defaultFS` with your S3 bucket name and Hoodie should be able to read/write from the bucket. ``` fs.defaultFS s3://ysharma fs.s3.impl org.apache.hadoop.fs.s3native.NativeS3FileSystem fs.s3.awsAccessKeyId AWS_KEY fs.s3.awsSecretAccessKey AWS_SECRET fs.s3n.awsAccessKeyId AWS_KEY fs.s3n.awsSecretAccessKey AWS_SECRET ``` ### AWS Libs AWS hadoop libraries to add to our classpath - com.amazonaws:aws-java-sdk:1.10.34 - org.apache.hadoop:hadoop-aws:2.7.3