Go to file

vinothchandar 9ca6f91e97 Perform consistency checks during write finalize

- Check to ensure written files are listable on storage
 - Docs reflected to capture how this helps with s3 storage
 - Unit tests added, corrections to existing tests
 - Fix DeltaStreamer to manage archived commits in a separate folder

2018-09-28 08:04:41 +05:30

deploy

Add ossrh profile to publish maven artifacts to oss.sonatype.org (synced with maven central)

2016-12-21 14:17:35 -08:00

docs

Perform consistency checks during write finalize

2018-09-28 08:04:41 +05:30

hoodie-cli

Explicitly release resources in LogFileReader and TestHoodieClientBase

2018-09-20 13:24:57 +05:30

hoodie-client

Perform consistency checks during write finalize

2018-09-28 08:04:41 +05:30

hoodie-common

Perform consistency checks during write finalize

2018-09-28 08:04:41 +05:30

hoodie-hadoop-mr

Travis CI tests needs to be run in quieter mode (WARN log level) to avoid max log-size errors

2018-09-26 21:10:20 +05:30

hoodie-hive

Travis CI tests needs to be run in quieter mode (WARN log level) to avoid max log-size errors

2018-09-26 21:10:20 +05:30

hoodie-integ-test/src/test/resources

Travis CI tests needs to be run in quieter mode (WARN log level) to avoid max log-size errors

2018-09-26 21:10:20 +05:30

hoodie-spark

Perform consistency checks during write finalize

2018-09-28 08:04:41 +05:30

hoodie-utilities

Perform consistency checks during write finalize

2018-09-28 08:04:41 +05:30

packaging

Add dummy classes to dump all classes loaded as part of packaging modules to ensure javadoc and sources jars are getting created

2018-09-18 09:24:33 +05:30

style

CodeStyle formatting to conform to basic Checkstyle rules.

2018-03-30 11:09:40 -07:00

_config.yml

Set theme jekyll-theme-minimal

2016-12-29 16:53:39 -08:00

.gitignore

Importing Hoodie Client from internal repo

2016-12-16 14:34:42 -08:00

.travis.yml

Travis CI tests needs to be run in quieter mode (WARN log level) to avoid max log-size errors

2018-09-26 21:10:20 +05:30

CHANGELOG.md

Added CHANGELOG.md and updated community contributions guideline

2017-06-16 10:48:37 -07:00

LICENSE.txt

Importing Hoodie Client from internal repo

2016-12-16 14:34:42 -08:00

pom.xml

Perform consistency checks during write finalize

2018-09-28 08:04:41 +05:30

README.md

Update README.md

2017-12-10 07:50:37 -08:00

RELEASE_NOTES.md

Release notes for 0.4.4

2018-09-12 23:39:57 +05:30

README.md

Hudi

Hudi (pronounced Hoodie) stands for Hadoop Upserts anD Incrementals. Hudi manages storage of large analytical datasets on HDFS and serve them out via two types of tables

Read Optimized Table - Provides excellent query performance via purely columnar storage (e.g. Parquet)
Near-Real time Table (WIP) - Provides queries on real-time data, using a combination of columnar & row based storage (e.g Parquet + Avro)

For more, head over here

Languages

Java 81.4%

Scala 16.7%

ANTLR 0.9%

Shell 0.8%

Dockerfile 0.2%