Go to file

Nishith Agarwal 7243ce40c9 Serializing the complete payload object instead of serializing just the GenericRecord

Removing Converter hierarchy as we now depend purely on JavaSerialization and require the payload to be java serializable

2018-12-04 11:43:41 -08:00

deploy

Add ossrh profile to publish maven artifacts to oss.sonatype.org (synced with maven central)

2016-12-21 14:17:35 -08:00

docker

Docker Container Build and Run setup with foundations for adding docker integration tests. Docker images built with Hadoop 2.8.4 Hive 2.3.3 and Spark 2.3.1 and published to docker-hub

2018-10-02 09:28:21 +05:30

docs

Enabling auto tuning of insert splits by default

2018-11-08 09:48:23 -08:00

hoodie-cli

Useful Hudi CLI commands to debug/analyze production workloads

2018-10-30 10:28:01 -07:00

hoodie-client

Serializing the complete payload object instead of serializing just the GenericRecord

2018-12-04 11:43:41 -08:00

hoodie-common

Serializing the complete payload object instead of serializing just the GenericRecord

2018-12-04 11:43:41 -08:00

hoodie-hadoop-mr

Fix regression which broke HudiInputFormat handling of non-hoodie datasets

2018-10-16 18:39:56 +01:00

hoodie-hive

Docker Container Build and Run setup with foundations for adding docker integration tests. Docker images built with Hadoop 2.8.4 Hive 2.3.3 and Spark 2.3.1 and published to docker-hub

2018-10-02 09:28:21 +05:30

hoodie-integ-test

Fix regression which broke HudiInputFormat handling of non-hoodie datasets

2018-10-16 18:39:56 +01:00

hoodie-spark

Serializing the complete payload object instead of serializing just the GenericRecord

2018-12-04 11:43:41 -08:00

hoodie-utilities

Compaction validate, unschedule and repair

2018-10-25 14:12:47 -07:00

packaging

[maven-release-plugin] prepare for next development iteration

2018-09-28 11:27:00 +05:30

style

CodeStyle formatting to conform to basic Checkstyle rules.

2018-03-30 11:09:40 -07:00

_config.yml

Set theme jekyll-theme-minimal

2016-12-29 16:53:39 -08:00

.gitignore

Importing Hoodie Client from internal repo

2016-12-16 14:34:42 -08:00

.travis.yml

Travis CI tests needs to be run in quieter mode (WARN log level) to avoid max log-size errors

2018-09-26 21:10:20 +05:30

CHANGELOG.md

Added CHANGELOG.md and updated community contributions guideline

2017-06-16 10:48:37 -07:00

LICENSE.txt

Importing Hoodie Client from internal repo

2016-12-16 14:34:42 -08:00

pom.xml

Update committership for balaji

2018-11-30 16:23:10 -08:00

README.md

Update README.md

2017-12-10 07:50:37 -08:00

RELEASE_NOTES.md

Update RELEASE_NOTES for release 0.4.4

2018-09-28 11:05:24 +05:30

README.md

Hudi

Hudi (pronounced Hoodie) stands for Hadoop Upserts anD Incrementals. Hudi manages storage of large analytical datasets on HDFS and serve them out via two types of tables

Read Optimized Table - Provides excellent query performance via purely columnar storage (e.g. Parquet)
Near-Real time Table (WIP) - Provides queries on real-time data, using a combination of columnar & row based storage (e.g Parquet + Avro)

For more, head over here

Languages

Java 81.4%

Scala 16.7%

ANTLR 0.9%

Shell 0.8%

Dockerfile 0.2%