lanyuanxiaoyao/hudi
1
0
Fork 0
Code Activity

Commit Graph

  • e0fc4ec38e Documentation update + helper method for WriteConfig builder Vinoth Chandar 2017-03-26 17:51:51 -07:00
  • dce35ff0d7 Adding a config to control whether date partitioning can be assumed Vinoth Chandar 2017-03-26 17:40:20 -07:00
  • f9fd16069d FSUtils.getAllPartitionsPaths() works based on .hoodie_partition_metadata Vinoth Chandar 2017-03-26 17:15:52 -07:00
  • 3129770fd0 Create .hoodie_partition_metadata in each partition, linking back to basepath - Concurreny handled via taskID, failure recovery handled via renames - Falls back to search 3 levels up - Cli tool has command to add this to existing tables Vinoth Chandar 2017-03-21 23:57:30 -07:00
  • 1e802ad4f2 Move HoodieAvroReader to hoodie-common, it will be used for compaction and in the record reader Prasanna Rajaperumal 2017-04-03 13:52:07 -07:00
  • aee136777b Fixes needed to run merge-on-read testing on production scale data Prasanna Rajaperumal 2017-03-31 01:02:02 -07:00
  • 57ab7a2405 [maven-release-plugin] prepare for next development iteration Prasanna Rajaperumal 2017-03-31 14:58:55 -07:00
  • 803c635098 [maven-release-plugin] prepare release hoodie-0.3.5 Prasanna Rajaperumal 2017-03-31 14:58:46 -07:00
  • f4bb44c1b1 Update snapshot version to 0.3.5-SNAPSHOT Prasanna Rajaperumal 2017-03-31 14:54:54 -07:00
  • 77e54e78f8 Create the partition path if it does not exist when listing data files in a partition Prasanna Rajaperumal 2017-03-27 14:49:26 -07:00
  • e3b273e9fd formatting for docs Yash Sharma 2017-03-28 10:30:50 +11:00
  • bca7e7dae4 improve documentations Yash Sharma 2017-03-27 17:29:00 +11:00
  • d6f94b998d Hoodie operability with S3 Yash Sharma 2017-03-24 14:42:10 +11:00
  • a7cd021f26 Update incremental pull query documentation prazanna 2017-03-23 16:20:54 -07:00
  • 0e3f635adb remove hardcoding of autoClean prazanna 2017-03-23 15:54:26 -07:00
  • a94f3a638e Pass table path as argument to HoodieClientExample Zeeshan Qureshi 2017-03-16 23:04:36 -04:00
  • b7047ab4fb Pass in String StroageLevel for WriteStatus (#113) fishie9 2017-03-23 04:31:30 -07:00
  • b02910c588 few fixes to quick start document (#112) ovj 2017-03-22 18:25:26 -07:00
  • f1b7afad21 Add config for index parallelism and make clean public (#109) prazanna 2017-03-21 17:36:46 -07:00
  • 21898907c1 tool for importing hive tables (in parquet format) into hoodie dataset (#89) ovj 2017-03-21 14:42:13 -07:00
  • d835710c51 Metadata timeline marks an already complete instant as complete again (#98) prazanna 2017-03-17 12:42:26 -07:00
  • d83b671ada Implement Savepoints and required metadata timeline - Part 2 Prasanna Rajaperumal 2017-03-13 23:09:29 -07:00
  • 6f36e1eaaf Implement Savepoints and required metadata timeline (#86) prazanna 2017-03-13 15:12:03 -07:00
  • 69d3950a32 Revamped Deltastreamer (#93) vinoth chandar 2017-03-13 12:41:29 -07:00
  • c3257b9680 Fix ugly favicon Vinoth Chandar 2017-03-12 20:28:27 -07:00
  • b252633fab Add analytics to site Vinoth Chandar 2017-03-12 19:39:58 -07:00
  • 404726031d Adding Siddhartha Gunda as a contributor prazanna 2017-03-04 01:36:21 -08:00
  • 348a48aa80 Add delete support to Hoodie (#85) siddharthagunda 2017-03-04 01:33:49 -08:00
  • 41e08018fc Fixing minor documentation fixes Prasanna Rajaperumal 2017-03-02 11:42:04 -08:00
  • d84aea3512 Fixing minor documentation fixes Prasanna Rajaperumal 2017-03-02 11:39:40 -08:00
  • 8a2a9ae764 Making minor documentation fixes prazanna 2017-03-02 11:35:09 -08:00
  • 116a78094f Cleanup code based on Java8 Lambdas (#84) vinoth chandar 2017-02-27 15:52:13 -08:00
  • c4fa585b27 Switch some info log to debug (#83) Wei Yan 2017-02-23 20:12:36 -08:00
  • fe5c5e8021 Test Failure in Travis-ci Prasanna Rajaperumal 2017-02-21 20:25:01 -08:00
  • 1132f3533d Merge and pull master commits Prasanna Rajaperumal 2017-02-21 17:53:28 -08:00
  • eb46e7c72b Implement Merge on Read Storage (#76) prazanna 2017-02-21 15:24:00 -08:00
  • 11d2fd3428 Introduce RealtimeTableView and Implement HoodieRealtimeTableCompactor (#73) prazanna 2017-02-06 14:32:32 -08:00
  • 48fbb0f425 Implement reliable log file management for Merge on read, which is fault tolerant and allows random block level access on avro file Prasanna Rajaperumal 2017-01-24 00:55:40 -08:00
  • ccd8cb2407 Take 2: Refactor hoodie-common and create right abstractions for Hoodie Storage V2.0 - Refactored timelines to be a single timeline for all active events and one for archived events. CommitTimeline and other timelines can be inferred by applying a filter on the activeTimelime - Introduced HoodieInstant to abstract different types of action, commit time and if isInFlight - Implemented other review comments Prasanna Rajaperumal 2017-01-18 01:00:36 -08:00
  • 8ee777a9bb Refactor hoodie-common and create right abstractions for Hoodie Storage V2.0 Prasanna Rajaperumal 2017-01-04 14:40:26 -08:00
  • 283269e57f [maven-release-plugin] prepare for next development iteration Prasanna Rajaperumal 2017-02-20 16:52:25 -08:00
  • d5a5f2ddff [maven-release-plugin] prepare release hoodie-0.3.0 Prasanna Rajaperumal 2017-02-20 16:52:04 -08:00
  • 0e234ac0ef Moving to Spark 2.1.0 Prasanna Rajaperumal 2017-02-20 16:47:52 -08:00
  • be1dd9444f [maven-release-plugin] prepare for next development iteration Prasanna Rajaperumal 2017-02-20 16:09:05 -08:00
  • 47583e280f [maven-release-plugin] prepare release hoodie-0.2.14 Prasanna Rajaperumal 2017-02-20 16:08:45 -08:00
  • 2d49711cce Changing the current development version to 0.2.14-SNAPSHOT Prasanna Rajaperumal 2017-02-20 16:01:24 -08:00
  • 4a47d26818 Fixing a javadoc lint issue Prasanna Rajaperumal 2017-02-20 15:57:58 -08:00
  • cc58a4c3e0 [maven-release-plugin] prepare for next development iteration Prasanna Rajaperumal 2017-02-20 15:49:45 -08:00
  • dd03038254 [maven-release-plugin] prepare release hoodie-0.2.13 Prasanna Rajaperumal 2017-02-20 15:49:20 -08:00
  • 7178cb5a3f Fixing a javadoc lint issue Prasanna Rajaperumal 2017-02-20 15:41:32 -08:00
  • 57a0b7a781 [maven-release-plugin] prepare for next development iteration Prasanna Rajaperumal 2017-02-20 15:35:19 -08:00
  • 9828bd8019 [maven-release-plugin] prepare release hoodie-0.2.12 Prasanna Rajaperumal 2017-02-20 15:35:03 -08:00
  • 8f12163166 [maven-release-plugin] prepare for next development iteration Prasanna Rajaperumal 2017-02-20 15:00:35 -08:00
  • 6e6f6efb94 [maven-release-plugin] prepare release hoodie-0.2.11 Prasanna Rajaperumal 2017-02-20 15:00:16 -08:00
  • 33a85900f8 Adding admin guide, guide for sql queries and incr processing Vinoth Chandar 2017-02-19 20:13:57 -08:00
  • dcc15d5d6f Adding docs for running sql queries on hoodie datasets Vinoth Chandar 2017-02-17 20:19:18 -08:00
  • 66e272e9eb Docs for performance section (#80) vinoth chandar 2017-02-17 18:30:56 -08:00
  • c7a8e15c78 Docs for impl & comparison (#79) vinoth chandar 2017-02-17 08:25:17 -08:00
  • a725382549 Add Configurations to Documentation Prasanna Rajaperumal 2017-02-06 14:12:18 -08:00
  • 186d70713f Adding documentation around Hoodie concepts (#71) vinoth chandar 2017-01-29 15:22:57 -08:00
  • 8e72ed69b4 Split insert() into insert() & bulkInsert() (#69) vinoth chandar 2017-01-27 10:51:00 -08:00
  • 54409b07ea Implement HoodieROTablePathFilter for use with Spark 2.0 (#66) vinoth chandar 2017-01-26 11:13:33 -08:00
  • 0004ae62ad Merge pull request #61 from zqureshi/format-comment-hoodiekey prazanna 2017-01-16 19:38:53 -08:00
  • 8a39730273 Format param comment in HoodieKey Zeeshan Qureshi 2017-01-16 22:14:30 -05:00
  • 693d751506 [maven-release-plugin] prepare for next development iteration Prasanna Rajaperumal 2017-01-10 22:27:35 -08:00
  • e9866bb4d9 [maven-release-plugin] prepare release hoodie-0.2.10 Prasanna Rajaperumal 2017-01-10 22:27:28 -08:00
  • e4e3395f3e Make commit a public method. Introduce a auto-commit config. Relates issue https://github.com/uber/hoodie/issues/58 (#60) prazanna 2017-01-10 22:14:40 -08:00
  • 9d09a58a18 Merge pull request #56 from vinothchandar/master vinoth chandar 2017-01-09 11:32:35 -08:00
  • 40a63fcab4 Shorten README and point to site Vinoth Chandar 2017-01-09 11:30:46 -08:00
  • 1559a3826f Minor fixes to use_cases.md vinoth chandar 2017-01-06 00:06:15 -08:00
  • 534c898c6b Merge pull request #34 from vinothchandar/master vinoth chandar 2017-01-05 23:57:48 -08:00
  • 5a7d408c3c Fixing the eyesore red font color over sidebar for docs Vinoth Chandar 2017-01-05 23:55:53 -08:00
  • 1ced46ab3e [maven-release-plugin] prepare for next development iteration Prasanna Rajaperumal 2017-01-05 20:04:35 -08:00
  • e9f0d4d0bf [maven-release-plugin] prepare release hoodie-0.2.9 Prasanna Rajaperumal 2017-01-05 20:04:28 -08:00
  • 1d72b164c8 Javadoc generation fails because of invalid html tags Prasanna Rajaperumal 2017-01-05 19:56:41 -08:00
  • 7171ea6909 [maven-release-plugin] prepare for next development iteration Prasanna Rajaperumal 2017-01-05 19:43:31 -08:00
  • c1f2d1e456 [maven-release-plugin] prepare release hoodie-0.2.8 Prasanna Rajaperumal 2017-01-05 19:43:25 -08:00
  • 9071220a30 Merge pull request #33 from vinothchandar/master prazanna 2017-01-05 19:28:59 -08:00
  • b2c958519e Changing Update record failure semantics to be consistent with inserts - Don't skip, but writes the same old record again now - Marks the correspoinding HoodieRecord as failure to be handed back to the client Vinoth Chandar 2017-01-05 17:26:47 -08:00
  • 93de14f2cf Merge pull request #32 from prazanna/master vinoth chandar 2017-01-05 16:59:31 -08:00
  • 6dd603352e Make sure to fail with HoodieUpsertException if HoodieUpdateHandle is not properly initialized Prasanna Rajaperumal 2017-01-05 16:45:59 -08:00
  • ee9be707e5 Merge pull request #26 from prazanna/master vinoth chandar 2017-01-05 16:45:08 -08:00
  • 64858239d1 Update use_cases.md vinoth chandar 2017-01-04 23:58:09 -08:00
  • 5d5e346c61 Merge pull request #28 from vinothchandar/add-docs vinoth chandar 2017-01-04 20:54:39 -08:00
  • 958f7ceda6 Adding Documentation for Getting Started Section Vinoth Chandar 2017-01-04 20:50:44 -08:00
  • 2475610246 Build hoodie-hadoop-mr as a fat jar - include hoodie common Prasanna Rajaperumal 2017-01-04 14:51:46 -08:00
  • 362a84377b Merge remote-tracking branch 'uber/master' Prasanna Rajaperumal 2017-01-04 14:42:05 -08:00
  • 83d4163c75 Merge pull request #25 from vinothchandar/master prazanna 2017-01-04 14:12:16 -08:00
  • dd8638c2cc Annotate HoodieInputFormat with UseFileSplitsFromInputFormat - Tested with corresponding Presto changes (pending PR) Vinoth Chandar 2017-01-04 11:18:05 -08:00
  • 16f20ebe39 Merge remote-tracking branch 'uber/master' Prasanna Rajaperumal 2017-01-03 20:40:34 -08:00
  • 040c7aa766 Delete CNAME prazanna 2017-01-03 18:24:36 -08:00
  • 7da5e9a03a Create CNAME prazanna 2017-01-03 17:26:28 -08:00
  • d525687512 Delete CNAME vinoth chandar 2016-12-30 11:26:44 -08:00
  • e73686be69 Create CNAME vinoth chandar 2016-12-30 11:24:24 -08:00
  • 70b50df79e Merge pull request #13 from vinothchandar/add-docs vinoth chandar 2016-12-30 11:16:18 -08:00
  • 2bf0db14c6 Adding docs folder, with skeleton jekyll based site Vinoth Chandar 2016-12-30 11:05:22 -08:00
  • db72a33d9a Delete CNAME vinoth chandar 2016-12-29 16:56:49 -08:00
  • e750506228 Create CNAME vinoth chandar 2016-12-29 16:54:37 -08:00
  • e8e43a22db Set theme jekyll-theme-minimal vinoth chandar 2016-12-29 16:53:39 -08:00
  • ac7595669c Merge pull request #12 from vinothchandar/master vinoth chandar 2016-12-28 16:51:55 -08:00