prazanna
7ef76a4de0
Adding Kathy Ge to the contributors list
2017-06-16 12:52:54 -07:00
Prasanna Rajaperumal
0ed3fac5e3
[maven-release-plugin] prepare for next development iteration
2017-06-16 11:03:17 -07:00
Prasanna Rajaperumal
45732e440c
[maven-release-plugin] prepare release hoodie-0.3.8
2017-06-16 10:59:58 -07:00
Prasanna Rajaperumal
e44f9b889b
Added CHANGELOG.md and updated community contributions guideline
2017-06-16 10:48:37 -07:00
Prasanna Rajaperumal
db6150c5ef
Refactor hoodie-hive
2017-06-09 13:06:33 -07:00
Prasanna Rajaperumal
933cc8071f
[maven-release-plugin] prepare for next development iteration
2017-05-24 14:02:50 -07:00
Prasanna Rajaperumal
bebae06b5b
[maven-release-plugin] prepare release hoodie-0.3.7
2017-05-24 14:02:41 -07:00
prazanna
e1d13f2bc8
https://repository.cloudera.com/artifactory/repo/ has been changed to https://repository.cloudera.com/artifactory/public/
2017-05-23 12:05:01 -07:00
Vinoth Chandar
7014670795
Update contributor list
2017-05-18 10:48:42 -07:00
Vinoth Chandar
da17c5c607
Introduce getCommitsAndCompactionsTimeline() explicitly & adjust usage across code base
2017-05-01 21:48:27 -07:00
Prasanna Rajaperumal
c3258039f0
[maven-release-plugin] prepare for next development iteration
2017-04-27 11:00:56 -07:00
Prasanna Rajaperumal
de1bdad756
[maven-release-plugin] prepare release hoodie-0.3.6
2017-04-27 11:00:45 -07:00
Prasanna Rajaperumal
aee136777b
Fixes needed to run merge-on-read testing on production scale data
2017-04-02 22:25:47 -07:00
Prasanna Rajaperumal
57ab7a2405
[maven-release-plugin] prepare for next development iteration
2017-03-31 14:58:55 -07:00
Prasanna Rajaperumal
803c635098
[maven-release-plugin] prepare release hoodie-0.3.5
2017-03-31 14:58:46 -07:00
Prasanna Rajaperumal
f4bb44c1b1
Update snapshot version to 0.3.5-SNAPSHOT
2017-03-31 14:54:54 -07:00
ovj
21898907c1
tool for importing hive tables (in parquet format) into hoodie dataset ( #89 )
...
* tool for importing hive tables (in parquet format) into hoodie dataset
* review fixes
* review fixes
* review fixes
2017-03-21 14:42:13 -07:00
prazanna
6f36e1eaaf
Implement Savepoints and required metadata timeline ( #86 )
...
- Introduce avro to save clean metadata with details about the last commit that was retained
- Save rollback metadata in the meta timeline
- Create savepoint metadata and add API to createSavepoint, deleteSavepoint and rollbackToSavepoint
- Savepointed commit should not be rolledback or cleaned or archived
- introduce cli commands to show, create and rollback to savepoints
- Write unit tests to test savepoints and rollbackToSavepoints
2017-03-13 15:12:03 -07:00
prazanna
404726031d
Adding Siddhartha Gunda as a contributor
...
for his contribution on the delete api
2017-03-04 01:36:21 -08:00
Prasanna Rajaperumal
48fbb0f425
Implement reliable log file management for Merge on read, which is fault tolerant and allows random block level access on avro file
2017-02-21 16:23:53 -08:00
Prasanna Rajaperumal
8ee777a9bb
Refactor hoodie-common and create right abstractions for Hoodie Storage V2.0
...
The following is the gist of changes done
- All low-level operation of creating a commit code was in HoodieClient which made it hard to share code if there was a compaction commit.
- HoodieTableMetadata contained a mix of metadata and filtering files. (Also few operations required FileSystem to be passed in because those were called from TaskExecutors and others had FileSystem as a global variable). Since merge-on-read requires a lot of that code, but will have to change slightly on how it operates on the metadata and how it filters the files. The two set of operation are split into HoodieTableMetaClient and TableFileSystemView.
- Everything (active commits, archived commits, cleaner log, save point log and in future delta and compaction commits) in HoodieTableMetaClient is a HoodieTimeline. Timeline is a series of instants, which has an in-built concept of inflight and completed commit markers.
- A timeline can be queries for ranges, contains and also use to create new datapoint (create a new commit etc). Commit (and all the above metadata) creation/deletion is streamlined in a timeline
- Multiple timelines can be merged into a single timeline, giving us an audit timeline to whatever happened in a hoodie dataset. This also helps with #55 .
- Move to java 8 and introduce java 8 succinct syntax in refactored code
2017-02-21 16:23:53 -08:00
Prasanna Rajaperumal
283269e57f
[maven-release-plugin] prepare for next development iteration
2017-02-20 16:52:25 -08:00
Prasanna Rajaperumal
d5a5f2ddff
[maven-release-plugin] prepare release hoodie-0.3.0
2017-02-20 16:52:04 -08:00
Prasanna Rajaperumal
0e234ac0ef
Moving to Spark 2.1.0
2017-02-20 16:47:52 -08:00
Prasanna Rajaperumal
be1dd9444f
[maven-release-plugin] prepare for next development iteration
2017-02-20 16:09:05 -08:00
Prasanna Rajaperumal
47583e280f
[maven-release-plugin] prepare release hoodie-0.2.14
2017-02-20 16:08:45 -08:00
Prasanna Rajaperumal
2d49711cce
Changing the current development version to 0.2.14-SNAPSHOT
2017-02-20 16:01:24 -08:00
Prasanna Rajaperumal
4a47d26818
Fixing a javadoc lint issue
2017-02-20 15:57:58 -08:00
Prasanna Rajaperumal
cc58a4c3e0
[maven-release-plugin] prepare for next development iteration
2017-02-20 15:49:45 -08:00
Prasanna Rajaperumal
dd03038254
[maven-release-plugin] prepare release hoodie-0.2.13
2017-02-20 15:49:20 -08:00
Prasanna Rajaperumal
57a0b7a781
[maven-release-plugin] prepare for next development iteration
2017-02-20 15:35:19 -08:00
Prasanna Rajaperumal
9828bd8019
[maven-release-plugin] prepare release hoodie-0.2.12
2017-02-20 15:35:03 -08:00
Prasanna Rajaperumal
8f12163166
[maven-release-plugin] prepare for next development iteration
2017-02-20 15:00:35 -08:00
Prasanna Rajaperumal
6e6f6efb94
[maven-release-plugin] prepare release hoodie-0.2.11
2017-02-20 15:00:16 -08:00
Prasanna Rajaperumal
693d751506
[maven-release-plugin] prepare for next development iteration
2017-01-10 22:27:35 -08:00
Prasanna Rajaperumal
e9866bb4d9
[maven-release-plugin] prepare release hoodie-0.2.10
2017-01-10 22:27:28 -08:00
Prasanna Rajaperumal
1ced46ab3e
[maven-release-plugin] prepare for next development iteration
2017-01-05 20:04:35 -08:00
Prasanna Rajaperumal
e9f0d4d0bf
[maven-release-plugin] prepare release hoodie-0.2.9
2017-01-05 20:04:28 -08:00
Prasanna Rajaperumal
7171ea6909
[maven-release-plugin] prepare for next development iteration
2017-01-05 19:43:31 -08:00
Prasanna Rajaperumal
c1f2d1e456
[maven-release-plugin] prepare release hoodie-0.2.8
2017-01-05 19:43:25 -08:00
vinoth chandar
501ef9d4da
Merge pull request #10 from vinothchandar/master
...
Adding hoodie-utilities module
2016-12-28 16:38:12 -08:00
Vinoth Chandar
0c854faebe
Adding hoodie-utilities module
2016-12-28 15:42:30 -08:00
Prasanna Rajaperumal
ee854da9b2
[maven-release-plugin] prepare for next development iteration
2016-12-21 17:38:57 -08:00
Prasanna Rajaperumal
587aaffcf6
[maven-release-plugin] prepare release hoodie-0.2.7
2016-12-21 17:38:50 -08:00
Prasanna Rajaperumal
b6d8e857f0
Fix javadoc issues. Prelude to pushing libs to maven central
2016-12-21 17:34:29 -08:00
Prasanna Rajaperumal
12885ab60a
[maven-release-plugin] prepare for next development iteration
2016-12-21 16:48:36 -08:00
Prasanna Rajaperumal
d42f235bbc
[maven-release-plugin] prepare release hoodie-0.2.6
2016-12-21 16:48:30 -08:00
Prasanna Rajaperumal
4b28ecae1b
Naming the release profile correctly
2016-12-21 16:44:04 -08:00
Prasanna Rajaperumal
5f9be58576
[maven-release-plugin] prepare for next development iteration
2016-12-21 14:45:37 -08:00
Prasanna Rajaperumal
5362e92886
[maven-release-plugin] prepare release hoodie-0.2.5
2016-12-21 14:45:31 -08:00
