Vinoth Chandar
89cd6b0726
[maven-release-plugin] prepare for next development iteration
2018-08-22 21:30:05 -07:00
Vinoth Chandar
8d305c5a86
[maven-release-plugin] prepare release hoodie-0.4.3
2018-08-22 21:29:53 -07:00
Vinoth Chandar
34827d50e1
[maven-release-plugin] prepare for next development iteration
2018-06-11 08:59:13 -07:00
Vinoth Chandar
43ef385730
[maven-release-plugin] prepare release hoodie-0.4.2
2018-06-11 08:59:02 -07:00
Vinoth Chandar
73534d467f
[maven-release-plugin] prepare for next development iteration
2018-03-07 21:04:10 -08:00
Vinoth Chandar
f2e5c6f9f8
[maven-release-plugin] prepare release hoodie-0.4.1
2018-03-07 21:04:00 -08:00
Nishith Agarwal
be0b1f3e57
Adding global indexing to HbaseIndex implementation
...
- Adding tests or HbaseIndex
- Enabling global index functionality
2018-02-05 15:21:22 -08:00
Vinoth Chandar
e45679f5e2
Reformatting code per Google Code Style all over
2017-11-12 23:19:02 -08:00
Vinoth Chandar
e1fe3ab937
[maven-release-plugin] prepare for next development iteration
2017-10-02 22:42:54 -07:00
Vinoth Chandar
50139fe904
[maven-release-plugin] prepare release hoodie-0.4.0
2017-10-02 22:42:32 -07:00
Vinoth Chandar
64e0573aca
Adding hoodie-spark to support Spark Datasource for Hoodie
...
- Write with COW/MOR paths work fully
- Read with RO view works on both storages*
- Incremental view supported on COW
- Refactored out HoodieReadClient methods, to just contain key based access
- HoodieDataSourceHelpers class can be now used to construct inputs to datasource
- Tests in hoodie-client using new helpers and mechanisms
- Basic tests around save modes & insert/upserts (more to follow)
- Bumped up scala to 2.11, since 2.10 is deprecated & complains with scalatest
- Updated documentation to describe usage
- New sample app written using the DataSource API
2017-10-02 20:44:53 -07:00
Nishith Agarwal
616c9a68c3
Enabled deletes in merge_on_read
2017-07-26 13:37:27 -07:00
Prasanna Rajaperumal
7d3963b4ab
Pushing master to 0.4.0 as we continue to make minor releases over 0.3.8 (MVP for MOR)
2017-06-30 11:41:23 -07:00
Nishith Agarwal
3eba812a1b
[maven-release-plugin] prepare for next development iteration
2017-06-30 11:17:07 -07:00
Nishith Agarwal
06d44daea3
[maven-release-plugin] prepare release hoodie-0.3.9
2017-06-30 11:16:58 -07:00
Prasanna Rajaperumal
0ed3fac5e3
[maven-release-plugin] prepare for next development iteration
2017-06-16 11:03:17 -07:00
Prasanna Rajaperumal
45732e440c
[maven-release-plugin] prepare release hoodie-0.3.8
2017-06-16 10:59:58 -07:00
Prasanna Rajaperumal
933cc8071f
[maven-release-plugin] prepare for next development iteration
2017-05-24 14:02:50 -07:00
Prasanna Rajaperumal
bebae06b5b
[maven-release-plugin] prepare release hoodie-0.3.7
2017-05-24 14:02:41 -07:00
Prasanna Rajaperumal
c3258039f0
[maven-release-plugin] prepare for next development iteration
2017-04-27 11:00:56 -07:00
Prasanna Rajaperumal
de1bdad756
[maven-release-plugin] prepare release hoodie-0.3.6
2017-04-27 11:00:45 -07:00
Prasanna Rajaperumal
57ab7a2405
[maven-release-plugin] prepare for next development iteration
2017-03-31 14:58:55 -07:00
Prasanna Rajaperumal
803c635098
[maven-release-plugin] prepare release hoodie-0.3.5
2017-03-31 14:58:46 -07:00
Prasanna Rajaperumal
f4bb44c1b1
Update snapshot version to 0.3.5-SNAPSHOT
2017-03-31 14:54:54 -07:00
Yash Sharma
bca7e7dae4
improve documentations
2017-03-28 05:08:54 -07:00
ovj
21898907c1
tool for importing hive tables (in parquet format) into hoodie dataset ( #89 )
...
* tool for importing hive tables (in parquet format) into hoodie dataset
* review fixes
* review fixes
* review fixes
2017-03-21 14:42:13 -07:00
Prasanna Rajaperumal
48fbb0f425
Implement reliable log file management for Merge on read, which is fault tolerant and allows random block level access on avro file
2017-02-21 16:23:53 -08:00
Prasanna Rajaperumal
8ee777a9bb
Refactor hoodie-common and create right abstractions for Hoodie Storage V2.0
...
The following is the gist of changes done
- All low-level operation of creating a commit code was in HoodieClient which made it hard to share code if there was a compaction commit.
- HoodieTableMetadata contained a mix of metadata and filtering files. (Also few operations required FileSystem to be passed in because those were called from TaskExecutors and others had FileSystem as a global variable). Since merge-on-read requires a lot of that code, but will have to change slightly on how it operates on the metadata and how it filters the files. The two set of operation are split into HoodieTableMetaClient and TableFileSystemView.
- Everything (active commits, archived commits, cleaner log, save point log and in future delta and compaction commits) in HoodieTableMetaClient is a HoodieTimeline. Timeline is a series of instants, which has an in-built concept of inflight and completed commit markers.
- A timeline can be queries for ranges, contains and also use to create new datapoint (create a new commit etc). Commit (and all the above metadata) creation/deletion is streamlined in a timeline
- Multiple timelines can be merged into a single timeline, giving us an audit timeline to whatever happened in a hoodie dataset. This also helps with #55 .
- Move to java 8 and introduce java 8 succinct syntax in refactored code
2017-02-21 16:23:53 -08:00
Prasanna Rajaperumal
283269e57f
[maven-release-plugin] prepare for next development iteration
2017-02-20 16:52:25 -08:00
Prasanna Rajaperumal
d5a5f2ddff
[maven-release-plugin] prepare release hoodie-0.3.0
2017-02-20 16:52:04 -08:00
Prasanna Rajaperumal
be1dd9444f
[maven-release-plugin] prepare for next development iteration
2017-02-20 16:09:05 -08:00
Prasanna Rajaperumal
47583e280f
[maven-release-plugin] prepare release hoodie-0.2.14
2017-02-20 16:08:45 -08:00
Prasanna Rajaperumal
2d49711cce
Changing the current development version to 0.2.14-SNAPSHOT
2017-02-20 16:01:24 -08:00
Prasanna Rajaperumal
cc58a4c3e0
[maven-release-plugin] prepare for next development iteration
2017-02-20 15:49:45 -08:00
Prasanna Rajaperumal
dd03038254
[maven-release-plugin] prepare release hoodie-0.2.13
2017-02-20 15:49:20 -08:00
Prasanna Rajaperumal
57a0b7a781
[maven-release-plugin] prepare for next development iteration
2017-02-20 15:35:19 -08:00
Prasanna Rajaperumal
9828bd8019
[maven-release-plugin] prepare release hoodie-0.2.12
2017-02-20 15:35:03 -08:00
Prasanna Rajaperumal
8f12163166
[maven-release-plugin] prepare for next development iteration
2017-02-20 15:00:35 -08:00
Prasanna Rajaperumal
6e6f6efb94
[maven-release-plugin] prepare release hoodie-0.2.11
2017-02-20 15:00:16 -08:00
Prasanna Rajaperumal
693d751506
[maven-release-plugin] prepare for next development iteration
2017-01-10 22:27:35 -08:00
Prasanna Rajaperumal
e9866bb4d9
[maven-release-plugin] prepare release hoodie-0.2.10
2017-01-10 22:27:28 -08:00
Prasanna Rajaperumal
1ced46ab3e
[maven-release-plugin] prepare for next development iteration
2017-01-05 20:04:35 -08:00
Prasanna Rajaperumal
e9f0d4d0bf
[maven-release-plugin] prepare release hoodie-0.2.9
2017-01-05 20:04:28 -08:00
Prasanna Rajaperumal
7171ea6909
[maven-release-plugin] prepare for next development iteration
2017-01-05 19:43:31 -08:00
Prasanna Rajaperumal
c1f2d1e456
[maven-release-plugin] prepare release hoodie-0.2.8
2017-01-05 19:43:25 -08:00
Prasanna Rajaperumal
ee854da9b2
[maven-release-plugin] prepare for next development iteration
2016-12-21 17:38:57 -08:00
Prasanna Rajaperumal
587aaffcf6
[maven-release-plugin] prepare release hoodie-0.2.7
2016-12-21 17:38:50 -08:00
Prasanna Rajaperumal
12885ab60a
[maven-release-plugin] prepare for next development iteration
2016-12-21 16:48:36 -08:00
Prasanna Rajaperumal
d42f235bbc
[maven-release-plugin] prepare release hoodie-0.2.6
2016-12-21 16:48:30 -08:00
Prasanna Rajaperumal
5f9be58576
[maven-release-plugin] prepare for next development iteration
2016-12-21 14:45:37 -08:00
