Introducing HoodieLogFormat V2 with versioning support

Browse Source

- HoodieLogFormat V2 has support for LogFormat evolution through versioning
			- LogVersion is associated with a LogBlock not a LogFile
			- Based on a version for a LogBlock, approporiate code path is executed
		- Implemented LazyReading of Hoodie Log Blocks with Memory / IO tradeoff
		- Implemented Reverse pointer to be able to traverse the log in reverse
		- Introduce new MAGIC for backwards compatibility with logs without versions

...

This commit is contained in:

Nishith Agarwal

2018-02-15 11:01:25 -08:00

committed by vinoth chandar

parent dfd1979c51

commit 5405a6287b

32 changed files with 2066 additions and 677 deletions

Show all changes Ignore whitespace when comparing lines Ignore changes in amount of whitespace Ignore changes in whitespace at EOL

Download Patch File Download Diff File Expand all files Collapse all files

BIN

docs/images/hoodie_log_format_v2.png Normal file

Binary file not shown.

Side by Side After Width:  |  Height:  |  Size: 218 KiB