lanyuanxiaoyao/hudi
1
0
Fork 0
Code Activity

[HUDI-69] Support Spark Datasource for MOR table - RDD approach (#1848)

Browse Source 
- This PR implements Spark Datasource for MOR table in the RDD approach.
- Implemented SnapshotRelation
- Implemented HudiMergeOnReadRDD
- Implemented separate Iterator to handle merge and unmerge record reader.
- Added TestMORDataSource to verify this feature.
- Clean up test file name, add tests for mixed query type tests
 - We can now revert the change made in DefaultSource

Co-authored-by: Vinoth Chandar <vchandar@confluent.io>
This commit is contained in:
Gary Li
2020-08-07 00:28:14 -07:00
committed by GitHub
parent ab453f2623
commit 4f74a84607
22 changed files with 1317 additions and 409 deletions
Download Patch File Download Diff File Expand all files Collapse all files

2
hudi-client/src/test/java/org/apache/hudi/testutils/HoodieClientTestBase.java
View File

@@ -71,7 +71,7 @@ import static org.junit.jupiter.api.Assertions.assertTrue;
*/
public class HoodieClientTestBase extends HoodieClientTestHarness {
private static final Logger LOG = LogManager.getLogger(HoodieClientTestBase.class);
protected static final Logger LOG = LogManager.getLogger(HoodieClientTestBase.class);
@BeforeEach
public void setUp() throws Exception {