apache / hudi-rs

A native Rust library for Apache Hudi, with bindings into Python
https://hudi.apache.org/
Apache License 2.0
142 stars 28 forks source link

feat: implement datafusion `TableProviderFactory` #162

Closed kazdy closed 5 days ago

kazdy commented 1 week ago

Description

resolves: #150

This allows datafusion users to register an external hudi table and query it like so:

CREATE EXTERNAL TABLE trips STORED AS HUDI LOCATION 'path';

SELECT * FROM trips;

How are the changes test-covered

codecov[bot] commented 1 week ago

Codecov Report

Attention: Patch coverage is 83.33333% with 2 lines in your changes missing coverage. Please review.

Project coverage is 90.44%. Comparing base (2d0ee12) to head (cbd1c99). Report is 1 commits behind head on main.

Files with missing lines Patch % Lines
crates/datafusion/src/lib.rs 83.33% 2 Missing :warning:
Additional details and impacted files ```diff @@ Coverage Diff @@ ## main #162 +/- ## ========================================== - Coverage 90.53% 90.44% -0.09% ========================================== Files 19 19 Lines 961 973 +12 ========================================== + Hits 870 880 +10 - Misses 91 93 +2 ```

:umbrella: View full report in Codecov by Sentry.
:loudspeaker: Have feedback on the report? Share it here.

kazdy commented 1 week ago

@xushiyan can I get another CI run, I added a test for when options are passed to create external table, should make codecov happy

xushiyan commented 6 days ago

@kazdy i'll push quick fixes and then freeze the code for release