search

aai-institute / lakefs-spec

An fsspec implementation for the lakeFS project.
http://lakefs-spec.org/
Apache License 2.0
37 stars 4 forks source link

Docs: Demonstrate integration of Hugging Face Datasets #275

Closed AdrianoKF closed 3 months ago

AdrianoKF commented 3 months ago

Similar to the lakeFS PR, this PR adds an example of how to interact with lakeFS repositories from the HF Datasets library.

It also adds a mention of the library in the repository README and docs landing page.

codecov[bot] commented 3 months ago

Codecov Report

All modified and coverable lines are covered by tests :white_check_mark:

Project coverage is 94.37%. Comparing base (d75c5b2) to head (a0c45b9).

:exclamation: Current head a0c45b9 differs from pull request most recent head 52d977c. Consider uploading reports for the commit 52d977c to get more accurate results

Additional details and impacted files ```diff @@ Coverage Diff @@ ## main #275 +/- ## ======================================= Coverage 94.37% 94.37% ======================================= Files 5 5 Lines 391 391 Branches 73 73 ======================================= Hits 369 369 Misses 13 13 Partials 9 9 ```

:umbrella: View full report in Codecov by Sentry.
:loudspeaker: Have feedback on the report? Share it here.

AdrianoKF commented 3 months ago

Nice!

On a meta-level: I remember that the polars code example broke out of the blue in some newer version. Should we add those examples to an integration test suite?

Good point. Eventually, I'd very much like that - the only problem is that the code examples in the docs currently assume a certain environment (but I guess we can hardcode that assumption for the time being, still better than no tests at all).