aai-institute / lakefs-spec

An fsspec implementation for the lakeFS project.
http://lakefs-spec.org/
Apache License 2.0
37 stars 4 forks source link

Best Practices Demo (PyData). #232

Closed maxmynter closed 5 months ago

maxmynter commented 6 months ago

Timed Presentation of the demo took me ~ 10 mins.

Best Practices Covered:

  • Define a data repository
  • Follow a branching strategy that ensures data integrity on the main branch, e.g. by running tests on feature branch datasets.
  • Utilize reusable and tested functions for data transformation.
  • Use commits to save checkpoints and merge branches for atomic changes.
  • Keep naming (of branches and commits) consistent, concise, and unique.
  • Use descriptive naming where it matters .

Question to Reviewer:

maxmynter commented 5 months ago

Done.

Currently working on merging the updated main and migrating away from the client_helpers.

codecov[bot] commented 5 months ago

Codecov Report

All modified and coverable lines are covered by tests :white_check_mark:

Comparison is base (9c936ca) 94.07% compared to head (232ba6c) 94.07%. Report is 2 commits behind head on main.

Additional details and impacted files ```diff @@ Coverage Diff @@ ## main #232 +/- ## ======================================= Coverage 94.07% 94.07% ======================================= Files 5 5 Lines 405 405 Branches 70 70 ======================================= Hits 381 381 Misses 15 15 Partials 9 9 ```

:umbrella: View full report in Codecov by Sentry.
:loudspeaker: Have feedback on the report? Share it here.

maxmynter commented 5 months ago

Closing in favour of having this in a dedicated Repository.