datopian / metastore-lib

🗄️ Library for storing dataset metadata, with versioning support and pluggable backends including GitHub.
https://tech.datopian.com/versioning/
MIT License
10 stars 1 forks source link

GitHub: Moved / deleted resources leave dangling LFS pointer files #11

Open shevron opened 4 years ago

shevron commented 4 years ago

When using the GitHub backend with LFS support, if I delete a resource previously pointed to by an LFS pointer file, or change the path of an existing resource, and then call .update(), I will end up with an orphan LFS pointer file not pointing to a resource which exists in the current revision.

This can cause side effects when repositories are accessed directly via Git. When checked out, users will get the old LFS pointer files downloaded as-is without being removed or replaced by LFS.

Resources referred to by the latest revision should work correctly.