alephdata / memorious

Lightweight web scraping toolkit for documents and structured data.
https://docs.alephdata.org/developers/memorious
MIT License
311 stars 59 forks source link

Filepaths that are longer than 255 characters should be shortened #202

Open breyten opened 2 years ago

breyten commented 2 years ago

image

When using the directory method in the store part of the pipeline, errors will be thrown when memorious tries to save a file with a really long filepath (as seen above, in the image). This can be remedied by shortening the filename if such an error occurs.

Rosencrantz commented 1 year ago

@breyten Are you running in a windows/NTFS environment, or similar?