zooniverse / Talk-archiver

A static site generator for old Talk forums, based on elevenpack.
Apache License 2.0
0 stars 1 forks source link

Some filenames aren't compatible with Azure Storage #78

Closed adammcmaster closed 4 years ago

adammcmaster commented 4 years ago

Azure storage has more restrictive rules on filenames than S3. In our case, it seems some files/directories have periods at the end of their names, which is not allowed. (The docs say to avoid it, but azcopy encounters a 403 error when it tries to PUT those files so they appear to be disallowed completely.)

Example failing request: PUT https://zooniversestatic.blob.core.windows.net/$web/talk.chicagowildlifewatch.org/users/Salma_S./comments.html

Affected sites so far:

See also Slack discussion. Summary:

camallen commented 4 years ago

one option to avoid a rebuild of all these sites is to manually rename all impacted paths for each site in s3. We would then provide the nginx URL rewrite via static server and copy the files over via azcopy

camallen commented 4 years ago

closed by #85 i've manually run the remap scripts and our nginx proxy now serves the invalid char URLs from the remapped files via https://github.com/zooniverse/static/pull/179