openzim / wp1_selection_tools

Create selections with the best articles of a WM project
https://download.kiwix.org/wp1/
GNU General Public License v3.0
6 stars 3 forks source link

Target uploads to new dropbox address #43

Closed rgaudin closed 2 years ago

rgaudin commented 2 years ago

SSH server which was used to receive file uploads (CI, nightly and release) has been migrated to a new one on a different address. Username, Key and paths are unchanged. Most notable changes are the use of master.download.kiwix.org as the target in replacement of mirror.download.kiwix.org (although it would still work) and the port to which SSH is listening on (30022 instead of 22)

I changed the expected remote file format: must include a port number (or ::).

I already changed remote file on instance-wp1.mwoffliner to ci@download.openzim.org:30022:/data/openzim/wp1/

You'll notice I changed the logic a bit so that top/customs/projects ZIP files are extracted on disk first then uploaded.

Reason behind this is that there is no shell on that server so you can't unzip on the remote anymore. I've looked at files and I don't think file size is an issue in that case.

Note: we can do it differently; it's just a suggestion so that your builds are fixed (those are probably failing starting tonight).