Archive old Zimit1 ZIMs

benoit74 commented 4 days ago

Now that migration to Zimit2 is almost done, we want to archive all Zimit1 ZIMs so that the normal folder and the library contains only Zimit2 ZIMs.

Following ZIMs will be moved from /data/download/zim/zimit to /data/download/archive/zim/zimit1 (containing also Zimit1 ZIMs which have been "overriden" by a more recent Zimit2 ZIM, so that we are sure to not fallback to a Zimit1 ZIM "by accident"):

100r-off-the-grid_en_2023-09.zim
100r-off-the-grid_en_2023-12.zim
armypubs_en_all_2023-08.zim
athena_fr_all_2024-05.zim
based.cooking_en_all_2024-05.zim
bibnum_fr_all_2021-12.zim
birds-of-ladakh_en_all_2022-08.zim
birds-of-ladakh_en_all_2023-02.zim
bnr_fr_all_2024-05.zim
booksdash_en_all_2023-02.zim
bouquineux.com_fr_all_2024-04.zim
cheatography.com_en_all_2022-04.zim
courses.lumenlearning.com_en_all_2021-03.zim
dart.dev_en_all_2024-03.zim
der-postillon.com_de_all_2020-12.zim
developer.mozilla.org_en_all_2023-02.zim
developer.mozilla.org_en_all_2024-01.zim
docs.python.org_en_2024-05.zim
encyclopedie-environnement.org_en_2024-05.zim
fas-military-medicine_en_2023-06.zim
fonts.google_en_2024-03.zim
fonts.google_en_2024-06.zim
getbootstrap.com_en_all_2024-05.zim
ghana-bece-past-questions_en_all_2022-05.zim
grimgrains_en_all_2024-05.zim
internet-encyclopedia-philosophy_en_all_2024-02.zim
jeffe.cs.illinois.edu_en_all_2024-05.zim
liberius.net_fr_all_2024-05.zim
marxists.org_de_all_2024-04.zim
marxists.org_es_all_2024-04.zim
music.dalitio.de_en_all_2024-05.zim
mutopiaproject.org_en_2024-05.zim
ncert-audiobooks_en_all_2022-05.zim
noted.lol_en_2024-05.zim
opendatastructures.org_en_all_2024-05.zim
openmusictheory.com_2024-03.zim
peps.python_en_all_2024-05.zim
scientific-alliance.obscurative.ru_ru_all_2024-05.zim
smbc-comics.com_en_2024-04.zim
stacks.math.columbia.edu_en_all_2022-01.zim
teoria.com_en_2023-08.zim
teoria.com_en_2024-02.zim
tomlehrersongs.com_en_2024-05.zim
tonedear.com_en_2024-05.zim
tvtropes_en_all_2023-08.zim
tvtropes_en_all_2023-09.zim
www.ready.gov_en_2024-03.zim
www.ready.gov_es_2024-03.zim

Checklist

[x] wait until there are no more in-progress Orders in the imager that includes those ZIMs (apriori @rgaudin)
[x] delete ZIMs on the file server (apriori @benoit74)
[x] trigger imager catalog refresh right after the move so any Order created right after uses the new URL (apriori @rgaudin)

rgaudin commented 4 days ago

OK let's coordinate together this week

benoit74 commented 4 days ago

Yep, that's the idea

benoit74 commented 4 days ago

Commands to issue on kstorage:

Validation


ls /data/download/zim/zimit/100r-off-the-grid_en_2023-09.zim
ls /data/download/zim/zimit/100r-off-the-grid_en_2023-12.zim
ls /data/download/zim/zimit/armypubs_en_all_2023-08.zim
ls /data/download/zim/zimit/athena_fr_all_2024-05.zim
ls /data/download/zim/zimit/based.cooking_en_all_2024-05.zim
ls /data/download/zim/zimit/bibnum_fr_all_2021-12.zim
ls /data/download/zim/zimit/birds-of-ladakh_en_all_2022-08.zim
ls /data/download/zim/zimit/birds-of-ladakh_en_all_2023-02.zim
ls /data/download/zim/zimit/bnr_fr_all_2024-05.zim
ls /data/download/zim/zimit/booksdash_en_all_2023-02.zim
ls /data/download/zim/zimit/bouquineux.com_fr_all_2024-04.zim
ls /data/download/zim/zimit/cheatography.com_en_all_2022-04.zim
ls /data/download/zim/zimit/courses.lumenlearning.com_en_all_2021-03.zim
ls /data/download/zim/zimit/dart.dev_en_all_2024-03.zim
ls /data/download/zim/zimit/der-postillon.com_de_all_2020-12.zim
ls /data/download/zim/zimit/developer.mozilla.org_en_all_2023-02.zim
ls /data/download/zim/zimit/developer.mozilla.org_en_all_2024-01.zim
ls /data/download/zim/zimit/docs.python.org_en_2024-05.zim
ls /data/download/zim/zimit/encyclopedie-environnement.org_en_2024-05.zim
ls /data/download/zim/zimit/fas-military-medicine_en_2023-06.zim
ls /data/download/zim/zimit/fonts.google_en_2024-03.zim
ls /data/download/zim/zimit/fonts.google_en_2024-06.zim
ls /data/download/zim/zimit/getbootstrap.com_en_all_2024-05.zim
ls /data/download/zim/zimit/ghana-bece-past-questions_en_all_2022-05.zim
ls /data/download/zim/zimit/grimgrains_en_all_2024-05.zim
ls /data/download/zim/zimit/internet-encyclopedia-philosophy_en_all_2024-02.zim
ls /data/download/zim/zimit/jeffe.cs.illinois.edu_en_all_2024-05.zim
ls /data/download/zim/zimit/liberius.net_fr_all_2024-05.zim
ls /data/download/zim/zimit/marxists.org_de_all_2024-04.zim
ls /data/download/zim/zimit/marxists.org_es_all_2024-04.zim
ls /data/download/zim/zimit/music.dalitio.de_en_all_2024-05.zim
ls /data/download/zim/zimit/mutopiaproject.org_en_2024-05.zim
ls /data/download/zim/zimit/ncert-audiobooks_en_all_2022-05.zim
ls /data/download/zim/zimit/noted.lol_en_2024-05.zim
ls /data/download/zim/zimit/opendatastructures.org_en_all_2024-05.zim
ls /data/download/zim/zimit/openmusictheory.com_2024-03.zim
ls /data/download/zim/zimit/peps.python_en_all_2024-05.zim
ls /data/download/zim/zimit/scientific-alliance.obscurative.ru_ru_all_2024-05.zim
ls /data/download/zim/zimit/smbc-comics.com_en_2024-04.zim
ls /data/download/zim/zimit/stacks.math.columbia.edu_en_all_2022-01.zim
ls /data/download/zim/zimit/teoria.com_en_2023-08.zim
ls /data/download/zim/zimit/teoria.com_en_2024-02.zim
ls /data/download/zim/zimit/tomlehrersongs.com_en_2024-05.zim
ls /data/download/zim/zimit/tonedear.com_en_2024-05.zim
ls /data/download/zim/zimit/tvtropes_en_all_2023-08.zim
ls /data/download/zim/zimit/tvtropes_en_all_2023-09.zim
ls /data/download/zim/zimit/www.ready.gov_en_2024-03.zim
ls /data/download/zim/zimit/www.ready.gov_es_2024-03.zim

Move

mv /data/download/zim/zimit/100r-off-the-grid_en_2023-09.zim /data/download/archive/zim/zimit1
mv /data/download/zim/zimit/100r-off-the-grid_en_2023-12.zim /data/download/archive/zim/zimit1
mv /data/download/zim/zimit/armypubs_en_all_2023-08.zim /data/download/archive/zim/zimit1
mv /data/download/zim/zimit/athena_fr_all_2024-05.zim /data/download/archive/zim/zimit1
mv /data/download/zim/zimit/based.cooking_en_all_2024-05.zim /data/download/archive/zim/zimit1
mv /data/download/zim/zimit/bibnum_fr_all_2021-12.zim /data/download/archive/zim/zimit1
mv /data/download/zim/zimit/birds-of-ladakh_en_all_2022-08.zim /data/download/archive/zim/zimit1
mv /data/download/zim/zimit/birds-of-ladakh_en_all_2023-02.zim /data/download/archive/zim/zimit1
mv /data/download/zim/zimit/bnr_fr_all_2024-05.zim /data/download/archive/zim/zimit1
mv /data/download/zim/zimit/booksdash_en_all_2023-02.zim /data/download/archive/zim/zimit1
mv /data/download/zim/zimit/bouquineux.com_fr_all_2024-04.zim /data/download/archive/zim/zimit1
mv /data/download/zim/zimit/cheatography.com_en_all_2022-04.zim /data/download/archive/zim/zimit1
mv /data/download/zim/zimit/courses.lumenlearning.com_en_all_2021-03.zim /data/download/archive/zim/zimit1
mv /data/download/zim/zimit/dart.dev_en_all_2024-03.zim /data/download/archive/zim/zimit1
mv /data/download/zim/zimit/der-postillon.com_de_all_2020-12.zim /data/download/archive/zim/zimit1
mv /data/download/zim/zimit/developer.mozilla.org_en_all_2023-02.zim /data/download/archive/zim/zimit1
mv /data/download/zim/zimit/developer.mozilla.org_en_all_2024-01.zim /data/download/archive/zim/zimit1
mv /data/download/zim/zimit/docs.python.org_en_2024-05.zim /data/download/archive/zim/zimit1
mv /data/download/zim/zimit/encyclopedie-environnement.org_en_2024-05.zim /data/download/archive/zim/zimit1
mv /data/download/zim/zimit/fas-military-medicine_en_2023-06.zim /data/download/archive/zim/zimit1
mv /data/download/zim/zimit/fonts.google_en_2024-03.zim /data/download/archive/zim/zimit1
mv /data/download/zim/zimit/fonts.google_en_2024-06.zim /data/download/archive/zim/zimit1
mv /data/download/zim/zimit/getbootstrap.com_en_all_2024-05.zim /data/download/archive/zim/zimit1
mv /data/download/zim/zimit/ghana-bece-past-questions_en_all_2022-05.zim /data/download/archive/zim/zimit1
mv /data/download/zim/zimit/grimgrains_en_all_2024-05.zim /data/download/archive/zim/zimit1
mv /data/download/zim/zimit/internet-encyclopedia-philosophy_en_all_2024-02.zim /data/download/archive/zim/zimit1
mv /data/download/zim/zimit/jeffe.cs.illinois.edu_en_all_2024-05.zim /data/download/archive/zim/zimit1
mv /data/download/zim/zimit/liberius.net_fr_all_2024-05.zim /data/download/archive/zim/zimit1
mv /data/download/zim/zimit/marxists.org_de_all_2024-04.zim /data/download/archive/zim/zimit1
mv /data/download/zim/zimit/marxists.org_es_all_2024-04.zim /data/download/archive/zim/zimit1
mv /data/download/zim/zimit/music.dalitio.de_en_all_2024-05.zim /data/download/archive/zim/zimit1
mv /data/download/zim/zimit/mutopiaproject.org_en_2024-05.zim /data/download/archive/zim/zimit1
mv /data/download/zim/zimit/ncert-audiobooks_en_all_2022-05.zim /data/download/archive/zim/zimit1
mv /data/download/zim/zimit/noted.lol_en_2024-05.zim /data/download/archive/zim/zimit1
mv /data/download/zim/zimit/opendatastructures.org_en_all_2024-05.zim /data/download/archive/zim/zimit1
mv /data/download/zim/zimit/openmusictheory.com_2024-03.zim /data/download/archive/zim/zimit1
mv /data/download/zim/zimit/peps.python_en_all_2024-05.zim /data/download/archive/zim/zimit1
mv /data/download/zim/zimit/scientific-alliance.obscurative.ru_ru_all_2024-05.zim /data/download/archive/zim/zimit1
mv /data/download/zim/zimit/smbc-comics.com_en_2024-04.zim /data/download/archive/zim/zimit1
mv /data/download/zim/zimit/stacks.math.columbia.edu_en_all_2022-01.zim /data/download/archive/zim/zimit1
mv /data/download/zim/zimit/teoria.com_en_2023-08.zim /data/download/archive/zim/zimit1
mv /data/download/zim/zimit/teoria.com_en_2024-02.zim /data/download/archive/zim/zimit1
mv /data/download/zim/zimit/tomlehrersongs.com_en_2024-05.zim /data/download/archive/zim/zimit1
mv /data/download/zim/zimit/tonedear.com_en_2024-05.zim /data/download/archive/zim/zimit1
mv /data/download/zim/zimit/tvtropes_en_all_2023-08.zim /data/download/archive/zim/zimit1
mv /data/download/zim/zimit/tvtropes_en_all_2023-09.zim /data/download/archive/zim/zimit1
mv /data/download/zim/zimit/www.ready.gov_en_2024-03.zim /data/download/archive/zim/zimit1
mv /data/download/zim/zimit/www.ready.gov_es_2024-03.zim /data/download/archive/zim/zimit1

benoit74 commented 4 days ago

Deletion completed

openzim / zim-requests