Excessive storage use by Toolforge deployment

bennofs / wdumper

Tool for generating filtered Wikidata RDF exports

https://tools.wmflabs.org/wdumps

MIT License

36 stars 5 forks source link

Closed bd808 closed 3 years ago

bd808 commented 3 years ago

T247449 NFS utilization is up to 310.95 GB. I wonder if the various 2019 and 2020 dump files in $HOME/dumpfiles/wikidatawiki/ are still useful data?

bennofs commented 3 years ago

They're not, but they also don't use much space:

tools.wdumps@tools-sgebastion-07:~$ du -sch dumpfiles/wikidatawiki/
956K    dumpfiles/wikidatawiki/

bennofs commented 3 years ago

Would it help if I move the dumpfiles to /scratch?

bd808 commented 3 years ago

Closing per the follow up at https://phabricator.wikimedia.org/T247449. Thank you for helping us keep NFS storage limping along for Toolforge. :)