Tools for downloading and preserving wikis. We archive wikis, from Wikipedia to tiniest wikis. As of 2024, WikiTeam has preserved more than 600,000 wikis.
This means it uses our configured user-agent, as well as any cookies.
This was needed to save https://wiiki.wii-homebrew.com/Hauptseite and https://breath-of-the-wild.wii-homebrew.com/Hauptseite which are behind cloudflare. I completed the cloudflare challenge in my browser, and then saved the following into a file named cookies.txt (where 1698010873 is the expirey time as a unix timestamp - probably it could have been anything, and longalphanumericstring was the value seen in firefox's devtools, and the values are separated by tabs, and there was no trailing newline):
Then running with --cookies cookies.txt worked properly. Note that I also changed the user-agent to match what firefox currently uses (and what was used when I completed the challenge); I'm not sure if this was actually needed:
Makes sense. Thanks! It's unfortunate that so many wikis are behind cloudflare, but it can't be ignored. I wonder if we can identify such cases and print an informative error with instructions.
This means it uses our configured user-agent, as well as any cookies.
This was needed to save https://wiiki.wii-homebrew.com/Hauptseite and https://breath-of-the-wild.wii-homebrew.com/Hauptseite which are behind cloudflare. I completed the cloudflare challenge in my browser, and then saved the following into a file named
cookies.txt
(where1698010873
is the expirey time as a unix timestamp - probably it could have been anything, andlongalphanumericstring
was the value seen in firefox's devtools, and the values are separated by tabs, and there was no trailing newline):Then running with
--cookies cookies.txt
worked properly. Note that I also changed the user-agent to match what firefox currently uses (and what was used when I completed the challenge); I'm not sure if this was actually needed: