ArchiveTeam / warrior-dockerfile

A Dockerfile for the ArchiveTeam Warrior
304 stars 57 forks source link

zstandard python module needed #55

Closed billsargent closed 3 years ago

billsargent commented 3 years ago

For some projects, such as yahoo answers, zstandard python module is needed. I'm working with the raspberry pi docker file. I've had to add python-dev and python3-dev to the apt-get for the container, and also add pip3 install zstandard and pip install zstandard.

I'm not sure if this is something that needs to be permanent in the docker file or not.

jhollowe commented 3 years ago

I've been working on getting a build working on the Pi here but have pause on this repo to work on implementing multiarch builds for the requisite repos/tools.

Ultimately, it would be great to split the Dockerfile into two steps to have a build step and a final step which only copies in the built tools from the builder step (docker multi-stage builds)

billsargent commented 3 years ago

I seem to be stuck now with no working wget+at errors. Everything compiles as normal though, including wget. So there must be something else going on inside the container.

TomGlass commented 3 years ago

Hello guys,

We're not supporting ARM right now. We are working to develop a new version but we do need to do thorough testing on the various components including the different variants of wget-at we use. Please do not test that version on live projects @jhollowe due to possible garbage data being produced

TomGlass commented 3 years ago

https://github.com/ArchiveTeam/warrior-dockerfile/issues/56