search

ArchiveTeam / grab-site

The archivist's web crawler: WARC output, dashboard for all crawls, dynamic ignore patterns
Other
1.31k stars 129 forks source link

Dockerfile? #182

Closed 818S closed 3 years ago

818S commented 3 years ago

Saw a pull request for this here https://github.com/ArchiveTeam/grab-site/pull/93 but there hasn't been a update for years

So are there any plans to officially ship a Dockerfile for this to simplify the installation and improve reliability?

Doing so would also make it more cross-platform.

jtagcat commented 3 years ago

Don't open up a duplicate issue please.

ivan commented 3 years ago

I don't use Docker and there hasn't been anyone else around to do the technical leadership necessary to get Docker support included and maintained here. This is not just about making a Docker container, but also fully documenting all the equivalent usage in the README, which would probably involve one container per grab-site process. For cross-platform installation, I recommend installing grab-site from nixpkgs. This should work on any Linux and macOS (though more cumbersome).

jtagcat commented 3 years ago

Make a fork / start your own.

acrois commented 2 years ago

What I am developing here works: https://github.com/acrois/grab-site/tree/feature/dockerfile it includes #149 into my branch and then I am updating it to include best practices and I am including it in the plan outline at #192