opencivicdata / scrapers-us-municipal

Scrapers for US municipal governments.
MIT License
101 stars 67 forks source link

Errors when setting up with Docker #394

Open pes10k opened 10 months ago

pes10k commented 10 months ago

New to the project, but i'm not able to get the system to run / build with docker.

The issue seems to be related to this

https://serverfault.com/questions/1074688/security-debian-org-does-not-have-a-release-file-on-with-debian-docker-images

but I'm not familiar enough with docker to know how to fix that issue in this project, and / or whether there is a fix here that should be pushed up / PR'ed in this project.

[~/Code/scrapers-us-municipal]$ docker-compose run --rm scrapers pupa init YOUR_CITY_SCRAPER
[+] Running 18/18
 ✔ postgres 17 layers [⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿]      0B/0B      Pulled          91.8s
   ✔ b7f91549542c Pull complete                                           48.4s
   ✔ 2a8eeda3ee97 Pull complete                                            0.3s
   ✔ c7d80e163fd1 Pull complete                                            9.3s
   ✔ 18645305d904 Pull complete                                            3.4s
   ✔ 7b292c9e4fc0 Pull complete                                            8.5s
   ✔ cca4a0495b6a Pull complete                                            9.3s
   ✔ c33c4a75b0f6 Pull complete                                            9.5s
   ✔ e7dee0dd847b Pull complete                                            9.6s
   ✔ ad2667c4fb09 Pull complete                                           87.9s
   ✔ 858f56b660b0 Pull complete                                           10.4s
   ✔ 5e4cf68957b8 Pull complete                                           11.0s
   ✔ 4d1e2891e31d Pull complete                                           11.6s
   ✔ 37b53aa30362 Pull complete                                           12.1s
   ✔ 680688222fdb Pull complete                                           74.9s
   ✔ 4f4fb700ef54 Pull complete                                           48.6s
   ✔ c640b5bc6473 Pull complete                                           48.9s
   ✔ 1657a2f3e11e Pull complete                                           49.3s
[+] Creating 4/3
 ✔ Network scrapers-us-municipal_default                                                                                                                   Created0.0s ainer scrapers-us-municipal-postgres                      Creating  0.3s
 ✔ Volume "scrapers-us-municipal_scrapers-us-municipal-db-data"                                                                                            Created0.0s
 ✔ Container scrapers-us-municipal-postgres                                                                                                                Created0.3s
 ! postgres The requested image's platform (linux/amd64) does not match the detected host platform (linux/arm64/v8) and no specific platform was requested 0.0s
[+] Running 1/1
 ✔ Container scrapers-us-municipal-postgres  Started                       0.2s
[+] Running 1/1
 ! scrapers Warning                                                        0.7s
[+] Building 20.1s (6/11)                                  docker:desktop-linux
 => [scrapers internal] load build definition from Dockerfile              0.0s
 => => transferring dockerfile: 502B                                       0.0s
 => [scrapers internal] load .dockerignore                                 0.0s
 => => transferring context: 2B                                            0.0s
 => [scrapers internal] load metadata for docker.io/library/python:3.6-sl  0.9s
 => [scrapers 1/7] FROM docker.io/library/python:3.6-slim-stretch@sha256  17.6s
 => => resolve docker.io/library/python:3.6-slim-stretch@sha256:66f641652  0.0s
 => => sha256:9446cb1d83c6a0c67349532479316e2879ee83ab09 9.36MB / 9.36MB  10.0s
 => => sha256:66f641652a3549459fe8f72e2daebbb5be383cf3120 1.22kB / 1.22kB  0.0s
 => => sha256:7f4a6c5f8ff9af79ac06e8a66f0170a2e3e23d9b57d 1.37kB / 1.37kB  0.0s
 => => sha256:4813bcae7d93c32db45c7b8b7e06c41e36211d1bbeb 8.30kB / 8.30kB  0.0s
 => => sha256:9e7a560784c85cb9624bff5b6e479fbb95d5e265 20.39MB / 20.39MB  16.1s
 => => sha256:f106dd115c60608b983fe2f2d8a76d91f00d8ceecee 2.22MB / 2.22MB  2.8s
 => => sha256:804ff02ace78c6494a6487ad23d3046d26df062f73dc1f6 241B / 241B  3.2s
 => => sha256:6988844e83a160c492294dd3adc631f50daadf44731 2.49MB / 2.49MB  7.0s
 => => extracting sha256:9e7a560784c85cb9624bff5b6e479fbb95d5e26587398701  0.9s
 => => extracting sha256:f106dd115c60608b983fe2f2d8a76d91f00d8ceecee4b904  0.1s
 => => extracting sha256:9446cb1d83c6a0c67349532479316e2879ee83ab09622de8  0.3s
 => => extracting sha256:804ff02ace78c6494a6487ad23d3046d26df062f73dc1f63  0.0s
 => => extracting sha256:6988844e83a160c492294dd3adc631f50daadf44731ae05c  0.2s
 => [scrapers internal] load build context                                 0.1s
 => => transferring context: 9.32MB                                        0.1s
 => ERROR [scrapers 2/7] RUN apt-get update &&     apt-get install -y lib  1.5s
------
 > [scrapers 2/7] RUN apt-get update &&     apt-get install -y libxml2-dev gdal-bin &&     apt-get clean &&     rm -rf /var/cache/apt/* /var/lib/apt/lists/*:
0.376 Ign:1 http://deb.debian.org/debian stretch InRelease
0.389 Ign:2 http://security.debian.org/debian-security stretch/updates InRelease
0.433 Ign:3 http://deb.debian.org/debian stretch-updates InRelease
0.463 Ign:4 http://security.debian.org/debian-security stretch/updates Release
0.492 Ign:5 http://deb.debian.org/debian stretch Release
0.508 Ign:6 http://security.debian.org/debian-security stretch/updates/main all Packages
0.538 Ign:7 http://deb.debian.org/debian stretch-updates Release
0.555 Ign:8 http://security.debian.org/debian-security stretch/updates/main arm64 Packages
0.578 Ign:9 http://deb.debian.org/debian stretch/main all Packages
0.598 Ign:6 http://security.debian.org/debian-security stretch/updates/main all Packages
0.624 Ign:10 http://deb.debian.org/debian stretch/main arm64 Packages
0.642 Ign:8 http://security.debian.org/debian-security stretch/updates/main arm64 Packages
0.666 Ign:11 http://deb.debian.org/debian stretch-updates/main arm64 Packages
0.690 Ign:6 http://security.debian.org/debian-security stretch/updates/main all Packages
0.706 Ign:12 http://deb.debian.org/debian stretch-updates/main all Packages
0.723 Ign:8 http://security.debian.org/debian-security stretch/updates/main arm64 Packages
0.741 Ign:9 http://deb.debian.org/debian stretch/main all Packages
0.758 Ign:6 http://security.debian.org/debian-security stretch/updates/main all Packages
0.773 Ign:10 http://deb.debian.org/debian stretch/main arm64 Packages
0.794 Ign:8 http://security.debian.org/debian-security stretch/updates/main arm64 Packages
0.809 Ign:11 http://deb.debian.org/debian stretch-updates/main arm64 Packages
0.829 Ign:6 http://security.debian.org/debian-security stretch/updates/main all Packages
0.849 Ign:12 http://deb.debian.org/debian stretch-updates/main all Packages
0.866 Ign:8 http://security.debian.org/debian-security stretch/updates/main arm64 Packages
0.884 Ign:9 http://deb.debian.org/debian stretch/main all Packages
0.902 Ign:6 http://security.debian.org/debian-security stretch/updates/main all Packages
0.915 Ign:10 http://deb.debian.org/debian stretch/main arm64 Packages
0.937 Err:8 http://security.debian.org/debian-security stretch/updates/main arm64 Packages
0.937   404  Not Found
0.954 Ign:11 http://deb.debian.org/debian stretch-updates/main arm64 Packages
0.989 Ign:12 http://deb.debian.org/debian stretch-updates/main all Packages
1.023 Ign:9 http://deb.debian.org/debian stretch/main all Packages
1.055 Ign:10 http://deb.debian.org/debian stretch/main arm64 Packages
1.087 Ign:11 http://deb.debian.org/debian stretch-updates/main arm64 Packages
1.122 Ign:12 http://deb.debian.org/debian stretch-updates/main all Packages
1.158 Ign:9 http://deb.debian.org/debian stretch/main all Packages
1.193 Ign:10 http://deb.debian.org/debian stretch/main arm64 Packages
1.228 Ign:11 http://deb.debian.org/debian stretch-updates/main arm64 Packages
1.264 Ign:12 http://deb.debian.org/debian stretch-updates/main all Packages
1.307 Ign:9 http://deb.debian.org/debian stretch/main all Packages
1.342 Err:10 http://deb.debian.org/debian stretch/main arm64 Packages
1.342   404  Not Found
1.403 Err:11 http://deb.debian.org/debian stretch-updates/main arm64 Packages
1.403   404  Not Found
1.457 Ign:12 http://deb.debian.org/debian stretch-updates/main all Packages
1.464 Reading package lists...
1.472 W: The repository 'http://security.debian.org/debian-security stretch/updates Release' does not have a Release file.
1.472 W: The repository 'http://deb.debian.org/debian stretch Release' does not have a Release file.
1.472 W: The repository 'http://deb.debian.org/debian stretch-updates Release' does not have a Release file.
1.472 E: Failed to fetch http://security.debian.org/debian-security/dists/stretch/updates/main/binary-arm64/Packages  404  Not Found
1.472 E: Failed to fetch http://deb.debian.org/debian/dists/stretch/main/binary-arm64/Packages  404  Not Found
1.472 E: Failed to fetch http://deb.debian.org/debian/dists/stretch-updates/main/binary-arm64/Packages  404  Not Found
1.472 E: Some index files failed to download. They have been ignored, or old ones used instead.
------
failed to solve: process "/bin/sh -c apt-get update &&     apt-get install -y libxml2-dev gdal-bin &&     apt-get clean &&     rm -rf /var/cache/apt/* /var/lib/apt/lists/*" did not complete successfully: exit code: 100