search

Princeton-CDH / derrida-django

Derrida's Margins - Python/Django web application
https://derridas-margins.princeton.edu
Apache License 2.0
8 stars 1 forks source link

Generate a full seed list for webscrape #288

Closed kmcelwee closed 2 years ago

kmcelwee commented 2 years ago

Ensure that these pages are available

kmcelwee commented 2 years ago

Caliper scrape did not discover any significant gaps between production and the archive. Some static files may be included:

http://localhost:8080/derrida/20210928203330oe_/https://derridas-margins.princeton.edu/static/manifest.json
http://localhost:8080/derrida/20210928203330oe_/https://derridas-margins.princeton.edu/static/safari-pinned-tab.svg
http://localhost:8080/derrida/20210928203330oe_/https://derridas-margins.princeton.edu/static/favicon-16x16.png
http://localhost:8080/derrida/20210928203330oe_/https://derridas-margins.princeton.edu/static/apple-touch-icon.png
http://localhost:8080/derrida/20210928203330oe_/http://derridas-margins.princeton.edu/static/safari-pinned-tab.svg
http://localhost:8080/derrida/20210928203330oe_/http://derridas-margins.princeton.edu/static/manifest.json
http://localhost:8080/derrida/20210928203330oe_/http://derridas-margins.princeton.edu/static/favicon-16x16.png
http://localhost:8080/derrida/20210928203330oe_/http://derridas-margins.princeton.edu/static/apple-touch-icon.png
https:///static/css/base.css # < ---- I don't fully understand this

URL encoding may be an issue. Process documented here: https://github.com/kmcelwee/derrida-archive-report/pull/1