search

MattX / Milton

A searchable article database
1 stars 1 forks source link

Auto-archive Submitted Links #12

Open jasonrdsouza opened 4 years ago

jasonrdsouza commented 4 years ago

When a link is submitted to Milton, it would be nice if we automatically submitted it to a web archiver like this to ensure that we have a reference to the original content in the face of link rot.

jasonrdsouza commented 4 years ago

Potentially useful links:

jasonrdsouza commented 4 years ago

This WebRecorder project also seems pretty cool: https://webrecorder.net/

They have a hosted version at https://webrecorder.io/, but all of the source code is also available on Github. Aside from being able to run a local version of webrecorder.io, they also make the underlying pywb library available: https://pywb.readthedocs.io/en/latest/, so we could potentially just use that.