Preserve Referenced Content - Githubissues

partridge-tech / chris-blog

You know, for me.

https://chris.partridge.tech/

MIT License

19 stars 2 forks source link

Preserve Referenced Content #4

Open tweedge opened 4 years ago

tweedge commented 4 years ago

Fuck link rot.

Can I make an Action which:

Parses all markdown in the content folder for links.
Downloads a list of previously known links.
Filters for only new links.
Screenshots, webarchives, etc. all new links.
Bulk loads the results into a data store somewhere else? Maybe an S3 bucket?

tweedge commented 4 years ago

Since this is just for me, I don't care about parallelism, fwiw. If needed, I'll dedupe or clean manually.