[Feature Request] Add ArchiveBox as an archival endpoint

sissbruecker / linkding

Self-hosted bookmark manager that is designed be to be minimal, fast, and easy to set up using Docker.

https://linkding.link/

MIT License

6.22k stars 294 forks source link

[Feature Request] Add ArchiveBox as an archival endpoint #380

Open ctag opened 1 year ago

ctag commented 1 year ago

ArchiveBox is a self-hosted web archival tool that stores pages in a variety of formats. While it appears there isn't a stable REST API yet, there is a pretty simple CLI that should be workable with linkding.

Would a pull request for adding Archivebox support be given consideration?

sissbruecker commented 1 year ago

Integrating this might be an option, but I'd prefer using a REST API rather than including a CLI tool into the Docker image, and then trying to drive that from the Django app.

Apart from that the expectations should be clarified. Creating the snapshot seems pretty clear. What do you expect to happen after the snapshot was created?

Should the snapshot link surface in the bookmark list?
Should this be an alternative to the Wayback machine integration, and replace the snapshot URL created by it?

An alternative could be to expose the web_archive_snapshot_url field in linkding's REST API, which would be fairly trivial to do, and then write a 3rd party app that:

Checks linkding for bookmarks that don't have a snapshot URL yet
Create an archive box snapshot for bookmarks that don't have one yet
Update the bookmark's snapshot URL in linkding

pratio commented 1 year ago

@sissbruecker It would be great if the snapshot link would replace the internet archive link. It would be enough if we can manually trigger it for the bookmarks that haven't been archived from the admin panel.

webysther commented 1 week ago

REST API is arrived: https://github.com/ArchiveBox/ArchiveBox/pull/1397#issuecomment-2076913352

huyz commented 1 week ago

How would this be different from having ArchiveBox pull an RSS feed from LinkDing?

webysther commented 1 week ago

How would this be different from having ArchiveBox pull an RSS feed from LinkDing?

I have no ideia, how do that?

ctag commented 1 week ago

That sounds like a good idea to me. From what I can tell linkding provides RSS feeds under settings -> integrations. And Archivebox can pull rss feeds.

I haven't tried it yet, but I imagine the big difference with that solution is that it's not as integrated. It would be nice to browse the bookmark within linkding and be able to select the at-home-archival link, without having to switch over to archivebox and then go hunting for it.