It would be useful to be able to supply the CLI with a link to a web resource and automatically ingest the resource with the correct metadata. For example, if the CLI is given a link to a Tumblr post featuring a photograph, the photograph would be ingested and a link to the post given as a source link.
mage ingest web "https://twitter.com/kanaya/status/1791642720630431947"
Concerns:
Retrieving web content is difficult. APIs may not be freely accessible, and scraping is fragile and dubious.
It would be useful to be able to supply the CLI with a link to a web resource and automatically ingest the resource with the correct metadata. For example, if the CLI is given a link to a Tumblr post featuring a photograph, the photograph would be ingested and a link to the post given as a source link.
Concerns: