This is, unfortunately, going to have to be a case-by-case issue across each site. As this is an open-source project, we aren't currently in the business of paying for a ton of various subscriptions.
These will have to be detected differently upon response handling for each media entity we scrape.
The handling, however, can be pretty simple. I figure we can just export these as leaf-nodes in the trees we scrape, labeling their media type as Pay-gated Article.
This is, unfortunately, going to have to be a case-by-case issue across each site. As this is an open-source project, we aren't currently in the business of paying for a ton of various subscriptions.
These will have to be detected differently upon response handling for each media entity we scrape.
The handling, however, can be pretty simple. I figure we can just export these as leaf-nodes in the trees we scrape, labeling their media type as
Pay-gated Article.