Sites that need implementing - Githubissues

SN4T14 / RedArc.js

Subreddit archiving tool written in Node.js

Do What The F*ck You Want To Public License

2 stars 1 forks source link

Sites that need implementing #1

Open SN4T14 opened 9 years ago

SN4T14 commented 9 years ago

If you implement any of these, please submit a pull request.

Reddit.com (might need to be recursively resolved to a link)
~~vid.me (youtube-dl)~~
~~gfycat.com (also giant.gfycat.com because fuck HTML5, right?)~~
~~videobam.com (youtube-dl)~~
~~imgflip.com~~
~~dropbox.com (and dl.dropboxusercontent.com)~~ (Does not include albums, because apparently dropbox now supports albums)
twitter.com (Fuck Twitter, surely there's a tool to rip that)
~~makeagif.com~~
~~youtube.com (youtube-dl)~~
~~tinypic.com~~
~~xhamster.com (youtube-dl)~~
~~imgur.com gifv support~~
possibly more?

These are based on a few weeks of /r/gonewild links, so it's incredibly biased, I'll get a sample of /r/all links at some point.

ohhdemgirls commented 9 years ago

I think you should pass off supported video sites to a separate youtube-dl thread, less work for you and keeps scraping/things fast in the main app.

twitter.com (possibly spam links?)

There are some legit users who host on twitter.

youtube.com (more spam?)

Again could be legit depending on the sub you're scrapping, include flags or a config to turn on/off certain hosts.

SN4T14 commented 9 years ago

Oh yeah, youtube-dl has a massive list of supported sites, I'll use it instead.