Goldenfreddy0703 / Otaku

Repository for Otaku Development
GNU General Public License v3.0
86 stars 21 forks source link

Scraping anidex #258

Open swarzn opened 1 month ago

swarzn commented 1 month ago

It would be awesome if the addon worked with anidex. Most spanish torrents are there and Animetosho only mirrors english ones. I tried scraping them from my real debrid cloud storage but that doesn't seem to work.

Goldenfreddy0703 commented 1 month ago

Anidex could probably be added but the only downside to Anidex is that it's behind dossgaurd and in order to bypass it, you would have to run Flaresolver to bypass it. For Animetosho, if you are looking for Spanish torrents, go to the prioritization settings in Otaku and set it to multisubs and you should be able to find you some good torrents on there. There is also spanish embeds as well that will help you out.

Also one last thing, make sure to have your subtitles set to Spanish and you should be good.

swarzn commented 1 month ago

I'm actually looking for anime from spanish fansubs as they edit and translate the anime and provide the best subs, most of them only upload to anidex. Ñyuum for example: https://anidex.info/?page=group&id=67&offset=0 I guess scraping anidex would be the only way, but shouldn't the addon scrape it from my cloud tho?

Goldenfreddy0703 commented 1 month ago

It should but the file name might not be matching correctly. This is something @theasguard could probably look into sense cloud scrapping can be weird sometimes.

theasguard commented 1 month ago

Heyy, yea there are some problems with cloud scraping we've noticed, that's another thing on the lists to check into. actually leaning towards this being the issue https://armkai.vercel.app/api/fuzzypacks . its requesting from here before proceeding with rd or premiumize cloud scrape, only problem is its crashing. that could also be because a query wasn't requested from us, but we believe there could be a better method than relying on this request from Vercel. will do further digging.

Lets also Note: we're using alldebrid which doesn't have the cloud scrape function but we can cache torrents to ad and have the links show up after in Otaku (most links), this could also be how it pulls in titles in Otaku, it actually lacks in retrieving certain stuff that we have cached, definitely going to look back into this during the week.

and lastly we'll also look into a way of scraping anidex, it shouldn't be too difficult especially with Flaresolver, but we're still in process of relearning this so be patient.

theasguard commented 1 month ago

Update on this, anidex servers are all over the place I'm not sure if a scraper would function that great with a ton more people, pages sometimes take their sweet time opening, then it won't load a page and their servers messed up for a minute sometimes while it sorts that, really unreliable at the moment. If their servers improve I may consider implementation of this.

Edit: we're going to put this on our to-do list for now since it seems their servers have improved not sure if thats because uploaders aren't going hard core on uploading torrents or what. If their site remains stable probably try to get this implemented.