search

stashapp / CommunityScrapers

This is a public repository containing scrapers created by the Stash Community.
https://stashapp.github.io/CommunityScrapers/
GNU Affero General Public License v3.0
649 stars 417 forks source link

Scrapers Request #73

Closed iamjen023 closed 5 months ago

iamjen023 commented 4 years ago

updated on April 22, 2024

This issue is to remain open as a ongoing list. I will crossout once we get it made.

Any of this can be worked on at any time.

Please ask for site with this style. name of site | url | free/paid/premium(pay for more) | requires subscription to view (yes/no) | notes

Site URL Free/Paid/Premium Sub Req (Yes/No) Notes Worked On By
abdreams https://abdreams.com/ paid yes none
abplayhouse http://www.abplayhouse.com/ paid no none
Allover30 https://www.allover30.com/ paid yes none
bailey jay https://www.ts-baileyjay.com/ paid no none
diapermess https://www.diapermess.com/ paid no none
erodougazo https://erodougazo.com/ free no subscription detailed Performer & film metadata, JAV only
Gelbooru https://gelbooru.com free no mostly images, but also some scenes
Max Hardcore https://www.max-hardcore.com/ Paid no Scenes and models
natalie mars https://nataliemars.com/ paid no none
Pascals Sub Sluts https://www.pascalssubsluts.com/submissive/ paid yes Scenes and models
punishedindiapers http://punishedindiapers.com/ paid no none
redtube https://www.redtube.com/ premium no none
Suicide Girls https://www.suicidegirls.com paid yes probably galleries and scenes
Triga Films https://trigafilms.com/ paid no Doesn't require a subscription to view details, but does require a free login
youtube https://youtube.com premium no none
~21roles~ ~https://www.21roles.com/~ ~paid~ ~no~ ~none~ halorrr
~adult time studios~ ~https://www.adulttime.com/~ ~paid~ ~yes~ ~none~ Belleyy
~angela white~ ~http://angelawhite.com/~ ~paid~ ~no~ ~none~ halorrr
~avmoo~ ~https://avmoo.online/~ ~free~ ~no subscription~ ~Scenes and Performers, contain images for both, change domain name frequently, JAV only~ MortonBridges
~Broke Straight Boys~ ~https://brokestraightboys.com/~ ~paid~ ~no~ ~Mostly clips~ Maista6969
~Cadinot~ ~https://www.cadinot.fr/en~ ~paid~ ~no~ ~none~ Maista6969
~Carnal+~ ~https://carnalplus.com/~ ~paid~ ~no~ ~None~ Maista6969
~Chanta's Bitches~ ~https://www.twistedfactory.com/~ ~free~ ~no~ ~Scenes and Performers~ ~Morton Bridges~
~Chanta's Bitches~ ~https://www.twistedfactory.com/~ ~free~ ~no~ ~Scenes and Performers~ Morton Bridges
~CockyBoys~ ~https://cockyboys.com/~ ~paid~ ~no~ ~None~ Maista6969
~Colby Knox~ ~https://www.colbyknox.com/~ ~Paid~ ~no~ ~Scenes and Performers~ DogmaDragon
~Colette~ ~https://www.colette.com/~ ~paid~ ~no~ ~None~ bnkai
~dickdrainers~ ~http://dickdrainers.com/~ ~paid~ ~yes~ ~just the scenes~ niemands
~dorcelclub~ ~https://www.dorcelclub.com/~ ~paid~ ~no~ ~none~ bnkai
~Facial Abuse~ ~https://tour5m.facialabuse.com~ ~paid~ ~no~ ~scenes~ MortonBridges
~Fetish Network~ ~http://www.fetishnetwork.com/~ ~paid~ ~no~ ~sub sites can be scraped from the main site~ niemands
~FuckedHard18~ ~http://fuckedhard18.com/membersarea/~ ~paid~ ~no~ ~no~
~Gay Erotic Video Index~ ~https://gayeroticvideoindex.com/~ ~free~ ~no~ ~none~ Maista6969
~girlsway~ ~https://www.girlsway.com/~ ~paid~ ~no~ ~none~ halorrr
~Gloryhole Secrets~ ~https://www.gloryholesecrets.com/~ ~paid~ ~no~ ~none~ niemands
~Guys in Sweatpants~ ~https://guysinsweatpants.com~ ~paid~ ~no~ ~none~ Maista6969
~HarmonyVision~ ~https://harmonyvision.com/~ ~paid~ ~no~ ~none~ bnkai
~hobby.porn~ ~https://hobby.porn/~ ~free~ ~no subscription~ ~Scenes and Performers, contains a lot deleted information from PornHub~ IAmKontrast
~hucows~ ~https://www.hucows.com/~ ~paid~ ~no~ ~none~ bnkai
~Hung Young Brit~ ~https://www.hungyoungbrit.com/~ ~Paid~ ~no for Scenes, Yes for Performers~ ~none~ MortonBridges
~incestflix~ ~http://www.incestflix.com/~ ~free~ ~no~ ~none~ plz12345
~Jacquie & Michel TV~ ~https://www.jacquieetmicheltv.net~ ~paid~ ~no~ ~blocked~ niemands
~javdatabase~ ~https://www.javdatabase.com/~ ~free~ ~no~ ~Scenes & Performers, images available for both, JAV only~ MortonBridges
~lordaardvark~ ~http://www.lordaardvark.com/~ ~free~ ~no~ ~none~ nrg101
~Mandy Flores~ ~https://mandyflores.com/~ ~paid~ ~no~ ~none~ niemands
~metart~ ~https://www.metart.com/~ ~premium~ ~no~ ~none~ halorrr
~motherless~ ~https://motherless.com/~ ~free~ ~no~ ~none~ halorrr
~My Dirty Hobby~ ~https://www.mydirtyhobby.com/~ ~paid~ ~no~ ~Scenes and Models~ bnkai
~NYSEED~ ~https://nyseedxxx.com/~ ~Paid~ ~no~ ~Scenes and Performers~ MortonBridges
~Older4Me~ ~www.older4me.com/home~ ~paid~ ~no~ ~AdultSiteRunner network~ Maista6969
~rachel steele~ ~https://rachel-steele.com/~ ~paid~ ~no~ ~none~ VillageIdiot
~Raw Fuck Club~ ~https://www.rawfuckclub.com/~ ~Premium~ ~no~ ~Scenes and Performers~
~shiny's bound sluts~ ~https://shinysboundsluts.com/~ ~paid~ ~yes~ ~browser able with out membership~ DogmaDragon
~spankbang~ ~https://spankbang.com/~ ~free~ ~no~ ~none~ halorrr
~strokies~ ~http://www.strokies.com/~ ~paid~ ~no~ ~none~ DogmaDragon
~studiofow~ ~https://studiofow.com/~ ~free~ ~no~ ~none~ bnkai
~Tadpolexstudio~ ~https://www.tadpolexstudio.com~ ~paid~ ~no~ ~non-VR scenes for tadpole studio~ Maista6969
~TMDB~ ~https://www.themoviedb.org/~ ~free~ ~no~ ~Scenes and Performers~ KennyG
~Trailer Trash Boys~ ~https://trailertrashboys.com/~ ~paid~ ~no~ ~Mostly clips~ MortonBridges
~traxxx~ ~https://traxxx.me~ ~free~ ~no~ ~none~ stg-annon
~Treasure Island Media~ ~https://www.treasureislandmedia.com/~ ~premium~ ~no~ ~Scenes and Performers~ MortonBridges
~tushyraw~ ~https://www.tushyraw.com/~ ~paid~ ~no~ ~none~ ueaslsef
~tushy~ ~https://www.tushy.com/~ ~paid~ ~no~ ~none~ ueaslsef
~Twisted Factory~ ~https://www.twistedfactory.com/~ ~free~ ~no~ ~Scenes and Performers~ MortonBridges
~watchmygf~ ~https://www.watchmygf.me~ ~free~ ~no~ ~none~ halorrr
~xhamster~ ~http://xhamster.com/~ ~premium~ ~no~ ~none~ bnkai
~xnxx~ ~https://www.xnxx.com/~ ~premium~ ~no~ ~none~ niemands
~xtube~ ~https://www.xtube.com/~ ~premium~ ~no~ ~none~ niemands
~WTFPass~ ~https://wtfpass.com/~ ~paid~ ~no~ ~none~ niemands
~xvideos~ ~https://www.xvideos.com/~ ~premium~ ~no~ ~none~ niemands
~youporn~ ~https://youporn.com~ ~free~ ~no~ ~none~ halorrr

notes

adudeirl commented 3 years ago

Swallow Salon | https://www.swallowsalon.com/ | paid | no | scenes

sister site of Amateur Allure, which already has a scrapper

Massage Girls 18 | http://massagegirls18.com | paid | no | scenes Fucked Hard GFs | http://fuckedhardgfs.com/ | paid | no | scenes

sister sites of FuckedHard18, figured they should get mentioned alongside that incase someone does it

bn326160 commented 3 years ago

Tianmei Media | http://timi1.info/ | not sure | no | title, image Monger In Asia | https://mongerinasia.com/ | paid | no | none HotMILFSfuck | https://hotmilfsfuck.com/ | paid | no | similar to exploited college girls Kim Holland | https://www.kimholland.nl/ | paid | no | none Fit18 | https://www.fit18.com | paid | no | none MomComesFirst | https://momcomesfirst.com/ | paid | no | similar to Family Therapy (familytherapyxxx.com)

JaseNZC commented 3 years ago

Monger In Asia | https://mongerinasia.com/ | paid | no | none

Done and is now a PR #536

exxx0dus commented 3 years ago

FTV Girls | https://www.ftvgirls.com | paid | no | models (I think each model is only on once, so model==scene) FTV Milfs| https://www.ftvmilfs.com | paid | no | models (I think each model is only on once, so model==scene)

exxx0dus commented 3 years ago

LoveHomePorn | https://lovehomeporn.com | free | no | models and scenes

aaron-typo commented 3 years ago

German Goo Girls | https://shop.germangoogirls.com/page/home/ | paid | no | Many of the movie files that could be purchased in the past contain the production number (mostly 5 digits, sometimes less, sometimes with 2 letters in the beginning, also shown on every movie cover) in the filename. Maybe this could be used for scrape by fragment, because you can search for the production number on the website.

Also: Maybe this website could be the basis for a performer-scraper? http://www.pornstarchive.com/ggg-models-by-name

quirkyjoe commented 3 years ago

I'd like to suggest the following:

IFeelMyself | https://ifeelmyself.com/ | paid | no | Site search returns results including image, title, description, and tags XConfessions | https://xconfessions.com/ | paid | no | Site search returns results including image, title, description, year, length, director, and performers.

CuddleBear92 commented 3 years ago

Could we maybe get a scraper for this: https://data18.empirestores.co/ ? Has a ton of movies and scenes and are linked like the old data18 sites but has new content!

Think you might be able to re-use some of the empire parsers you already have.

CuddleBear92 commented 3 years ago

Since there already is a StudioFOW parser, could we get a Affect3D and DLSite parser. Both handle a bunch of videos and longer scenes, along with image sets. Sadly DLsite have gotten weird since they merged the English site into a global site, sadly worse for it. Both have a ton of exclusive content and some metadata that is useful.

CuddleBear92 commented 3 years ago

Found some more sites that dont have a parser yet: https://jerkoffwithme.com/ https://bamvisions.com/ https://inthecrack.com/ http://brutalpov.com/ https://www.atkgirlfriends.com/ https://www.atkpetites.com/ https://www.atkarchives.com/

https://mylifeinmiami.com/ https://www.spizoo.com/ https://aziani.com/ https://allanalallthetime.com/ https://mypervyfamily.com/ https://www.loveherfeet.com/ https://hookuphotshot.com/ https://www.girlsrimming.com/ https://www.sweetyx.com/en/ https://deeplush.com/ https://cum4k.com/ https://baddaddypov.com/ https://www.archangelvideo.com/

The Entire ATK Network: (i think its all of them?) https://www.atkexotics.com/ https://www.atkhairy.com/ https://www.atkpremium.com/ https://www.amkingdom.com/

Note i searched up all of them in https://stashdb.org/studios and didnt find anything close to any of them. I am guessing the parsers for the site and the clients is the same in the end.

peolic commented 3 years ago

@CuddleBear92 Unless you mean something different by "parser", I can see most of these sites on the list, so they should have scrapers.

Supported Site Scraper
mylifeinmiami.com ModelCentroAPI.yml
spizoo.com Spizoo.yml
aziani.com GangBangCreampie.yml
allanalallthetime.com VNAGirls.yml
mypervyfamily.com AdultEmpireCash.yml
loveherfeet.com LoveHerFeet.yml
hookuphotshot.com hussiemodels.yml
girlsrimming.com GirlsRimming.yml
sweetyx.com SweetyX.yml
deeplush.com Nubiles.yml
cum4k.com AMAMultimedia.yml
baddaddypov.com AnalizedNetwork.yml
archangelvideo.com ArchAngelVideo.yml
atkexotics.com ATKExotics.yml
atkhairy.com ATKHairy.yml
atkpremium.com ATKHairy.yml
amkingdom.com ATKExotics.yml

Of the your original list, that leaves:

CuddleBear92 commented 3 years ago

oh sorry about that, should have also checked the parser files directly. Just had files that didnt have any info on them on the main stash-box

JaseNZC commented 3 years ago

Out of those I could do brutalpov, the rest are either behind a paywall or have next to nothing to scrape.

MrX292 commented 3 years ago

Shoko Server | https://shokoanime.com/ | free | no | i have the API calls in #586 ita a local server that gets its metadata for anime/hentai from https://anidb.net/ made a pull request for it in #628

maxcom99 commented 3 years ago

Please add support for OnlyFans Url / pull the header image and bio as the gallery/info. More and more stars have OF accounts and they’re simple to archive locally.

nerfdaderp commented 3 years ago

I'd like to request POVR, the parent site of WankzVR and MIlfVR. Once working, it should be able to replace the scrapers for both of those sites.

JaseNZC commented 3 years ago

I'd like to request POVR, the parent site of WankzVR and MIlfVR. Once working, it should be able to replace the scrapers for both of those sites.

Have submitted scraper if you want to try it out. Covers all 18 studios on the site.

598

nerfdaderp commented 3 years ago

Works beautiful for what I've tested - BrasilVR, POVR, and WankzVR. Even better, it now also scrapes the image, which WankzVR and MIlfVR did not, so a huge improvement! Thanks so much!

nerfdaderp commented 3 years ago

Another studio that I'm seeing new content for that you may wish to include is:

Site Paid SubReq https://bamvisions.com/ Yes No

JaseNZC commented 3 years ago

Another studio that I'm seeing new content for that you may wish to include is:

Site Paid SubReq https://bamvisions.com/ Yes No

Done, I have created a PR for it here #606

jeremymeyers commented 3 years ago

DigitalDesire (or digitaldesires) | https://www.digitaldesire.com/ | premium | no | DarkReachCash sites (specifically babearchives.com and ikissgirls.com) | https://babearchives.com or https://darkreachcash.com/external.php?page=sites for site list | premium | no

JaseNZC commented 3 years ago

DigitalDesire (or digitaldesires) | https://www.digitaldesire.com/ | premium | no | DarkReachCash sites (specifically babearchives.com and ikissgirls.com) | https://babearchives.com or https://darkreachcash.com/external.php?page=sites for site list | premium | no

These are done and have been PR'ed. I also managed to get a few others that were listed under darkreachcash

jeremymeyers commented 3 years ago

HDVPass | https://hdvpass.com/ | premium | no | ATKPetites and ATKPremium | https://www.atkpetites.com and https://www.atkpremium.com | premium | no | can probably use the existing ATKHairy one. Also Amkingdom.com should be added

JaseNZC commented 3 years ago

HDVPass | https://hdvpass.com/ | premium | no | ATKPetites and ATKPremium | https://www.atkpetites.com and https://www.atkpremium.com | premium | no | can probably use the existing ATKHairy one. Also Amkingdom.com should be added

The only one missing is ATKPetites and that is just a matter of adding the name into ATKHairy This has been done in PR #622

JaseNZC commented 3 years ago

DeepThroatSirens | https://tour.deepthroatsirens.com/ | paid | no| BigGulpGirls | https://tour.biggulpgirls.com/ | paid | no |

These sites layout and use of script may exclude them from getting done. Somebody else may like to comment on the possibility of being able to do these.

TaylorSwiftFan13 commented 3 years ago

JAV-Movies | https://www.jav-movies.com/ | free | no

Would be useful for scraping a bunch of JAV titles

jeremymeyers commented 3 years ago

ChickPass Sites | https://www.tandalesbians.com/tour1/network-sites/ | paid | no | sample url: https://www.tandalesbians.com/tour1/scenes/Tamara-fucks-Latina-teen-Leenuh_vids.html

eoop commented 3 years ago

e-hentai (via hentai@home) | https://e-hentai.org | free | no |

notes: e-hentai.org provides an open source server called Hentai@Home which allows archiving of the site's galleries. When a gallery is archived, the images are saved as jpgs with galleryinfo.txt in the same folder. galleryinfo.txt provides the title and tags for a given image gallery in an organized, scrapable format.

Juscelle commented 3 years ago

Les Worship site | https://lesworship.com | paid | no | sample url: https://lesworship.com/scenes/1644/les-latina-seamstress-seduces-her-sexy-client-for-pussy-licking

jeremymeyers commented 3 years ago

Les Worship site | https://lesworship.com | paid | no | sample url: https://lesworship.com/scenes/1644/les-latina-seamstress-seduces-her-sexy-client-for-pussy-licking

This. Other network sites for this creator are: japanlust.com honeytrans.com joibabes.com povmasters.com cuckhunter.com nudeyogaporn.com and transroommates.com (all running the same back-end)

baloodusudouest commented 2 years ago

Hi,

Can you add this websites too? name of site | url | free/paid/premium(pay for more) | requires subscription to view (yes/no) | notes Crunchboy | https://www.crunchboy.com/fr/accueil | premium | no | Menoboy | https://www.menoboy.fr/xxx/ | premium| no| Dragon media| https://www.dragonmediastore.com/ | premium | no| Belami| https://newtour.belamionline.com/updates.aspx | premium | no | czechgayfantasy | https://czechgayfantasy.com/?adult_content_agreement=true | premium | no | Mack studio | https://www.mackstudio.com/fr/accueil | premium | no | Frenchdudes | https://www.frenchdudes.com/public/ | premium | no | cockyboys| https://cockyboys.com/ |premium |no | masqulin | https://masqulin.com/ | premium | no |

toby666123 commented 2 years ago

Big7 | https://www.big7.com | paid | yes | Scenes & Models

gimmeliina commented 2 years ago

@baloodusudouest Belami and Cockyboys is available here. Works kind of... Masqulin PR #844 and czechgayfantasy #846

jeremymeyers commented 2 years ago

Addicted2Girls| https://www.addicted2girls.com/| free | no | its a Gamma site

VonTittyslappen commented 2 years ago

boobpedia | https://www.boobpedia.com/ | free | no | for scraping performers

Much needed, Boobpedia have info that IAFD/Indexxx do not, in some cases

Thanks in advance :)

bnkai commented 2 years ago

moving a request from #889

Could you add a scraper for TMDB? https://www.themoviedb.org/

BlokeCDP commented 2 years ago

Request please: killergram | https://killergram.com | paid | no Thanks.

Alexisback commented 2 years ago

indexxx.com | [https://www.indexxx.com | free | requires subscription to view (no) | databases xxx actress (scrape section info model Websites)

Roycinger commented 2 years ago

HQPorner | https://hqporner.com/ | free | no | none

hphpanon commented 2 years ago

indexxx.com | [https://www.indexxx.com | free | requires subscription to view (no) | databases xxx actress (scrape section info model Websites)

@Alexisback Can you clarify how you'd expect this to work? What data from this site would go where? In #882 you said

in the Performer cards you could load all participations in the websites

Do you mean copying that data into the Performer's description box? Studios don't have the concept of performers, so that websites data seems kinda useless to Stash otherwise. The scenes linked in Portfolio could possibly be used as Scene data, but the information is rather limited, to the extend that IAFD would often be a more useful source.

BrikoX commented 2 years ago

Can you clarify how you'd expect this to work? What data from this site would go where?

I think the main thing to scrape from it would be the Websites section. And put them into Performer (Website) format in the Also known as. But since Stash doesn't recognize Performer AKAs as tags it's not that useful.

aaron-typo commented 2 years ago

Pissplay | https://pissplay.com/ | paid | no | we already have an url-based scraper, but looking at the video URLs (just /videos/title-of-the-video) maybe a scraper by fragment could be done?

baloodusudouest commented 2 years ago

Hi, can you add Eric Video | https://www.ericvideos.com/warning-all.php?retour=%2F | piad | no UKnakedmen | https://www.uknakedmen.com/tour/?nats=MC4yLjM5LjEyNi4wLjAuMC4wLjA | paid | no

Thanks

baloodusudouest commented 2 years ago

Hi,

can you add GEVI for performer scene and movie? Thanks gayeroticvideoindex

timcantona2 commented 2 years ago

Hi, could you add Luxure| https://luxure.com/| paid | no | none

For example, https://luxure.com/en/videos/1137-3-men-for-my-wife?referrer=freetour_homepage&mediaType=thumbnail&mediaId=3819

its the same studio as Dorcel Club, so maybe its similar to that scraper? Thanks

PorkenPig commented 2 years ago

can you add smutjunkies for performer, scene and movie? Thanks! smutjunkies.com)

xob0t commented 2 years ago

Joymii | https://www.joymii.com/ | paid | no | none

it recently became a part of adultTime and now uses Algolina

fidofido300 commented 2 years ago

MindControlTheatre|https://mindcontroltheatre.com/|free|no Example : https://mindcontroltheatre.com/movie/every-third-month Please :)

timcantona2 commented 2 years ago

CumBizz| https://cumbizz.com| paid | no | none

For example, https://cumbizz.com/movie/skyfall/

Thanks

gurgles-1 commented 2 years ago

Brand New Amateurs | https://brandnewamateurs.com | paid | no | no notes

Example https://brandnewamateurs.com/trailers/Kali-Ryder-Blowjob-Instructions.html