Scrapers Request - Githubissues

iamjen023 commented 4 years ago

updated on April 22, 2024

This issue is to remain open as a ongoing list. I will ~~crossout~~ once we get it made.

Any of this can be worked on at any time.

Please ask for site with this style. name of site | url | free/paid/premium(pay for more) | requires subscription to view (yes/no) | notes

Site	URL	Free/Paid/Premium	Sub Req (Yes/No)	Notes	Worked On By
abdreams	https://abdreams.com/	paid	yes	none
abplayhouse	http://www.abplayhouse.com/	paid	no	none
Allover30	https://www.allover30.com/	paid	yes	none
bailey jay	https://www.ts-baileyjay.com/	paid	no	none
diapermess	https://www.diapermess.com/	paid	no	none
erodougazo	https://erodougazo.com/	free	no subscription	detailed Performer & film metadata, JAV only
Gelbooru	https://gelbooru.com	free	no	mostly images, but also some scenes
Max Hardcore	https://www.max-hardcore.com/	Paid	no	Scenes and models
natalie mars	https://nataliemars.com/	paid	no	none
Pascals Sub Sluts	https://www.pascalssubsluts.com/submissive/	paid	yes	Scenes and models
punishedindiapers	http://punishedindiapers.com/	paid	no	none
redtube	https://www.redtube.com/	premium	no	none
Suicide Girls	https://www.suicidegirls.com	paid	yes	probably galleries and scenes
Triga Films	https://trigafilms.com/	paid	no	Doesn't require a subscription to view details, but does require a free login
youtube	https://youtube.com	premium	no	none
~21roles~	~https://www.21roles.com/~	~paid~	~no~	~none~	halorrr
~adult time studios~	~https://www.adulttime.com/~	~paid~	~yes~	~none~	Belleyy
~angela white~	~http://angelawhite.com/~	~paid~	~no~	~none~	halorrr
~avmoo~	~https://avmoo.online/~	~free~	~no subscription~	~Scenes and Performers, contain images for both, change domain name frequently, JAV only~	MortonBridges
~Broke Straight Boys~	~https://brokestraightboys.com/~	~paid~	~no~	~Mostly clips~	Maista6969
~Cadinot~	~https://www.cadinot.fr/en~	~paid~	~no~	~none~	Maista6969
~Carnal+~	~https://carnalplus.com/~	~paid~	~no~	~None~	Maista6969
~Chanta's Bitches~	~https://www.twistedfactory.com/~	~free~	~no~	~Scenes and Performers~	~Morton Bridges~
~Chanta's Bitches~	~https://www.twistedfactory.com/~	~free~	~no~	~Scenes and Performers~	Morton Bridges
~CockyBoys~	~https://cockyboys.com/~	~paid~	~no~	~None~	Maista6969
~Colby Knox~	~https://www.colbyknox.com/~	~Paid~	~no~	~Scenes and Performers~	DogmaDragon
~Colette~	~https://www.colette.com/~	~paid~	~no~	~None~	bnkai
~dickdrainers~	~http://dickdrainers.com/~	~paid~	~yes~	~just the scenes~	niemands
~dorcelclub~	~https://www.dorcelclub.com/~	~paid~	~no~	~none~	bnkai
~Facial Abuse~	~https://tour5m.facialabuse.com~	~paid~	~no~	~scenes~	MortonBridges
~Fetish Network~	~http://www.fetishnetwork.com/~	~paid~	~no~	~sub sites can be scraped from the main site~	niemands
~FuckedHard18~	~http://fuckedhard18.com/membersarea/~	~paid~	~no~	~no~
~Gay Erotic Video Index~	~https://gayeroticvideoindex.com/~	~free~	~no~	~none~	Maista6969
~girlsway~	~https://www.girlsway.com/~	~paid~	~no~	~none~	halorrr
~Gloryhole Secrets~	~https://www.gloryholesecrets.com/~	~paid~	~no~	~none~	niemands
~Guys in Sweatpants~	~https://guysinsweatpants.com~	~paid~	~no~	~none~	Maista6969
~HarmonyVision~	~https://harmonyvision.com/~	~paid~	~no~	~none~	bnkai
~hobby.porn~	~https://hobby.porn/~	~free~	~no subscription~	~Scenes and Performers, contains a lot deleted information from PornHub~	IAmKontrast
~hucows~	~https://www.hucows.com/~	~paid~	~no~	~none~	bnkai
~Hung Young Brit~	~https://www.hungyoungbrit.com/~	~Paid~	~no for Scenes, Yes for Performers~	~none~	MortonBridges
~incestflix~	~http://www.incestflix.com/~	~free~	~no~	~none~	plz12345
~Jacquie & Michel TV~	~https://www.jacquieetmicheltv.net~	~paid~	~no~	~blocked~	niemands
~javdatabase~	~https://www.javdatabase.com/~	~free~	~no~	~Scenes & Performers, images available for both, JAV only~	MortonBridges
~lordaardvark~	~http://www.lordaardvark.com/~	~free~	~no~	~none~	nrg101
~Mandy Flores~	~https://mandyflores.com/~	~paid~	~no~	~none~	niemands
~metart~	~https://www.metart.com/~	~premium~	~no~	~none~	halorrr
~motherless~	~https://motherless.com/~	~free~	~no~	~none~	halorrr
~My Dirty Hobby~	~https://www.mydirtyhobby.com/~	~paid~	~no~	~Scenes and Models~	bnkai
~NYSEED~	~https://nyseedxxx.com/~	~Paid~	~no~	~Scenes and Performers~	MortonBridges
~Older4Me~	~www.older4me.com/home~	~paid~	~no~	~AdultSiteRunner network~	Maista6969
~rachel steele~	~https://rachel-steele.com/~	~paid~	~no~	~none~	VillageIdiot
~Raw Fuck Club~	~https://www.rawfuckclub.com/~	~Premium~	~no~	~Scenes and Performers~
~shiny's bound sluts~	~https://shinysboundsluts.com/~	~paid~	~yes~	~browser able with out membership~	DogmaDragon
~spankbang~	~https://spankbang.com/~	~free~	~no~	~none~	halorrr
~strokies~	~http://www.strokies.com/~	~paid~	~no~	~none~	DogmaDragon
~studiofow~	~https://studiofow.com/~	~free~	~no~	~none~	bnkai
~Tadpolexstudio~	~https://www.tadpolexstudio.com~	~paid~	~no~	~non-VR scenes for tadpole studio~	Maista6969
~TMDB~	~https://www.themoviedb.org/~	~free~	~no~	~Scenes and Performers~	KennyG
~Trailer Trash Boys~	~https://trailertrashboys.com/~	~paid~	~no~	~Mostly clips~	MortonBridges
~traxxx~	~https://traxxx.me~	~free~	~no~	~none~	stg-annon
~Treasure Island Media~	~https://www.treasureislandmedia.com/~	~premium~	~no~	~Scenes and Performers~	MortonBridges
~tushyraw~	~https://www.tushyraw.com/~	~paid~	~no~	~none~	ueaslsef
~tushy~	~https://www.tushy.com/~	~paid~	~no~	~none~	ueaslsef
~Twisted Factory~	~https://www.twistedfactory.com/~	~free~	~no~	~Scenes and Performers~	MortonBridges
~watchmygf~	~https://www.watchmygf.me~	~free~	~no~	~none~	halorrr
~xhamster~	~http://xhamster.com/~	~premium~	~no~	~none~	bnkai
~xnxx~	~https://www.xnxx.com/~	~premium~	~no~	~none~	niemands
~xtube~	~https://www.xtube.com/~	~premium~	~no~	~none~	niemands
~WTFPass~	~https://wtfpass.com/~	~paid~	~no~	~none~	niemands
~xvideos~	~https://www.xvideos.com/~	~premium~	~no~	~none~	niemands
~youporn~	~https://youporn.com~	~free~	~no~	~none~	halorrr

notes

none as of yet.

bnkai commented 4 years ago

Girlsway is already supported

girlsway.com	GammaEntertainment.yml

iamjen023 commented 4 years ago

ok sorry i ~~corssed~~ it out. i would remove it but dont want it to lead to confusion.

redmont59 commented 4 years ago

Any interest in adding Tushy and TushyRaw?

iamjen023 commented 4 years ago

Tushy

there one in the works if you look at the pull request, "Create vixenNetwork.yml xPath" which is Tushy and TushyRaw. i will add to my list and when i see it available i ~cross~ it out

mmenanno commented 4 years ago

The big hang up on the Vixen Media one is the images https://github.com/stashapp/CommunityScrapers/pull/1#discussion_r426182917 . They are inserted via javascript and unpredictable in their position in the script.

bnkai commented 4 years ago

You can cross off AngelaWhite. Also sites that require subscription to get the metadata cannot be scraped using xpath scrapers , at least for now. Using the script option instead could be possible but it's a lot more work so i would classify those as reqs as very low priority.

bnkai commented 3 years ago

@binarygeek119 xvideos, xnxx and xtube were merged. Can you update the first post?

iamjen023 commented 3 years ago

@binarygeek119 xvideos, xnxx and xtube were merged. Can you update the first post?

done

bnkai commented 3 years ago

@binarygeek119 hucows and xhamster ( new postprocess format so dev build required) were merged can you update ?

iamjen023 commented 3 years ago

@binarygeek119 hucows and xhamster ( new postprocess format so dev build required) where merged can you update ?

done

bnkai commented 3 years ago

@binarygeek119 can you cross off xtube also ? it was merged along with xnxx and xvideos

iamjen023 commented 3 years ago

@binarygeek119 can you cross off xtube also ? it was merged along with xnxx and xvideos

done

timcantona commented 3 years ago

Hope its still ok to make requests?

dorcelclub| https://www.dorcelclub.com/| paid | no | none

You are able to view each scene individually eg https://www.dorcelclub.com/en/scene/31298/so-xtrem-valentina-nappi Just looking at the page, it seems you can get the Cast, Title, date, screenshot and categories

iamjen023 commented 3 years ago

Hope its still ok to make requests?

dorcelclub| https://www.dorcelclub.com/| paid | no | none

You are able to view each scene individually eg https://www.dorcelclub.com/en/scene/31298/so-xtrem-valentina-nappi Just looking at the page, it seems you can get the Cast, Title, date, screenshot and categories

added to the list

bnkai commented 3 years ago

@binarygeek119 dorcel club was just merged can you update ?

iamjen023 commented 3 years ago

@binarygeek119 dorcel club was just merged can you update ?

done

bnkai commented 3 years ago

@binarygeek119 tushy,tushyraw were merged with the vixen network scraper . can you update?

iamjen023 commented 3 years ago

@binarygeek119 tushy,tushyraw were merged with the vixen network scraper . can you update?

done

also added some more i like to see

timcantona commented 3 years ago

Thanks for the last one; another request if someone can?

Mandy Flores | https://mandyflores.com/ | paid | no | none

bnkai commented 3 years ago

@binarygeek119 mandyflores was merged , can you update ?

iamjen023 commented 3 years ago

@binarygeek119 mandyflores was merged , can you update ?

done

bnkai commented 3 years ago

@iamjen023 can you cross off spankbang , motherless, watchmygf , youporn as they were completed by @halorrr and merged?

iamjen023 commented 3 years ago

@iamjen023 can you cross off spankbang , motherless, watchmygf , youporn as they were completed by @halorrr and merged?

done

aaron-typo commented 3 years ago

Could the scraper for the Kink-Websites (kink.yml) be upgraded by adding sceneByFragment so that no known URL is needed? The filenames of scenes often contain a 4-5 digit number from which url of the scene can be formed: https://kink.com/shoot/{Scenenumber}

bnkai commented 3 years ago

@aaron-typo can you provide some filenames? I don't have any from kink to look at. It also seems that for the oldest scenes we go down to single digits so it's 1-5 digits. If it's easy to take apart the id from the rest of the numbers (eg dates present in the filename) it shouldn be that different from the heyzo,carib PR i did

Edit if you can append the filenames in a pastebin URL that would be safer

bnkai commented 3 years ago

@iamjen023 can you cross off 21roles and metart ?

aaron-typo commented 3 years ago

@bnkai here you go: https://paste2.org/d32ddtj2

bnkai commented 3 years ago

@aaron-typo i am assuming you forgot the .extension parts from the filenames ? you can try the scraper and leave some feeback here https://github.com/stashapp/CommunityScrapers/pull/247

timcantona commented 3 years ago

Another request from me, thanks.

HarmonyVision | https://harmonyvision.com/ | paid | no | none

Ziatexataor commented 3 years ago

devilsfilm.com

niemands commented 3 years ago

devilsfilm.com

@Ziatexataor There is already a scraper for this site in GammaEntertainment.yml

timcantona commented 3 years ago

Thanks bnkai!

Another request...

Jacquie & Michel TV | https://www.jacquieetmicheltv.net | paid | no | none

yoshnopa commented 3 years ago

I have two requests:

For scenes (on demand) and movies: AdultEmpire | https://www.adultempire.com | paid | no | None

Scenes only: Colette | https://www.colette.com/ | paid | no | None

bnkai commented 3 years ago

@yoshnopa adultempire is the same with adultdvdempire

bnkai commented 3 years ago

A couple of requests from the channel

Site	URL	paid	Sub	Notes
Suicide Girls	https://www.suicidegirls.com	paid	yes	probably galleries and scenes
Facial Abuse	https://tour5m.facialabuse.com	paid	no	scenes

edit: the one that requested the suicide girsl from the discord channel is working on it

timcantona commented 3 years ago

I thought wtfpass was in there somewhere, but can't seem to find it?

WTFPass| https://wtfpass.com/ | paid | no | none

also;

iamjen023 commented 3 years ago

ive updated this list both added and crossed off things sorry i was away for a while

bnkai commented 3 years ago

@iamjen023 no worries can you cross off metart, 21roles, harmonyvision,colette,StudioFOW ? they are already merged Jacquie & Michel TV already has a PR ( blocked atm but its being worked )