UltimaHoarder / UltimaScraper

Scrape all the media from an OnlyFans account - Updated regularly
GNU General Public License v3.0
3.95k stars 606 forks source link

Add csv metadata export #1053

Closed CTDragon closed 11 months ago

CTDragon commented 3 years ago

I've been locally maintaining version 5.3 for quite a while now so I could just get the csv files and use my own downlaoder. Recently it broke again with "user not found" during auth. It seems silly to keep maintaining this separately. I don't suppose we could add the csv export back to the main project could we???

CTDragon commented 3 years ago

A couple thoughts

If this is too much to ask, I could probably just query the sqlite database and generate it myself.

Is there currently a way to turn off downloading of media? The -m flag no longer seems to work for that.

UltimaHoarder commented 3 years ago

A couple thoughts

If this is too much to ask, I could probably just query the sqlite database and generate it myself.

Best if you just do this

Is there currently a way to turn off downloading of media? The -m flag no longer seems to work for that.

Not yet

CTDragon commented 3 years ago

I went ahead and added the functionality directly into code in a local branch controlled by a parameter in the config defaulted to false. Do you want me to make a PR for it?

If you'd rather not have it in there I can just merge/ rebase to your latest locally anytime I need an update.

dilemmax commented 3 years ago

I went ahead and added the functionality directly into code in a local branch controlled by a parameter in the config defaulted to false. Do you want me to make a PR for it?

If you'd rather not have it in there I can just merge/ rebase to your latest locally anytime I need an update.

@CTDragon Is there any chance I can have a copy of this code? I miss exporting to CSV. I was using v6.0 until it stopped working for me as well.

UltimaHoarder commented 3 years ago

I went ahead and added the functionality directly into code in a local branch controlled by a parameter in the config defaulted to false. Do you want me to make a PR for it?

If you'd rather not have it in there I can just merge/ rebase to your latest locally anytime I need an update.

Which functionality

CTDragon commented 3 years ago

I went ahead and added the functionality directly into code in a local branch controlled by a parameter in the config defaulted to false. Do you want me to make a PR for it? If you'd rather not have it in there I can just merge/ rebase to your latest locally anytime I need an update.

@CTDragon Is there any chance I can have a copy of this code? I miss exporting to CSV. I was using v6.0 until it stopped working for me as well.

Sure thing

CTDragon commented 3 years ago

I went ahead and added the functionality directly into code in a local branch controlled by a parameter in the config defaulted to false. Do you want me to make a PR for it? If you'd rather not have it in there I can just merge/ rebase to your latest locally anytime I need an update.

@CTDragon Is there any chance I can have a copy of this code? I miss exporting to CSV. I was using v6.0 until it stopped working for me as well.

I created a PR with the changes so it may end up in the main project if accepted. If not/ until then, you can grab it from here. Just hit Code->Download Zip.

https://github.com/CTDragon/OnlyFans/tree/csv-export

image

UltimaHoarder commented 3 years ago

I don't want to add CSV back because people might think I've started supporting it again :/

CTDragon commented 3 years ago

Completely understandable. I'll keep it forked and will maintain it for my own use.

For anyone who needs it, @dilemmax, I'll try to keep a working release, but I can't promise it will always be up-to-date. It's working for me right now though.

Look for the csv releases on the following page. https://github.com/CTDragon/OnlyFans/releases

UltimaHoarder commented 3 years ago

Actually, I'll incorporate your fork soon but change it up since it's only exporting links.

CTDragon commented 3 years ago

The latest merge seems like a nightmare. All we want is a newline delimited list of links for each creator. Is this possible?

UltimaHoarder commented 3 years ago

The latest merge seems like a nightmare. All we want is a newline delimited list of links for each creator. Is this possible?

As a text file? Sure.