666diabolus
commented
3 weeks ago after change it into growik, the script pass the low scan, let me choose the option, scraping the database (very slow) and then stop, nothing downloaded.
Open datawhores opened 3 weeks ago
666diabolus
commented
3 weeks ago after change it into growik, the script pass the low scan, let me choose the option, scraping the database (very slow) and then stop, nothing downloaded.
datawhores
commented
3 weeks ago after change it into growik, the script pass the low scan, let me choose the option, scraping the database (very slow) and then stop, nothing downloaded.
You should provide logs and config file
r32bum
commented
3 weeks ago Same issue as user above, log and config below ofscraper_main_profile_2024-06-06.log config.json
issue may stem from
`" 2024-06-06 13:37:11:[helpers.inner:11] Traceback (most recent call last): File "C:\Users\USER\AppData\Local\Programs\Python\Python312\Lib\site-packages\ofscraper\commands\helpers\normal.py", line 30, in wrapper all_media=filters.filtermediaFinal(all_media, model_id, username) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "C:\Users\USER\AppData\Local\Programs\Python\Python312\Lib\site-packages\ofscraper\filters\media\main.py", line 42, in filtermediaFinal return helpers.previous_download_filter(media, username=username, model_id=model_id) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "C:\Users\USER\AppData\Local\Programs\Python\Python312\Lib\site-packages\ofscraper\filters\media\helpers\helpers.py", line 172, in previous_download_filter media_ids = set(get_media_ids_downloaded(model_id=modelid, username=username)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "C:\Users\USER\AppData\Local\Programs\Python\Python312\Lib\site-packages\ofscraper\db\operations\wrapper.py", line 122, in inner raise E File "C:\Users\USER\AppData\Local\Programs\Python\Python312\Lib\site-packages\ofscraper\db\operations_\wrapper.py", line 98, in inner or placeholder.databasePlaceholder().databasePathHelper( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "C:\Users\USER\AppData\Local\Programs\Python\Python312\Lib\site-packages\ofscraper\classes\placeholder.py", line 73, in inner return f(args[0], *args[1:], **kwargs) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "C:\Users\USER\AppData\Local\Programs\Python\Python312\Lib\site-packages\ofscraper\classes\placeholder.py", line 124, in databasePathHelper self._variables.update({"first_letter": model_username[0].capitalize()})
TypeError: 'int' object is not subscriptable
2024-06-06 13:37:11:[scrape_context.scrape_context_manager:37] `after change it into growik, the script pass the low scan, let me choose the option, scraping the database (very slow) and then stop, nothing downloaded.
You should provide logs and config file
I was about to record another fresh log for you but now it's starting to scrap (weird), using growik, same config, latest commit 3.10.2, exactly 24 hour after it crash the first time.
WyohKnott
commented
3 weeks ago Yes I tried the new stuff.
python3 -m pip install git+https://github.com/datawhores/OF-Scraper.git@3.10b
or
python3 -m pip install git+https://github.com/datawhores/OF-Scraper.git
[sessionmanager.<lambda>:320] attempt: 2 for https://onlyfans.com/api2/v2/users/me sessionmanager.py:320
[sessionmanager.requests:356] failed: https://onlyfans.com/api2/v2/users/me sessionmanager.py:356
[sessionmanager.requests:357] status: 400 sessionmanager.py:357
[sessionmanager.requests:358] response text : {"error":{"code":0,"message":"Something went wrong. [29141B1D]"}} sessionmanager.py:358
[sessionmanager.requests:359] headers: Headers([('date', 'Thu, 06 Jun 2024 18:40:56 GMT'), ('content-type', 'application/json; charset=utf-8'), sessionmanager.py:359
('content-length', '65'), ('set-cookie', 'sess=validnewsess; expires=Sun, 16-Jun-2024 18:40:56 GMT; Max-Age=864000; path=/;
domain=.onlyfans.com; secure; HttpOnly'), ('expires', 'Thu, 19 Nov 1981 08:52:00 GMT'), ('cache-control', 'no-store, no-cache, must-revalidate'),
('pragma', 'no-cache'), ('x-of-rev', 'stuff-stuff'), ('strict-transport-security', 'max-age=31536000; includeSubdomains; preload'),
('x-frame-options', 'DENY'), ('cf-cache-status', 'DYNAMIC'), ('set-cookie', 'sess=validnewsess; expires=Sun, 16-Jun-2024 18:40:56
GMT; Max-Age=864000; path=/; domain=.onlyfans.com; secure; HttpOnly'), ('set-cookie',
'__cf_bm=DDFBE.JjdoE2Yb1vstuffWWn_HbjoHN16r0-1717699256-1.0.1.1-2s7u6D6aDuqw6kph5mQGVUGU9jEQlN9u7irRqhfKO8tXEy2NhxADstuffJNnl2.Xt5PixW
uSiN2LAKrg1A; path=/; expires=Thu, 06-Jun-24 19:10:56 GMT; domain=.onlyfans.com; HttpOnly; Secure; SameSite=None'), ('set-cookie',
'_cfuvid=vWd25q1w9BlC9tstuffIaXFfaDf9L_OJxtbI2ROo-1717stuff449-0.0.1.1-604800000; path=/; domain=.onlyfans.com; HttpOnly; Secure;
SameSite=None'), ('server', 'cloudflare'), ('cf-ray', '88fa889ffaa1366e-FRA'), ('alt-svc', 'h3=":443"; ma=86400')])
TRACEBACK_ [helpers.inner:11] Client error '400 Bad Request' for url 'https://onlyfans.com/api2/v2/users/me' helpers.py:11
For more information check: https://developer.mozilla.org/en-US/docs/Web/HTTP/Status/400
TRACEBACK_ [helpers.inner:11] Traceback (most recent call last): helpers.py:11
File "/home/your_username/.local/lib/python3.12/site-packages/ofscraper/classes/sessionmanager.py", line 360, in requests
r.raise_for_status()
File "/home/your_username/.local/lib/python3.12/site-packages/httpx/_models.py", line 761, in raise_for_status
raise HTTPStatusError(message, request=request, response=self)
httpx.HTTPStatusError: Client error '400 Bad Request' for url 'https://onlyfans.com/api2/v2/users/me'
For more information check: https://developer.mozilla.org/en-US/docs/Web/HTTP/Status/400 conf:
{
"main_profile": "main_profile",
"metadata": "/run/media/stuff/29e35030-fa36-49bd-a525-d85fa7a0498d/Vaults/backup/ofscraper2/meta/{model_username}_{model_id}/",
"discord": "",
"file_options": {
"save_location": "/run/media/stuff/29e35030-fa36-49bd-a525-d85fa7a0498d/Vaults/backup/ofscraper2/",
"dir_format": "{model_username}/{responsetype}/{value}/{mediatype}/",
"file_format": "{date}_{filename}.{ext}",
"textlength": 0,
"space_replacer": " ",
"date": "YYYYMMDD",
"text_type_default": "letter",
"truncation_default": true
},
"download_options": {
"file_size_max": 0,
"file_size_min": 0,
"filter": [
"Images",
"Audios",
"Videos"
],
"auto_resume": true,
"system_free_min": 0,
"max_post_count": 0
},
"binary_options": {
"mp4decrypt": "/home/stuff/.config/ofscraper/bin/mp4decrypt",
"ffmpeg": "/usr/bin/ffmpeg"
},
"cdm_options": {
"private-key": null,
"client-id": null,
"key-mode-default": "keydb",
"keydb_api": "apikey"
},
"performance_options": {
"download-sem": 6,
"threads": 10
},
"advanced_options": {
"code-execution": false,
"dynamic-mode-default": "growik",
"backend": "aio",
"downloadbars": false,
"cache-mode": "sqlite",
"appendlog": true,
"custom_values": null,
"sanitize_text": false,
"temp_dir": null,
"remove_hash_match": false,
"infinite_loop_action_mode": false,
"post_download_script": null,
"disable_auto_after": false,
"default_user_list": "main",
"default_black_list": "somebuggymodel"
},
"responsetype": {
"timeline": "Posts",
"message": "Messages",
"archived": "Archived",
"paid": "Messages",
"stories": "Stories",
"highlights": "Stories",
"profile": "Profile",
"pinned": "Posts"
},
"overwrites": {
"audios": {},
"videos": {},
"images": {},
"text": {}
}
}Same issue as user above, log and config below ofscraper_main_profile_2024-06-06.log config.json
issue may stem from
`" 2024-06-06 13:37:11:[helpers.inner:11] Traceback (most recent call last): File "C:\Users\USER\AppData\Local\Programs\Python\Python312\Lib\site-packages\ofscraper\commands\helpers\normal.py", line 30, in wrapper all_media=filters.filtermediaFinal(all_media, model_id, username) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "C:\Users\USER\AppData\Local\Programs\Python\Python312\Lib\site-packages\ofscraper\filters\media\main.py", line 42, in filtermediaFinal return helpers.previous_download_filter(media, username=username, model_id=model_id) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "C:\Users\USER\AppData\Local\Programs\Python\Python312\Lib\site-packages\ofscraper\filters\media\helpers\helpers.py", line 172, in previous_download_filter media_ids = set(get_media_ids_downloaded(model_id=modelid, username=username)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "C:\Users\USER\AppData\Local\Programs\Python\Python312\Lib\site-packages\ofscraper\db\operations\wrapper.py", line 122, in inner raise E File "C:\Users\USER\AppData\Local\Programs\Python\Python312\Lib\site-packages\ofscraper\db\operations_\wrapper.py", line 98, in inner or placeholder.databasePlaceholder().databasePathHelper( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "C:\Users\USER\AppData\Local\Programs\Python\Python312\Lib\site-packages\ofscraper\classes\placeholder.py", line 73, in inner return f(args[0], *args[1:], **kwargs) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "C:\Users\USER\AppData\Local\Programs\Python\Python312\Lib\site-packages\ofscraper\classes\placeholder.py", line 124, in databasePathHelper self._variables.update({"first_letter": model_username[0].capitalize()})
~~~~~~^^^ TypeError: 'int' object is not subscriptable2024-06-06 13:37:11:[scrape_context.scrape_context_manager:37] `
This is a different issue and should be fixed in 3.10.2
datawhores
commented
3 weeks ago This is the only one that would work python3 -m pip install git+https://github.com/datawhores/OF-Scraper.git@3.10b
and did you update the auth file
WyohKnott
commented
3 weeks ago This is the only one that would work python3 -m pip install git+https://github.com/datawhores/OF-Scraper.git@3.10b
and did you update the auth file
yes, i'll try again
Edit: Works with auth from Brave, didn't work with from Edge or Firefox.
avekifes
commented
3 weeks ago I still cannot figure this out.
Script version is 3.10.2, confirmed with ofscraper --version command.
Config is as follows:
}, "advanced_options": { "code-execution": false, "dynamic-mode-default": "growik", "backend": "aio", "downloadbars": false, "cache-mode": "sqlite", "appendlog": true, "custom_values": null, "sanitize_text": false, "temp_dir": null, "remove_hash_match": false, "infinite_loop_action_mode": false, "post_download_script": null, "disable_auto_after": false, "default_user_list": "active", "default_black_list": "" },
Yet it keeps asking me to fill out my auth info every time.
datawhores
commented
3 weeks ago Are you getting logged out when you try
avekifes
commented
3 weeks ago Are you getting logged out when you try
Nope. I've double checked that the auth is filled out correctly, too.
dunngitter
commented
3 weeks ago I'm getting what looks like (to me) the same error:
This log file is from checking out the 3.10b branch locally and building the docker container, but I've also tried with the 3.10.2 docker image, with the same results (at least as far as I could see).
Every time I try running it, I get logged out of OF.
This is running with docker-compose, using command:
command: ["ofscraper", "--config", "/home/ofscraper/config/config.json", "--daemon", "5400", "--black-list", "blacklisted", "--username", "ALL", "--posts", "all", "--action", "download", "--output", "debug", "--log", "debug"]
bogdanbdg
commented
3 weeks ago Are you getting logged out when you try
Yes. Apparently after three attempts, which look like:
2024-06-07 12:02:33:[checkers.check_auth:20] Auth Failed
2024-06-07 12:03:56:[request.get_request_auth:48] getting new signature
2024-06-07 12:03:57:[request.get_request_auth:48] getting new signature
2024-06-07 12:03:58:[sessionmanager.requests:356] failed: https://onlyfans.com/api2/v2/users/me
2024-06-07 12:03:58:[sessionmanager.requests:357] status: 400
2024-06-07 12:03:58:[sessionmanager.requests:358] response text : {"error":{"code":301,"message":"Wrong user."}}
2024-06-07 12:03:58:[sessionmanager.requests:359] headers: Headers([('date', 'Fri, 07 Jun 2024 12:03:58 GMT'), ('content-type', 'application/json; charset=utf-8'), ('content-length', '46'), ('expires', 'Thu, 19 Nov 1981 08:52:00 GMT'), ('cache-control', 'no-store, no-cache, must-revalidate'), ('pragma', 'no-cache'), ('set-cookie', 'sess=qq0hasioj8l48481dgvgn7gj6d; expires=Mon, 17-Jun-2024 12:03:58 GMT; Max-Age=864000; path=/; domain=.onlyfans.com; secure; HttpOnly'), ('access-control-allow-credentials', 'true'), ('access-control-allow-methods', 'GET, PUT, POST, DELETE, OPTIONS, PATCH'), ('access-control-allow-headers', 'Origin, Content-Type, Authorization, X-Requested-With, User-Agent, Access-Token, User-Id, Time, Sign, X-BC, App-Token, X-Of-Rev, X-Hash, Csrf'), ('access-control-expose-headers', 'Content-Length, Content-Range, Date, Access-Token, User-Id, X-OF-REV'), ('allow', 'PUT, GET, DELETE, POST'), ('x-of-rev', '202406061350-b0621cb88f'), ('strict-transport-security', 'max-age=31536000; includeSubdomains; preload'), ('x-frame-options', 'DENY'), ('cf-cache-status', 'DYNAMIC'), ('set-cookie', '__cf_bm=VDf5Lvhicaq9mipBJvsxxERnCoW5rKZex4IwGP6CQLs-1717761838-1.0.1.1-0XyeO10IF6QRKjzPVDsr2FoJXVVwnTONIVgnmybLfq8N.2JNslmkvj_ARQNEVkyQus8AteUv1N5J4nt2vc2R1g; path=/; expires=Fri, 07-Jun-24 12:33:58 GMT; domain=.onlyfans.com; HttpOnly; Secure; SameSite=None'), ('set-cookie', '_cfuvid=UqpVgu7jPncYtCMo5IWctH75NyDIIUnScpPpZIpPsoA-1717761838884-0.0.1.1-604800000; path=/; domain=.onlyfans.com; HttpOnly; Secure; SameSite=None'), ('server', 'cloudflare'), ('cf-ray', '89008084292eb1fd-WAW'), ('alt-svc', 'h3=":443"; ma=86400')])
2024-06-07 12:03:58:[helpers.inner:11] Client error '400 Bad Request' for url 'https://onlyfans.com/api2/v2/users/me'
see-spot-run
commented
3 weeks ago Similar issues here! Have 10.0.2 installed, config updated to growik, using Firefox and the OF Cookie Helper to grab auth info, added it to the Auth file, can't get past the auth screen in ofscraper. I also get logged out of the OF website sometimes after running ofscraper.
Sicofra
commented
3 weeks ago ofscraper_main_profile_2024-06-07.txt config.json
Also cannot get past the Authentication. I started today with 3.9.x2ish? and ended up with authentication error. Tried paste cookie details again, still auth error. I have done py -3 -m pip uninstall ofscraper followed by py -3 -m pip install ofscraper --upgrade
so now on 3.10.2 Also tried pasting cookie details from the Cookie helper and also manually but It ends in the same error. Since I have tried that about 20 times or so, each time now I tried ofscraper Onlyfans page will log me out.
datawhores
commented
3 weeks ago Please update to 3.10.3 when it releases a few minutes after this post
and when the 400 error happens make sure to double check the information printed to console to make sure that it matches with what your browser says
Make sure that you check to make sure that the user_agent is correct, and that there are not any additional spaces Also make sure that the right dynamic rule is being used
Sicofra
commented
3 weeks ago Please update to 3.10.3 when it releases a few minutes after this post
and when the 400 error happens make sure to double check the information printed to console to make sure that it matches with what your browser says
Make sure that you check to make sure that the user_agent is correct, and that there are not any additional spaces Also make sure that the right dynamic rule is being used
Thanks, updating to 3.10.3 AND changing dynamic rule default to : growik made the trick... (Tho https://of-scraper.gitbook.io/of-scraper/getting-started/config-options/advanced-config-options#dynamic-mode-default does not mention other modes so no clue what it does against the default deviint but it works :) )
datawhores
commented
3 weeks ago It just some data that is added to identifiy a requests as valid
They all do the same thing, the only
difference is that the other options are not up to date with changes on the site
bogdanbdg
commented
3 weeks ago Please update to 3.10.3 when it releases
It said 3.10.4 when I upgraded just now
Also make sure that the right dynamic rule is being used
Which one is "the right" one? I read above that another user changed the default to "growik" so I did the same and it seems to work now.
datawhores
commented
3 weeks ago growik is the only option that works at the moment
I've removed sneaky since that repo is deleted
I'm keeping digital and deviint as they might start working again, and if they do may be used as alternative
666diabolus
commented
3 weeks ago growik is the only option that works at the moment
I've removed sneaky since that repo is deleted
I'm keeping digital and deviint as they might start working again, and if they do may be used as alternative
I've noticed that growik working speed is pretty much slow compare to deviint, is that the nature of it or it just myself?
datawhores
commented
3 weeks ago growik is the only option that works at the moment
- I've removed sneaky since that repo is deleted
- I'm keeping digital and deviint as they might start working again, and if they do may be used as alternative
I've noticed that growik working speed is pretty much slow compare to deviint, is that the nature of it or it just myself?
I mean they all are being served via github so they should all be quick maybe It's related to growik being updated more frequently, but I am not sure
jp1151419
commented
3 weeks ago I can confirm I just did a fresh install and I got v3.10.4 which is correctly downloading content again, using "growik".
Many thanks @datawhores
BragnarXIX
commented
3 weeks ago Puedo confirmar que acabo de realizar una instalación nueva y obtuve la versión 3.10.4 que descarga contenido correctamente nuevamente, usando "growik".
Muchas gracias@datawhores
Did you just change the word to growik in the configuration or do you have to do something else because it doesn't work for me
dunngitter
commented
3 weeks ago Seems to be working for me as well with 3.10.4 and growik, thanks!
BragnarXIX
commented
3 weeks ago Parece que a mí también me funciona con 3.10.4 y growik, ¡gracias!
What browser are you using or how did you make it work? I can't get it to work.
xxtensazenxx
commented
3 weeks ago So what steps need to be take to "change dynamic-mode-default to growik"...? I've been looking but I cannot find it
datawhores
commented
3 weeks ago easiest is just to upgrade to the lastest version
carlosmqz
commented
3 weeks ago re-installed the whole pipx venv and the .config folders, installed the latest version using pipx, created from scratch the auth file and set the dynamic mode to growik as specified in the instructions yet the script is not authenticating me and then falls into an infinite loop between menus.
2024-06-08 18:36:37:[sessionmanager.<lambda>:356] attempt: 3 for https://onlyfans.com/api2/v2/users/me 2024-06-08 18:36:37:[request.get_request_auth:49] getting new signature with growik 2024-06-08 18:36:38:[sessionmanager.requests:393] failed: https://onlyfans.com/api2/v2/users/me 2024-06-08 18:36:38:[sessionmanager.requests:394] status: 400 2024-06-08 18:36:38:[sessionmanager.requests:395] response text : {"error":{"code":301,"message":"Wrong user."}} 2024-06-08 18:36:38:[sessionmanager.requests:396] headers: Headers([('date', 'Sun, 09 Jun 2024 00:37:53 GMT'), ('content-type', 'application/json; charset=utf-8'), ('content-length', '46'), ('set-cookie', 'sess=nel4f6bghe63230ibogdng292b; expires=Wed, 19-Jun-2024 00:37:53 GMT; Max-Age=864000; path=/; domain=.onlyfans.com; secure; HttpOnly'), ('expires', 'Thu, 19 Nov 1981 08:52:00 GMT'), ('cache-control', 'no-store, no-cache, must-revalidate'), ('pragma', 'no-cache'), ('access-control-allow-credentials', 'true'), ('access-control-allow-methods', 'GET, PUT, POST, DELETE, OPTIONS, PATCH'), ('access-control-allow-headers', 'Origin, Content-Type, Authorization, X-Requested-With, User-Agent, Access-Token, User-Id, Time, Sign, X-BC, App-Token, X-Of-Rev, X-Hash, Csrf'), ('access-control-expose-headers', 'Content-Length, Content-Range, Date, Access-Token, User-Id, X-OF-REV'), ('allow', 'PUT, GET, DELETE, POST'), ('x-of-rev', '202406071925-a3977a59c9'), ('strict-transport-security', 'max-age=31536000; includeSubdomains; preload'), ('x-frame-options', 'DENY'), ('cf-cache-status', 'DYNAMIC'), ('set-cookie', 'sess=nel4f6bghe63230ibogdng292b; expires=Wed, 19-Jun-2024 00:37:53 GMT; Max-Age=864000; path=/; domain=.onlyfans.com; secure; HttpOnly'), ('set-cookie', '__cf_bm=m7vDMQ9wZWO5I9KW6i4ebfAI_dhx5JcdBhkX7YiwsMU-1717893473-1.0.1.1-LLDDZhdWhQV2wbbzO1j2OOAPm4igG1rkJppo7_HYJiyuEPKX_lPMWMz5fCi2BEZXL27FBzWOcuYfHe9LhM.X9g; path=/; expires=Sun, 09-Jun-24 01:07:53 GMT; domain=.onlyfans.com; HttpOnly; Secure; SameSite=None'), ('set-cookie', '_cfuvid=EpMReNn4oRtM6_7bXd3mlmzvcyvVJ8MMkLKKCxt9dk4-1717893473069-0.0.1.1-604800000; path=/; domain=.onlyfans.com; HttpOnly; Secure; SameSite=None'), ('server', 'cloudflare'), ('cf-ray', '890d0e3e2c3549e9-MFE'), ('alt-svc', 'h3=":443"; ma=86400')]) 2024-06-08 18:36:46:[helpers.inner:11] Client error '400 Bad Request' for url 'https://onlyfans.com/api2/v2/users/me' For more information check: https://developer.mozilla.org/en-US/docs/Web/HTTP/Status/400 2024-06-08 18:36:46:[helpers.inner:11] Traceback (most recent call last): File "/home/##username##/.local/pipx/venvs/ofscraper/lib/python3.12/site-packages/ofscraper/classes/sessionmanager.py", line 397, in requests r.raise_for_status() File "/home/##username##/.local/pipx/venvs/ofscraper/lib/python3.12/site-packages/httpx/_models.py", line 761, in raise_for_status raise HTTPStatusError(message, request=request, response=self) httpx.HTTPStatusError: Client error '400 Bad Request' for url 'https://onlyfans.com/api2/v2/users/me' [ofscraper_main_profile_2024-06-08.log](https://github.com/user-attachments/files/15750042/ofscraper_main_profile_2024-06-08.log)
dvkrav
commented
3 weeks ago How to change dynamic_rule from default deviint to recommended growik ?
Bun-Bun
commented
3 weeks ago Fully removed ofscraper, installed 3.10.5 using the following
pip3 install git+https://github.com/datawhores/OF-Scraper.git@3.10.5
Set "dynamic-mode-default": "growik"
auth fail using my existing working cookie and a fresh extracted cookie.
2024-06-09 02:20:54:[sessionmanager.<lambda>:356] attempt: 3 for https://onlyfans.com/api2/v2/users/me
2024-06-09 02:20:54:[request.get_request_auth:49] getting new signature with growik
2024-06-09 02:20:55:[sessionmanager.requests:393] failed: https://onlyfans.com/api2/v2/users/me
2024-06-09 02:20:55:[sessionmanager.requests:394] status: 400
2024-06-09 02:20:55:[sessionmanager.requests:395] response text : {"error":{"code":301,"message":"Wrong user."}}
2024-06-09 02:20:55:[sessionmanager.requests:396] headers: Headers([('date', 'Sun, 09 Jun 2024 08:20:55 GMT'), ('content-type', 'application/json; charset=utf-8'), ('content-length', '46'), ('set-cookie', 'sess=12is2g17vruaccfhpsm8cgmd26; expires=Wed, 19-Jun-2024 08:20:55 GMT; Max-Age=864000; path=/; domain=.onlyfans.com; secure; HttpOnly'), ('expires', 'Thu, 19 Nov 1981 08:52:00 GMT'), ('cache-control', 'no-store, no-cache, must-revalidate'), ('pragma', 'no-cache'), ('access-control-allow-credentials', 'true'), ('access-control-allow-methods', 'GET, PUT, POST, DELETE, OPTIONS, PATCH'), ('access-control-allow-headers', 'Origin, Content-Type, Authorization, X-Requested-With, User-Agent, Access-Token, User-Id, Time, Sign, X-BC, App-Token, X-Of-Rev, X-Hash, Csrf'), ('access-control-expose-headers', 'Content-Length, Content-Range, Date, Access-Token, User-Id, X-OF-REV'), ('allow', 'PUT, GET, DELETE, POST'), ('x-of-rev', '202406071925-a3977a59c9'), ('strict-transport-security', 'max-age=31536000; includeSubdomains; preload'), ('x-frame-options', 'DENY'), ('cf-cache-status', 'DYNAMIC'), ('set-cookie', 'sess=12is2g17vruaccfhpsm8cgmd26; expires=Wed, 19-Jun-2024 08:20:55 GMT; Max-Age=864000; path=/; domain=.onlyfans.com; secure; HttpOnly'), ('set-cookie', '__cf_bm=3VjfnJeIG5XV1s5a25s5DWouH_b1siEU5M25h2_Z8hM-1717921255-1.0.1.1-ZDqDsVcnHYckwb_7EE4cKFBzs05xK5VP.23UcMFh2wHohuujLdkKzoPjX6W0xaO8haPI6BiF2SAjz5ofHe6vZg; path=/; expires=Sun, 09-Jun-24 08:50:55 GMT; domain=.onlyfans.com; HttpOnly; Secure; SameSite=None'), ('set-cookie', '_cfuvid=YAZW.b5Vp.TQf39bMfOdg3HqTxf00Aai0KFlvMfcm6c-1717921255537-0.0.1.1-604800000; path=/; domain=.onlyfans.com; HttpOnly; Secure; SameSite=None'), ('server', 'cloudflare'), ('cf-ray', '890fb4867ea82db9-YVR'), ('alt-svc', 'h3=":443"; ma=86400')])
2024-06-09 02:21:03:[helpers.inner:11] Client error '400 Bad Request' for url 'https://onlyfans.com/api2/v2/users/me'
For more information check: https://developer.mozilla.org/en-US/docs/Web/HTTP/Status/400
2024-06-09 02:21:03:[helpers.inner:11] Traceback (most recent call last):
File "/root/src/ofscraper.dev/lib/python3.11/site-packages/ofscraper/classes/sessionmanager.py", line 397, in requests
r.raise_for_status()
File "/root/src/ofscraper.dev/lib/python3.11/site-packages/httpx/_models.py", line 761, in raise_for_status
raise HTTPStatusError(message, request=request, response=self)
httpx.HTTPStatusError: Client error '400 Bad Request' for url 'https://onlyfans.com/api2/v2/users/me'
For more information check: https://developer.mozilla.org/en-US/docs/Web/HTTP/Status/400
2024-06-09 02:21:03:[helpers.inner:11] Client error '400 Bad Request' for url 'https://onlyfans.com/api2/v2/users/me'
For more information check: https://developer.mozilla.org/en-US/docs/Web/HTTP/Status/400
2024-06-09 02:21:03:[helpers.inner:11] Traceback (most recent call last):
File "/root/src/ofscraper.dev/lib/python3.11/site-packages/ofscraper/api/me.py", line 38, in _scraper_user_helper
with c.requests(constants.getattr("meEP")) as r:
File "/opt/python/3.11.6/lib/python3.11/contextlib.py", line 137, in __enter__
return next(self.gen)
^^^^^^^^^^^^^^
File "/root/src/ofscraper.dev/lib/python3.11/site-packages/ofscraper/classes/sessionmanager.py", line 349, in requests
for _ in Retrying(
File "/root/src/ofscraper.dev/lib/python3.11/site-packages/tenacity/__init__.py", line 435, in __iter__
do = self.iter(retry_state=retry_state)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/root/src/ofscraper.dev/lib/python3.11/site-packages/tenacity/__init__.py", line 368, in iter
result = action(retry_state)
^^^^^^^^^^^^^^^^^^^
File "/root/src/ofscraper.dev/lib/python3.11/site-packages/tenacity/__init__.py", line 410, in exc_check
raise retry_exc.reraise()
^^^^^^^^^^^^^^^^^^^
File "/root/src/ofscraper.dev/lib/python3.11/site-packages/tenacity/__init__.py", line 183, in reraise
raise self.last_attempt.result()
^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/opt/python/3.11.6/lib/python3.11/concurrent/futures/_base.py", line 449, in result
return self.__get_result()
^^^^^^^^^^^^^^^^^^^
File "/opt/python/3.11.6/lib/python3.11/concurrent/futures/_base.py", line 401, in __get_result
raise self._exception
File "/root/src/ofscraper.dev/lib/python3.11/site-packages/ofscraper/classes/sessionmanager.py", line 403, in requests
raise E
File "/root/src/ofscraper.dev/lib/python3.11/site-packages/ofscraper/classes/sessionmanager.py", line 397, in requests
r.raise_for_status()
File "/root/src/ofscraper.dev/lib/python3.11/site-packages/httpx/_models.py", line 761, in raise_for_status
raise HTTPStatusError(message, request=request, response=self)
httpx.HTTPStatusError: Client error '400 Bad Request' for url 'https://onlyfans.com/api2/v2/users/me'
For more information check: https://developer.mozilla.org/en-US/docs/Web/HTTP/Status/400
2024-06-09 02:21:04:[helpers.inner:11] Client error '400 Bad Request' for url 'https://onlyfans.com/api2/v2/users/me'
For more information check: https://developer.mozilla.org/en-US/docs/Web/HTTP/Status/400
2024-06-09 02:21:04:[helpers.inner:11] Traceback (most recent call last):
File "/root/src/ofscraper.dev/lib/python3.11/site-packages/ofscraper/api/init.py", line 34, in getstatus
me.scrape_user()
File "/root/src/ofscraper.dev/lib/python3.11/site-packages/ofscraper/api/me.py", line 33, in scrape_user
return _scraper_user_helper(c)
^^^^^^^^^^^^^^^^^^^^^^^
File "/root/src/ofscraper.dev/lib/python3.11/site-packages/ofscraper/api/me.py", line 53, in _scraper_user_helper
raise E
File "/root/src/ofscraper.dev/lib/python3.11/site-packages/ofscraper/api/me.py", line 38, in _scraper_user_helper
with c.requests(constants.getattr("meEP")) as r:
File "/opt/python/3.11.6/lib/python3.11/contextlib.py", line 137, in __enter__
return next(self.gen)
^^^^^^^^^^^^^^
File "/root/src/ofscraper.dev/lib/python3.11/site-packages/ofscraper/classes/sessionmanager.py", line 349, in requests
for _ in Retrying(
File "/root/src/ofscraper.dev/lib/python3.11/site-packages/tenacity/__init__.py", line 435, in __iter__
do = self.iter(retry_state=retry_state)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/root/src/ofscraper.dev/lib/python3.11/site-packages/tenacity/__init__.py", line 368, in iter
result = action(retry_state)
^^^^^^^^^^^^^^^^^^^
File "/root/src/ofscraper.dev/lib/python3.11/site-packages/tenacity/__init__.py", line 410, in exc_check
raise retry_exc.reraise()
^^^^^^^^^^^^^^^^^^^
File "/root/src/ofscraper.dev/lib/python3.11/site-packages/tenacity/__init__.py", line 183, in reraise
raise self.last_attempt.result()
^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/opt/python/3.11.6/lib/python3.11/concurrent/futures/_base.py", line 449, in result
return self.__get_result()
^^^^^^^^^^^^^^^^^^^
File "/opt/python/3.11.6/lib/python3.11/concurrent/futures/_base.py", line 401, in __get_result
raise self._exception
File "/root/src/ofscraper.dev/lib/python3.11/site-packages/ofscraper/classes/sessionmanager.py", line 403, in requests
raise E
File "/root/src/ofscraper.dev/lib/python3.11/site-packages/ofscraper/classes/sessionmanager.py", line 397, in requests
r.raise_for_status()
File "/root/src/ofscraper.dev/lib/python3.11/site-packages/httpx/_models.py", line 761, in raise_for_status
raise HTTPStatusError(message, request=request, response=self)
httpx.HTTPStatusError: Client error '400 Bad Request' for url 'https://onlyfans.com/api2/v2/users/me'
For more information check: https://developer.mozilla.org/en-US/docs/Web/HTTP/Status/400
2024-06-09 02:21:04:[checkers.check_auth:23] Auth Failed
EDIT: Installed chrome, exported cookie from chrome. That for some reason works now.
carlosmqz
commented
3 weeks ago re-installed the whole pipx venv and the .config folders, installed the latest version using pipx, created from scratch the auth file and set the dynamic mode to growik as specified in the instructions yet the script is not authenticating me and then falls into an infinite loop between menus.
2024-06-08 18:36:37:[sessionmanager.<lambda>:356] attempt: 3 for https://onlyfans.com/api2/v2/users/me 2024-06-08 18:36:37:[request.get_request_auth:49] getting new signature with growik 2024-06-08 18:36:38:[sessionmanager.requests:393] failed: https://onlyfans.com/api2/v2/users/me 2024-06-08 18:36:38:[sessionmanager.requests:394] status: 400 2024-06-08 18:36:38:[sessionmanager.requests:395] response text : {"error":{"code":301,"message":"Wrong user."}} 2024-06-08 18:36:38:[sessionmanager.requests:396] headers: Headers([('date', 'Sun, 09 Jun 2024 00:37:53 GMT'), ('content-type', 'application/json; charset=utf-8'), ('content-length', '46'), ('set-cookie', 'sess=nel4f6bghe63230ibogdng292b; expires=Wed, 19-Jun-2024 00:37:53 GMT; Max-Age=864000; path=/; domain=.onlyfans.com; secure; HttpOnly'), ('expires', 'Thu, 19 Nov 1981 08:52:00 GMT'), ('cache-control', 'no-store, no-cache, must-revalidate'), ('pragma', 'no-cache'), ('access-control-allow-credentials', 'true'), ('access-control-allow-methods', 'GET, PUT, POST, DELETE, OPTIONS, PATCH'), ('access-control-allow-headers', 'Origin, Content-Type, Authorization, X-Requested-With, User-Agent, Access-Token, User-Id, Time, Sign, X-BC, App-Token, X-Of-Rev, X-Hash, Csrf'), ('access-control-expose-headers', 'Content-Length, Content-Range, Date, Access-Token, User-Id, X-OF-REV'), ('allow', 'PUT, GET, DELETE, POST'), ('x-of-rev', '202406071925-a3977a59c9'), ('strict-transport-security', 'max-age=31536000; includeSubdomains; preload'), ('x-frame-options', 'DENY'), ('cf-cache-status', 'DYNAMIC'), ('set-cookie', 'sess=nel4f6bghe63230ibogdng292b; expires=Wed, 19-Jun-2024 00:37:53 GMT; Max-Age=864000; path=/; domain=.onlyfans.com; secure; HttpOnly'), ('set-cookie', '__cf_bm=m7vDMQ9wZWO5I9KW6i4ebfAI_dhx5JcdBhkX7YiwsMU-1717893473-1.0.1.1-LLDDZhdWhQV2wbbzO1j2OOAPm4igG1rkJppo7_HYJiyuEPKX_lPMWMz5fCi2BEZXL27FBzWOcuYfHe9LhM.X9g; path=/; expires=Sun, 09-Jun-24 01:07:53 GMT; domain=.onlyfans.com; HttpOnly; Secure; SameSite=None'), ('set-cookie', '_cfuvid=EpMReNn4oRtM6_7bXd3mlmzvcyvVJ8MMkLKKCxt9dk4-1717893473069-0.0.1.1-604800000; path=/; domain=.onlyfans.com; HttpOnly; Secure; SameSite=None'), ('server', 'cloudflare'), ('cf-ray', '890d0e3e2c3549e9-MFE'), ('alt-svc', 'h3=":443"; ma=86400')]) 2024-06-08 18:36:46:[helpers.inner:11] Client error '400 Bad Request' for url 'https://onlyfans.com/api2/v2/users/me' For more information check: https://developer.mozilla.org/en-US/docs/Web/HTTP/Status/400 2024-06-08 18:36:46:[helpers.inner:11] Traceback (most recent call last): File "/home/##username##/.local/pipx/venvs/ofscraper/lib/python3.12/site-packages/ofscraper/classes/sessionmanager.py", line 397, in requests r.raise_for_status() File "/home/##username##/.local/pipx/venvs/ofscraper/lib/python3.12/site-packages/httpx/_models.py", line 761, in raise_for_status raise HTTPStatusError(message, request=request, response=self) httpx.HTTPStatusError: Client error '400 Bad Request' for url 'https://onlyfans.com/api2/v2/users/me' [ofscraper_main_profile_2024-06-08.log](https://github.com/user-attachments/files/15750042/ofscraper_main_profile_2024-06-08.log)
Copying the cookie and sess values from chromium worked for some reason
dvkrav
commented
3 weeks ago Can you share the format of your auth.json file which works with values grayed out
bogdanbdg
commented
3 weeks ago Can you share the format of your auth.json file which works with values grayed out
$ cat .config/ofscraper/main_profile/auth.json
{
"sess": "<your_sess>",
"auth_id": "<your_auth_id>",
"auth_uid": "",
"user_agent": "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/125.0.0.0 Safari/537.36",
"x-bc": "<your_x-bc>"
}
badchoices
commented
2 weeks ago How to change dynamic_rule from default deviint to recommended growik ?
From the main menu
growikbogdanbdg
commented
2 weeks ago … and what's the story with the Auto updating config... every time? Anything to do to get the config updated once for good?
datawhores
commented
2 weeks ago Yeah it might be confusing to see that message all the time
The good thing is that the config should remain the same even if the auto updating config message appears As the config is only changed if a key is missing for the json
In any case I fixed the function that was meant to check if the config was not up to date with the current template
bogdanbdg
commented
2 weeks ago In any case I fixed the function that was meant to check if the config was not up to date with the current template
TNX 🙇
robinhugy
commented
2 weeks ago 2024-06-12 04:44:29:[run.main:28] Client error '400 Bad Request' for url 'https://onlyfans.com/api2/v2/users/me' For more information check: https://developer.mozilla.org/en-US/docs/Web/HTTP/Status/400 2024-06-12 04:44:29:[close.sendCloseMessage:41] Finished Script
Using "growik", pasted login info from cookie helper, but ask for data always and crash all time.
bollerdominik
commented
2 weeks ago Growik repo gives 404
GROWIK="https://raw.githubusercontent.com/Growik/onlyfans-dynamic-rules/main/rules.json"
Is there an alternative?
basketballhead6
commented
2 weeks ago Growik repo gives 404
GROWIK="https://raw.githubusercontent.com/Growik/onlyfans-dynamic-rules/main/rules.json"
Is there an alternative?
I am getting the same issue, the Growik rep is giving a 404 error
Mitsurugi369
commented
2 weeks ago I have tried replacing the current Growik with the webarchive one. It'll get pass the selection of what you want to scrape then fails with Status-Down.
You can try it out yourself by goin gto where ..\ofscraper\consts\values\url.py is located.
PsychoSid
commented
2 weeks ago From the Discord channel
Can someone try setting their dynamic-mode-default to deviint, and add set
"custom_values": {
"DEVIINT": "https://raw.githubusercontent.com/deviint/onlyfans-dynamic-rules/b6b1c1ae3910ed6a8bb282197a1c7dfb732fb82f/dynamicRules.json"
},
That from a pull request some dude made a week ago in de deviint repo; seems those values are still actualNot a permanent solution I imagine but a work around for now.
Bun-Bun
commented
2 weeks ago Setting it back to deviint and using the following
"custom_values": {
"DEVIINT": "https://raw.githubusercontent.com/datawhores/onlyfans-dynamic-rules/new/dynamicRules.json"
},Works now.
datawhores
commented
2 weeks ago This is the recommend pattern for 3.10.7 and latest commits on 3.10b
https://gist.github.com/datawhores/82b51e1463c2fea8286e0d41cdc35d5c
lordoffools
commented
2 weeks ago Thanks so much for the fixes.
Is there a new commit (yet) that includes everything fixed? Or do we still have to make the changes?
dunngitter
commented
2 weeks ago ~back to not working for me with the latest from your comment above @datawhores. Used option 1 from the gist with fresh auth values, but I'm getting a 401 in the response. Do you want logs?~
~Interestingly, it didn't log me out from OF this time...~
nvm, it was my fault. I copied the settings from the gist incorrectly.
alfratrople
commented
2 weeks ago Setting it back to deviint and using the following
"custom_values": { "DEVIINT": "https://raw.githubusercontent.com/datawhores/onlyfans-dynamic-rules/new/dynamicRules.json" },Works now.
i normally use the executable, i have set back to deviint from growik and i dont know what or where i'm supposed to put this custom values information. the program still closes without trying to download anything, same as the other guy.
Rustybrickc
commented
2 weeks ago Hi. I updated to commit 51c48a2. The script starts, reaches auth info input stage. I enter the data manually, but then the script does not want to work further and throws me back to the auth info input stage. ofscraper_main_profile_2024-06-13.log
Generic Instructions These are little out of date, and are meant for older versions of the script
Instead of using 'growik' use one of the valid urls listed below
If your on 3.10.7 or using the latest commits use this pattern instead of option 1
List of valid urls https://gist.github.com/datawhores/76914ae80944fe1913789e232a9b52f0
Please state your issue here other auth issue reports will be closed