Closed brianjmurrell closed 1 month ago
That's a session cookie. Because session cookies don't persist beyond a session, I presume they never leave your browser's memory and are never written to disk, which means they won't be retrievable by this tool (or likely any other tool that can't read your browser's memory). If you need access to these, I suggest you look into browser extensions instead of command-line tools.
Yet another attempt at trying to get data from this particular website failed. :frowning_face:
I suggest you look into browser extensions instead of command-line tools
Fair enough. Any suggestions? I'd want to write the cookies (or even just the page content) out on every page refresh (I also employ a timed-page reloader).
Quite honestly, I'd prefer (and did attempt) to just log into the website using Python requests (like I do for a number of others) but this particular website has that Akamai Bot Detector garbage in front of it so I need the browser to establish the session and use an extension to reload the page I want to keep the session alive. And as I said, I'd be just as happy to have the page written to a file on page reload even.
Any suggestions?
Nothing terribly specific, but if you're familiar with JavaScript, you might be able to work something out with GreaseMonkey / TamperMonkey (I'm no good at JS though, so this could be a dead end).
For similar tasks I've used playwright in the past. If you haven't tried it, it's worth a look.
My Issue
One particular cookie being set is not being returned by
chrome_cookies()
I have the following code:
but it is failing to return the
session-id
cookie which you can see is being set by the website in this devtools response:Additionally, in devtools->Application tab we can see the cookie is present for the site:
pycookiecheat
doesn't return that cookie either but it returns a dozen or so others.WHYT
I don't know what to try other than the above code snippet and
pycookiecheat
CLI.Please make sure you've taken these steps before submitting a new issue:
-v
flags but didn't get any kind of debug output and--help
doesn't detail any other kind of debug/verbose options