search

thisisparker / xword-dl

⬛⬜⬛ Command line tool to scrape crosswords from online solvers and save them as .puz files ⬛⬜⬛
MIT License
147 stars 32 forks source link

New amuselabs obfuscation #46

Closed boisvert42 closed 2 years ago

boisvert42 commented 2 years ago

It works on all the ones I've tested it on, but I suspect they will change things again shortly.

thisisparker commented 2 years ago

Thanks for the quick PR! I can't ship a release for a few days due to travel but I will merge this in then and as a benefit maybe we'll see if it's more-or-less stable after a few days.

boisvert42 commented 2 years ago

Yeah, that's perfect. I basically made this as a placeholder. I'll keep checking on it.

boisvert42 commented 2 years ago

They did in fact change things in the way I thought they would so I'm now pulling in the JS to find the decode key they're using.

edsantiago commented 2 years ago

Can confirm: New Yorker 2022-06-20 (today) fails to download:

'utf-8' codec can't decode byte 0x94 in position 0: invalid start byte

This patch resolves the problem. Thank you @boisvert42 .

thisisparker commented 2 years ago

Alright, let's do it! Thank you @boisvert42.