search

thisisparker / xword-dl

⬛⬜⬛ Command line tool to scrape crosswords from online solvers and save them as .puz files ⬛⬜⬛
MIT License
139 stars 30 forks source link

Add downloader for Financial Times puzzles #180

Open afontenot opened 5 months ago

afontenot commented 5 months ago

This adds a downloader for the three Financial Times puzzles - the daily Cryptic, the weekly Polymath, and weekly Weekend puzzle.

This adds a new dependency on pycryptodome for AES decryption. I approached this in such a way that the dependency could easily be swapped out with a different one if preferable.

afontenot commented 5 months ago

I just want to say it's understandable if you don't want to add this one, either because of the added dependency or the deobfuscation involved. It was no great amount of work on my part, I just set it as my Sunday project (last Sunday), and I've been testing it every day since then to make sure it worked reliably.

Hopefully FT does not syndicate their crosswords from some other, more easily scraped source. I attempted to figure out if this was the case, but didn't see any evidence of it.

mixographer commented 2 weeks ago

I tried to test this change, but I just get an error stating that the keyword is unrecognized.

Keyword ftc not recognized.

afontenot commented 2 weeks ago

I tried to test this change, but I just get an error stating that the keyword is unrecognized.

Keyword ftc not recognized.

Could you provide reproduction steps? The following works for me:

git clone https://github.com/thisisparker/xword-dl
cd xword-dl
git fetch origin pull/180/head:ft
git checkout ft
python -m xword_dl ftc