thisisparker / xword-dl

⬛⬜⬛ Command line tool to scrape crosswords from online solvers and save them as .puz files ⬛⬜⬛
MIT License
147 stars 32 forks source link

add partial support for crossword compiler widgets embedded in pages for by_url search #64

Closed thisisparker closed 2 years ago

thisisparker commented 2 years ago

This improves the existing by_url search a bit and also adds a check for Crossword Compiler widgets in script tags and any iframe script tags. (To support that, this also adds a CrosswordCompilerDownloader to the downloader sub-package, which hopefully will be reusable later.)

Support is currently partial as it works in some places: xword-dl "https://www.brendanemmettquigley.com/2022/11/crossword-1522-themeless-monday.html"

but not others: xword-dl "https://www.theglobeandmail.com/puzzles-and-crosswords/cryptic-crossword/?date=121122&T=0"