search

likeawizard / polyglot-composer

A library to compose polyglot opening books from PGN game collections
GNU General Public License v3.0
6 stars 0 forks source link

Lichess DB scraping #15

Open likeawizard opened 2 years ago

likeawizard commented 2 years ago

Automatic scraping of Lichess public data base.

  1. Think of a special CLI flag / parameter that the program will launch in lichess scraping mode.
  2. Find a html parser that can find all the pgn resources in the https://database.lichess.org/ open DB
  3. Scrape all the links and create web resources as defined in 5.
  4. Should respect the concurrency flag defined in 4.
  5. Optional, Low priority Allow sorting by date based on filename date postfix. Use regex to extract date
likeawizard commented 2 years ago

Dependencies: