search

nguyenpham / ocgdb

Open Chess Game Database Standard (OCGDB)
MIT License
31 stars 8 forks source link

export back to pgn much slower than import pgn #20

Closed Jonathan003 closed 2 years ago

Jonathan003 commented 2 years ago

When importing a pgn the speed is about 20.000 games/s on my PC, what I think is really fast. When I export a db3 database to pgn the speed is about 2000 games/s, what is rather slow in comparison exporting a Scid database to pgn for example.

nguyenpham commented 2 years ago

Did you set -cpu as large as when you created the database? Did you create the database with Moves field (text field)?

Having Moves field may be slower (for exporting) than having Moves1 or Moves2 because it can run with 1 thread only.

On my computer, I set "-cpu 4", the test database of 3.45 million games with Moves2 needs about 2:21 minutes to create (from a PGN file) and 3:0 minutes to export back to a PGN file. Quite close.

Jonathan003 commented 2 years ago

Thanks, changing -o moves to moves2 did the trick.