Closed tissatussa closed 1 year ago
It's close. With MultiPV 2, default Hash and 1 thread pawn actually prefers e4 at depth 16 (at least on the latest version)
then why shows my SCID output otherwise ? I use 64 Mb hash and e4 does not appear in the MPV-7 list ..
Are you using the latest version? I recently pushed some big Elo gainer commits, and I only tested the latest version with this position
aha .. i receive email notifications from GitHub, but it didn't mention any MAIN version update .. i remember you once supplied the github commands to get such LATEST version ? I certainly want to try this is SCID then, with your settings.
Just git pull
inside the directory and then recompile. The latest version is always likely to be the strongest :)
thank you. This is what i did :
roelof@roelof-HP-Elite-x2-1012-G2:~/Compiled$ git clone https://github.com/ruicoelhopedro/pawn.git --recursive
Cloning into 'pawn'...
remote: Enumerating objects: 591, done.
remote: Counting objects: 100% (25/25), done.
remote: Compressing objects: 100% (17/17), done.
remote: Total 591 (delta 8), reused 15 (delta 8), pack-reused 566
Receiving objects: 100% (591/591), 284.00 KiB | 5.36 MiB/s, done.
Resolving deltas: 100% (439/439), done.
roelof@roelof-HP-Elite-x2-1012-G2:~/Compiled$ cd pawn/
roelof@roelof-HP-Elite-x2-1012-G2:~/Compiled/pawn$ git pull
Already up to date.
so, your git pull
seemed not be needed ?
indeed, this version gives e4 a high ranking, with your settings :
Pawn is improving ! What rating does it have ? I determined about 2350 then, remember ?
uci
id name pawn
id author ruicoelhopedro
option name Clear Hash type button
option name Hash type spin default 16 min 1 max 262144
option name MultiPV type spin default 1 min 1 max 255
option name Ponder type check default false
option name Threads type spin default 1 min 1 max 512
uciok
[ it would be handy to have the UCI id value 'version' along 'author' ]
maybe you supposed i had an old version by git clone on my PC, and by doing git pull i would update to the latest (main or dev?) source ? What does git pull do ? I thought git clone always gives me the latest main source ?
git pull
works when you have already cloned the repository. Re-cloning will also update to the latest version, and in that case, the git pull
does nothing indeed.
Since your rating estimate, pawn has improved at least 100 Elo in self-play. The last time I checked it was around -80 Elo compared to Drosophila 1.6 (2655 CCRL 40/15), so that should place it in the 2400-2500 range.
I have yet to release a proper version and get in contact with testers in CCRL to get pawn properly rated. There are some issues I would like to fix first and improve a little bit the strength before doing so :)
yes, i like Pawn to compete in CCRL !
btw. i noticed a bug when using Pawn in SCID : when changing its MPV # in the settings, Pawn can not run again (because it was already loaded) : SCID gives an error .. i have to close Pawn, edit its MPV # and then restart Pawn .. i'm on Linux Xubuntu 21.10
another question regarding such position & finding best move : whenever i stumble upon another curious position, i can post it .. but will you be able to improve Pawn accordingly ? I mean in general, not only regarding "such positions" .. and what about the ELO difference by self play : do you also reference other engines ? Maybe only self-play can lead to false assumptions ? [ why Drosophilia ]
yes, i like Pawn to compete in CCRL !
btw. i noticed a bug when using Pawn in SCID : when changing its MPV # in the settings, Pawn can not run again (because it was already loaded) : SCID gives an error .. i have to close Pawn, edit its MPV # and then restart Pawn .. i'm on Linux Xubuntu 21.10
Does Scid output engine log? If it tries to reset MultiPV while pawn is searching there may be undefined behaviour.
another question regarding such position & finding best move : whenever i stumble upon another curious position, i can post it .. but will you be able to improve Pawn accordingly ? I mean in general, not only regarding "such positions" .. and what about the ELO difference by self play : do you also reference other engines ? Maybe only self-play can lead to false assumptions ? [ why Drosophilia ]
A test position is useful to identify potential weaknesses of the search and evaluation and serves as a guide to improve them. Nevertheless, all changes must be validated with self-play. There is no point in finding the best move for a given complex position if the engine blunders at the next move. Cross-referencing with other engines is also very useful to measure progress, but I don't have enough resources to do so properly. Last time I did it I just picked 5 random engines from CCRL (drosophilia being one of them) and did a quick test.
Does Scid output engine log? If it tries to reset MultiPV while pawn is searching there may be undefined behaviour.
i would think so .. good point, i will look into it.
Cross-referencing with other engines is also very useful to measure progress, but I don't have enough resources to do so properly.
well, in past years i gathered a lot of (open source) engines, maybe i can help .. at least i can point you to GitHub pages containing their source codes .. then we can use my python script to compute its (new) rating ? I attached my recent list of my gathered engines & versions & ratings : chess-engines-list.zip
regarding the SCID issue : Here is a text part of https://sourceforge.net/p/scid/wiki/TheEngineList/ :
Engine commands and directories
For each engine, you must specify the executable file to run and which directory Scid should run it in.
The most likely cause of engine starting problems is the choice of which directory the engine should run in. Some engines require an initialization or opening book file in their start directory to run properly. Other engines (like Crafty) write log files to the directory they start in, so you will need to run them in a directory where you have write access. If the directory setting for an engine is ".", Scid will just start the engine in the current directory.
So if an engine that should work fine in Scid does not start, try changing its directory setting. To avoid engines creating log files in many different directories, I recommend starting engines in the directory of the Scid User files (this is where the scid.exe file is located on Windows, or ~/.scid/ on Unix); there is a button in the dialog box for editing engine details marked scid.exe dir on Windows or ~/.scid on Unix that lets you set the engine to start in this directory. [...]
I let all engines run in their own directory .. according to the Wiki, Scid does NOT seem to write logs and Pawn does't write a log either .. only some engines (always) write their log file, but i tend to disable all logging when such (UCI) option exists.
i guess you can build a dev version which writes a log, so i can supply you the resulting log when switching MPV ?
Cross-referencing with other engines is also very useful to measure progress, but I don't have enough resources to do so properly.
well, in past years i gathered a lot of (open source) engines, maybe i can help .. at least i can point you to GitHub pages containing their source codes .. then we can use my python script to compute its (new) rating ? I attached my recent list of my gathered engines & versions & ratings : chess-engines-list.zip
Thank you :) Btw, there should be another Elo gainer coming up, almost passing LTC.
regarding the SCID issue : Here is a text part of https://sourceforge.net/p/scid/wiki/TheEngineList/ :
Engine commands and directories
For each engine, you must specify the executable file to run and which directory Scid should run it in.
The most likely cause of engine starting problems is the choice of which directory the engine should run in. Some engines require an initialization or opening book file in their start directory to run properly. Other engines (like Crafty) write log files to the directory they start in, so you will need to run them in a directory where you have write access. If the directory setting for an engine is ".", Scid will just start the engine in the current directory.
So if an engine that should work fine in Scid does not start, try changing its directory setting. To avoid engines creating log files in many different directories, I recommend starting engines in the directory of the Scid User files (this is where the scid.exe file is located on Windows, or ~/.scid/ on Unix); there is a button in the dialog box for editing engine details marked scid.exe dir on Windows or ~/.scid on Unix that lets you set the engine to start in this directory. [...]
I let all engines run in their own directory .. according to the Wiki, Scid does NOT seem to write logs and Pawn does't write a log either .. only some engines (always) write their log file, but i tend to disable all logging when such (UCI) option exists.
i guess you can build a dev version which writes a log, so i can supply you the resulting log when switching MPV ?
That's a good idea, I can work on a version with debug outputs.
Btw, there should be another Elo gainer coming up, almost passing LTC.
so, a newer Pawn version is coming .. what is LTC ?
I can work on a version with debug outputs.
yes, then you can make an UCI option 'en/disable log output' and maybe even browse for dir/file name.
so, a newer Pawn version is coming .. what is LTC ?
Long time control test, 60+0.6
recently i reached this position in one of my (tissatussa) recent online games :
r2q1rk1/5ppp/p1pbpn2/2pp1b2/8/1P1PPN1P/PBPN1PP1/R2Q1RK1 w - - 3 11
position after 10... O-O : White to move.
[ spoiler ] the best move is e4, which i failed to play .. SF and clones see this continuation as best from low depth and up, but Pawn thinks e4 is 2nd or 3rd best only at high depth AND with MPV more then 7 :
it seems Pawn is not looking for such strategical-&-tactical moves ? Or do we call this a 'positional' move ?