allow backends to suggest minibatch size

LeelaChessZero / lc0

The rewritten engine, originally for tensorflow. Now all other backends have been ported here.

GNU General Public License v3.0

2.44k stars 529 forks source link

allow backends to suggest minibatch size #1877

Closed borg323 closed 11 months ago

borg323 commented 1 year ago

I only added actual suggestions where it was easy (blas, onednn and onnx).

borg323 commented 1 year ago

The proxy backends will be done in a next PR - it needs a similar treatment for threads first. Selfplay is not (and will not be) affected as the default minibatch-size is not changed to 0 there.