[perf] Tentative perf fix for the pypi package (local builds were fast already)

Photoroom / datago

A golang-based data loader which can be used from Python. Processing data per sample at GB/s speeds, covering various use cases eventually.

MIT License

82 stars 0 forks source link

[perf] Tentative perf fix for the pypi package (local builds were fast already) #33

Closed blefaudeux closed 1 day ago

blefaudeux commented 1 day ago

auto GOMAXPROCS
some uarch optims, won't change much (since most of the compute is in vips)

blefaudeux commented 1 day ago

see https://github.com/Photoroom/datago/issues/32, probably what happens. Checked locally that the pypi package is really slow, not using all the CPUs (no matter the concurrency setting, go runtime issue)