Investigation: help user set up client parameters

astronomy-commons / lsdb

Large Survey DataBase

https://lsdb.io

BSD 3-Clause "New" or "Revised" License

13 stars 3 forks source link

Investigation: help user set up client parameters #247

Open nevencaplar opened 5 months ago

nevencaplar commented 5 months ago

Investigate if there is a possibility to create a helper functionality to suggest the user's optimal number of workers (threads?), memory, and similar given their use-case. Is there some way to use dask functionality to do something like that?

nevencaplar commented 1 month ago

Link documentation ticket here

delucchi-cmu commented 1 month ago

https://github.com/astronomy-commons/hipscat-import/issues/119