does not set the num_cpus in ray remote task to 8, still requires 16, as in it could result in:
2024-03-28 13:23:50,928 INFO worker.py:1743 -- Started a local Ray instance. View the dashboard at 127.0.0.1:8266
(autoscaler +1m21s) Tip: use `ray status` to view detailed cluster status. To disable these messages, set RAY_SCHEDULER_EVENTS=0.
(autoscaler +1m21s) Error: No available node types can fulfill resource request {'CPU': 16.0}. Add suitable node types to this cluster to resolve this issue.
For example
does not set the num_cpus in ray remote task to 8, still requires 16, as in it could result in:
The issue seems to be setting up the remote tasks in initialization at: https://github.com/ssec-jhu/dplutils/blob/main/dplutils/pipeline/ray.py#L167-L176