[Suggestion]: add descriptions on how many Actors are needed given my cluster

ray-project / ray-educational-materials

This is suite of the hands-on training materials that shows how to scale CV, NLP, time-series forecasting workloads with Ray.

Apache License 2.0

344 stars 65 forks source link

Closed kamil-kaczmarek closed 1 year ago

kamil-kaczmarek commented 1 year ago

Help Ray users understand how they can estimate number of Actors and compute needed to achieve performant batch prediction. Mention the following:

actor defaults (1 cpu) and how to change it
how to assign GPU to actors
total number of actors as a function of number of cpus or gpus in the cluster.
for large cluster mention good practice of limiting the number of CPUs made available on the head node (docs).