Use fractional GPUs for a Ray cluster

ray-project / tune-sklearn

A drop-in replacement for Scikit-Learn’s GridSearchCV / RandomizedSearchCV -- but with cutting edge hyperparameter tuning techniques.

https://docs.ray.io/en/master/tune/api_docs/sklearn.html

Apache License 2.0

465 stars 52 forks source link

Use fractional GPUs for a Ray cluster #145

Closed Yard1 closed 3 years ago

Yard1 commented 3 years ago

Solves https://github.com/ray-project/tune-sklearn/issues/143.

I am not entirely sure if this is the full solution to the issue, but I assumed that it would be only applicable to a Ray cluster. Therefore, the new behavior is to query Ray for the number of available GPUs and assign a fraction of them to each trial in the exact same way CPUs are assigned.