nebuly-ai / optimate

A collection of libraries to optimise AI model performances
https://www.nebuly.com/
Apache License 2.0
8.37k stars 643 forks source link

[Nebullvm] Add option to Nebullvm auto-installer for installing **all** libraries #310

Open Telemaco019 opened 1 year ago

Telemaco019 commented 1 year ago

Description

The Nebullvm auto-installer (nebullvm.installers.auto_installer) installs only the libraries available for the current hardware, even when --all options are specified. This means that if I run the installer on a machine with no GPUs available, all the libraries required for GPU optimization won't be installed.

It would be useful to have an option that allows installing all libraries, including GPU ones, even if no GPUs are available. Without this option, when using the installer inside a Docker image build, it is required to build the image on a GPU-enabled node. Otherwise, all the GPUs libraries won't be installed.

This prevents me from using the Nebullvm auto-installer in GitHub actions used for building Docker images, as no GPUs are available.

Proposed solution

Add --all option to auto_installer CLI