Fix installation step (install requirements) & Add multi-GPU explanation

turboderp / exllamav2

A fast inference library for running LLMs locally on modern consumer-class GPUs

MIT License

3.2k stars 235 forks source link

Fix installation step (install requirements) & Add multi-GPU explanation #374

Closed Lyrcaxis closed 3 months ago

Lyrcaxis commented 3 months ago

There was a missing pip install -r requirements.txt step on the installation steps on main page. This PR adds it with some additional comments/reminders about conda environment (not necessary but potentially useful).

In addition, added some info for people that want to load models on multiple-GPUs.