search

AetherCortex / Llama-X

Open Academic Research on Improving LLaMA to SOTA LLM
Apache License 2.0
1.59k stars 101 forks source link

Adding a Docker image containing every single setup steps #21

Open ltngonnguyen opened 1 year ago

ltngonnguyen commented 1 year ago

I have created a Docker image to streamline the setup process for LLaMA-X model training on GPU rental services like vast.ai. Currently, setting up the required dependencies such as CUDA and PyTorch is a time-consuming and repetitive chore, hindering the efficiency of researchers and developers. With this Docker image, we can eliminate the need to repeat these steps every single time, making the setup process quick and hassle-free.

This Docker image encapsulates the necessary software stack, including CUDA, PyTorch, and other dependencies, allowing users to spin up a ready-to-use environment for LLaMA-X model training in minutes.

The image itself is based on Nvidia's official CUDA 11.3 docker image, with conda installing pytorch and all dependencies. I've tested it on a couple different vast.ai GPU instances and all worked.

sdake commented 1 year ago

@ltngonnguyen looks pretty cool. Can you share your dockerfile you used?

Thank you, -steve