jiaweizzhao / GaLore

GaLore: Memory-Efficient LLM Training by Gradient Low-Rank Projection
Apache License 2.0
1.24k stars 131 forks source link

chore: Initialize Docker setup #10

Closed tomas-gajarsky closed 3 months ago

tomas-gajarsky commented 3 months ago

This pull request introduces a Docker-based environment setup for this CUDA-utilizing application, leveraging the power of Docker Compose to streamline development and execution on GPU-enhanced systems. By integrating a Dockerfile based on the CUDA 12.1 image and a corresponding Docker Compose configuration, we enable effortless building and running of the application in a GPU-accelerated environment. With this setup, executing the code in a predefined environment is as simple as running:

docker compose up

jiaweizzhao commented 3 months ago

@tomas-gajarsky Thanks for providing the docker environment. Since we are still actively modifying the core training code, we are not planning docker wrap so far.